EarlyBirdBot
EarlyBirdBot is the crawler behind the Early Bird job search app. It reads the job postings that employers publish on their own job boards, so job seekers can find them and apply on the employer’s own site.
How to recognize it
Every request carries this User-Agent:
EarlyBirdBot/1.0 (+https://earlybirdjobsearch.com/bot)
What it reads
- The public job-board endpoints that applicant tracking systems provide for showing an employer’s open jobs: Greenhouse, Lever, Ashby, SmartRecruiters, Workable, Recruitee, Workday, Gem and Rippling. These are the same endpoints an employer’s own careers page uses.
- Public careers pages that publish their openings as structured data (schema.org JobPosting) or in a sitemap.
- The United States government’s official USAJOBS API.
What it does not do
- It does not sign in anywhere, create accounts, or read anything behind a login.
- It does not solve or get around CAPTCHAs or other access controls.
- It never reads job listings from Indeed, LinkedIn, Glassdoor or ZipRecruiter.
- It does not collect information about people. It reads job postings only.
How often it visits
- Most job boards are read once every 6 hours. Boards that add jobs often are read hourly. Boards with no open jobs are read once a day.
- It sends at most one request per second to any Lever site and to any single Workday site.
- If a server answers with status 429 or a Retry-After header, it waits as asked.
- A board that keeps failing is retried weekly instead.
What Early Bird shows
For each job, Early Bird shows the title, the employer, the location, the pay if the posting states it, a short summary, and when the posting was last seen on the employer’s board. Every job links to the original posting, and applications go through the employer’s own application form. When a posting is missing from the employer’s board on two visits in a row, Early Bird removes it.
How to opt out
If you are an employer and do not want your job board read, email pgbuildsapps@gmail.com from an address at your company’s domain with your company name and the address of your job board. We will stop reading the board and remove its listings within two working days.
You can also block the User-Agent above at your server. A board that keeps refusing requests is then retried only once a week.
Contact
Questions or problems with the crawler: pgbuildsapps@gmail.com.