Crawler Information
About CronCareersBot
What it is
CronCareers collects publicly listed job openings so job seekers can be alerted when new roles are posted. Every listing links back to the original posting where the candidate applies.
Our requests identify themselves with the User-Agent CronCareersBot/1.0 (+https://croncareers.com/bot).
How it behaves
- It reads your
/robots.txtbefore fetching and skips anything you disallow. - It waits between requests to the same host and backs off when it receives 429 or 5xx responses.
- It only reads public job listing pages and public job APIs. It does not log in or bypass access controls.
Blocking or removal
To stop the crawler, add this to your robots.txt:
User-agent: CronCareersBot Disallow: /
To have existing listings removed, or to report a problem, email [email protected].