Skip to content
jobs·jobs·jobs.com

jobs-jobs-jobs.com-Bot

Information for operators of career and job sites

Who we are

The jobs-jobs-jobs.com-Bot is operated by Meng GmbH (see the legal notice). It collects publicly advertised job openings from employers' career pages so that job seekers can find them on jobs-jobs-jobs.com. Every listing links to the original posting – candidates always apply with the employer.

The bot identifies itself with this user agent:

Mozilla/5.0 (compatible; jobs-jobs-jobs.com-Bot/1.0; +https://jobs-jobs-jobs.com/bot)

What the bot reads

  • public job board interfaces, job lists, sitemaps and feeds, to find openings
  • the individual postings: title, employer, location, pay range if published, and the text of the posting
  • no forms, no logins, no applicant data, and no personal data beyond contact details published in the posting itself

How the bot behaves

  • It obeys robots.txt, including Crawl-delay.
  • It requests at most one page every 10 seconds per host – less often if robots.txt asks for it.
  • It re-reads known postings about once a week and uses conditional requests, so unchanged pages are not transferred again.
  • On errors or “429 Too Many Requests” it backs off, and it honors Retry-After.
  • It does not execute JavaScript and loads no images, scripts or style sheets.

Excluding the bot

You can exclude the bot from your whole site or from parts of it in robots.txt:

User-agent: jobs-jobs-jobs.com-Bot
Disallow: /

Changes to robots.txt take effect within 24 hours. If you want postings that were already collected removed, or a different crawl rate, write to and we will take your site out of the crawl right away.