ConpassBot: information for site owners

ConpassBot reads public event pages so founders can find your event. It identifies itself, checks your robots.txt before every request, visits slowly and never logs in. Blocking it takes one line.

How to recognise it

ConpassBot sends this user agent with every request:

ConpassBot/0.1 (+https://vernesystems.com/conpass; contact: events@vernesystems.com)

How it behaves

  • robots.txt first. Checked before every fetch, including any Crawl-delay. A disallowed path is never requested, and a source whose robots.txt blocks it is marked as such and left alone.
  • Slow by default. About one request every two seconds per site, with at most two at a time, unless you ask for slower.
  • Conditional requests. It sends If-None-Match and If-Modified-Since so unchanged pages cost you a 304, and it skips pages whose content hasn’t changed.
  • Scheduled, not constant. Most pages are checked daily or weekly. Only a ticket page around an announced on-sale time is checked more often, and only for that window.
  • Public pages only. No logins, no cookies, no forms, no attempts to get past paywalls or bot challenges. A site that shows a challenge is backed off, not retried around.
  • JavaScript pages. Some sites only show their events after running JavaScript. ConpassBot loads those in a headless browser under the same robots.txt checks and rate limits, skips images and media, and keeps no cookies between pages.
  • Finding new sources. When an event names an organiser’s or venue’s website, ConpassBot may check that site’s robots.txt, sitemap and event pages to see whether it publishes events. Personal profiles are never followed.

How to opt out

Add this to your robots.txt to block ConpassBot from your whole site:

User-agent: ConpassBot Disallow: /

Or block specific paths only. You can also email events@vernesystems.com and we’ll remove your site and its events.

What we keep from your pages

  • The facts of an event: title, dates, venue, price, organiser, registration link and deadlines.
  • The organiser’s public business contact details and public agenda speaker names.
  • A snapshot of the page for up to 180 days, used to detect changes and test our readers. After that only the extracted facts remain.

We never republish your event description. Founders see a one-line summary and a link back to your page, so registrations still happen on your site.

Want to be found?

Add schema.org Event markup to your event pages, or publish an ICS calendar or RSS feed. Structured data is read exactly, with no guesswork. Then tell us at events@vernesystems.com.

Conpass’s full principles are on the trust page. Legal detail lives in the privacy policy.