PubTriviaMapBot
The crawler that keeps Pub Trivia Map's listings current. Here's what it does and how to turn it away.
How to Spot It
It identifies itself in every request with this user agent:
PubTriviaMapBot/1.0 (+https://www.pubtriviamap.com/bot)
What It Does
- Visits public trivia venue lists published by trivia companies and bars, about once a month.
- Reads facts only: venue name, address, night, start time, host, price. No text, photos or reviews.
- Makes at most one request per second to a site, and slower if your robots.txt sets a Crawl-delay.
- Caches pages and sends If-Modified-Since, so unchanged pages cost you almost nothing.
- Never logs in, never gets past paywalls, and stops on bot challenges or repeated errors.
- Links every listing back to where we found it.
How to Opt Out
Add this to your robots.txt and we'll stop crawling your site on the next run:
User-agent: PubTriviaMapBot Disallow: /
We check robots.txt before every run. If your terms of use say no automated access, we don't crawl you at all, even if robots.txt allows it.
Rather Send Us Your Data Directly?
Hosts can add and fix their nights at /submit. For a feed or partnership, reach us at the contact address coming to this page soon.