What it does
RuledOutBot reads public news feeds, sitemaps and club pages for football injury news. It keeps headlines and links, not article text; our pages are written in our own words and link back to the source.
How it behaves
One honest User-Agent: RuledOutBot/0.1 (+https://ruledout.app; contact: [email protected]), on every request.
robots.txt first: checked before every request and on every redirect; a Crawl-delay is honoured. A site that blocks us stays blocked: we never work around it.
Gently: one request at a time per site, with a pause between requests, and conditional requests so an unchanged feed costs almost nothing.
No paywalls: we never go past one.
Contact
To ask what we read from your site, or to ask us to stop, email [email protected], or disallow RuledOutBot in your robots.txt.