Crawler
The nwsppr bot
nwsppr reads public news feeds so it can put each story in front of the companies it matters to, with a link back to the publisher. Here's what it fetches and how to recognise it.
What it fetches
Only RSS and Atom feeds that publishers make public. It reads the headline, summary and link from each item and sends readers to the original article; it doesn't fetch or republish full article pages.
Each feed is checked at most once every 15 minutes, with If-None-Match and If-Modified-Since so an unchanged feed costs one short 304. A feed that fails is retried less and less often.
How to recognise it
User agent: nwsppr/1.0 (+https://nwsppr.ai/bot; news for marketing teams).
Requests are signed with Web Bot Auth (RFC 9421 HTTP message signatures, Ed25519) and carry Signature-Agent: "https://www.nwsppr.ai". The public keys are at https://www.nwsppr.ai/.well-known/http-message-signatures-directory.
It runs on Cloudflare Workers.
How to block it or slow it down
Remove the feed, or block the user agent above. If you'd like it fetched less often or not at all, write to us and we'll change it the same day.
Contact
hello@nwsppr.ai