crawlsignals · How we read · About, corrections and removal · Privacy · records.json

Reuters www.reuters.com · publisher

What it says about automated access

robots.txt:

NOTICE: Collection of content, data and/or information from reuters.com through automated means is prohibited unless you have prior written consent from Reuters and may only be conducted for the purposes explicitly described in such permission.
automated-access · source, read 2026-10-03
If you would like to seek permission to license the content and/or other materials of Reuters, please contact https://reutersagency.com/contact-us/enquire/
permission · source, read 2026-10-03

robots.txt https://www.reuters.com/robots.txt read 2026-10-03

Agent	Rules it follows (RFC 9309)	Over the whole file
*	the `*` group	disallowed at `/` (line 130), with 1 Allow rule
Googlebot	its own group	26 Disallow rules; `/` allowed; not bound by 1 of the `*` Disallow rules
Bingbot	its own group	26 Disallow rules; `/` allowed; not bound by 1 of the `*` Disallow rules
OAI-SearchBot	its own group	26 Disallow rules; `/` allowed; not bound by 1 of the `*` Disallow rules
ChatGPT-User	its own group	26 Disallow rules; `/` allowed; not bound by 1 of the `*` Disallow rules
Applebot-Extended	its own group	disallowed at `/` (line 125)

With no group of their own, these follow the * group: GPTBot, ClaudeBot, Claude-SearchBot, Claude-User, Google-Extended, PerplexityBot, CCBot, Bytespider, meta-externalagent.

Under RFC 9309 an agent with its own group follows only that group, so the * rules do not apply to it.

Official way in

Not found by us: no API, feed or export.

Documents

Terms of Use terms · named in robots.txt, line 6 of www.reuters.com · not read by us: robots.txt's comments prohibit crawling, so our crawler reads nothing else from this host

Nothing here is legal advice. A mistake? Write to hello@crawlsignals.com (corrections).