robots.txt:
Any other uses are not permitted, incl. but not limited to: for large language models (LLMs), machine learning and/or artificial intelligence-related purposes; with any of the aforementioned technologies; and/or for any commercial purposes.
Guardian content is made available under our terms and conditions of use.
Contact licensing@theguardian.com for assistance
| Agent | Rules it follows (RFC 9309) | Over the whole file |
|---|---|---|
| * | the * group | 48 Disallow rules; / allowed |
| ClaudeBot | its own group | disallowed at / (line 102) |
| Claude-SearchBot | its own group | disallowed at / (line 102) |
| Claude-User | its own group | disallowed at / (line 102) |
| Applebot-Extended | its own group | disallowed at / (line 102) |
| PerplexityBot | its own group | disallowed at / (line 102) |
| CCBot | its own group | disallowed at / (line 102) |
| Bytespider | its own group | disallowed at / (line 102) |
| meta-externalagent | its own group | disallowed at / (line 102) |
Not found by us: no API, feed or export.
Not found by us: terms of use.