We found no statement about automated access in what we read.
| Agent | Rules it follows (RFC 9309) | Over the whole file |
|---|---|---|
| * | the * group | 16 Disallow rules; / allowed |
| Bingbot | its own group | 13 Disallow rules; / allowed; not bound by 1 of the * Disallow rules |
| GPTBot | its own group | disallowed at / (line 26) |
| OAI-SearchBot | its own group | disallowed at / (line 26) |
| ChatGPT-User | its own group | disallowed at / (line 26) |
| ClaudeBot | its own group | disallowed at / (line 26) |
| Claude-SearchBot | its own group | disallowed at / (line 26) |
| Claude-User | its own group | disallowed at / (line 26) |
| Google-Extended | its own group | disallowed at / (line 26) |
| Applebot-Extended | its own group | disallowed at / (line 26) |
| PerplexityBot | its own group | disallowed at / (line 26) |
| CCBot | its own group | disallowed at / (line 26) |
| Bytespider | its own group | disallowed at / (line 26) |
| meta-externalagent | its own group | disallowed at / (line 26) |
Not found by us: no API, feed or export.
Not found by us: terms of use.