We found no statement about automated access in what we read.
| Agent | Rules it follows (RFC 9309) | Over the whole file |
|---|---|---|
| * | the * group | 168 Disallow rules; / allowed |
| Googlebot | its own group | 158 Disallow rules; / allowed; not bound by 10 of the * Disallow rules |
| GPTBot | its own group | 151 Disallow rules; / allowed; not bound by 1 of the * Disallow rules |
| OAI-SearchBot | its own group | 158 Disallow rules; / allowed; not bound by 10 of the * Disallow rules |
| ChatGPT-User | its own group | 158 Disallow rules; / allowed; not bound by 10 of the * Disallow rules |
| ClaudeBot | its own group | 151 Disallow rules; / allowed; not bound by 1 of the * Disallow rules |
| Claude-SearchBot | its own group | 158 Disallow rules; / allowed; not bound by 10 of the * Disallow rules |
| Claude-User | its own group | 158 Disallow rules; / allowed; not bound by 10 of the * Disallow rules |
| Google-Extended | its own group | 158 Disallow rules; / allowed; not bound by 10 of the * Disallow rules |
| Applebot-Extended | its own group | 151 Disallow rules; / allowed; not bound by 1 of the * Disallow rules |
| PerplexityBot | its own group | 158 Disallow rules; / allowed; not bound by 10 of the * Disallow rules |
| CCBot | its own group | 151 Disallow rules; / allowed; not bound by 1 of the * Disallow rules |
| Bytespider | its own group | 151 Disallow rules; / allowed; not bound by 1 of the * Disallow rules |
| meta-externalagent | its own group | 151 Disallow rules; / allowed; not bound by 1 of the * Disallow rules |
Not found by us: no API, feed or export.
Not found by us: terms of use.