robots.txt:
Notice: Collection of data on Facebook through automated means is prohibited unless you have express written permission from Facebook and may only be conducted for the limited purpose contained in said permission.
All authorized user-agents listed on this page must comply with Meta’s Automated Data Collection Terms available at: https://www.facebook.com/legal/automated_data_collection_terms
| Agent | Rules it follows (RFC 9309) | Over the whole file |
|---|---|---|
| * | the * group | disallowed at / (line 1352) |
| Googlebot | its own group | 41 Disallow rules; / allowed; not bound by 1 of the * Disallow rules |
| Bingbot | its own group | 41 Disallow rules; / allowed; not bound by 1 of the * Disallow rules |
| GPTBot | its own group | 41 Disallow rules; / allowed; not bound by 1 of the * Disallow rules |
| ClaudeBot | its own group | 41 Disallow rules; / allowed; not bound by 1 of the * Disallow rules |
| Google-Extended | its own group | 41 Disallow rules; / allowed; not bound by 1 of the * Disallow rules |
| Applebot-Extended | its own group | 41 Disallow rules; / allowed; not bound by 1 of the * Disallow rules |
| PerplexityBot | its own group | 41 Disallow rules; / allowed; not bound by 1 of the * Disallow rules |
Not found by us: no API, feed or export.