crawlsignals · How we read · About, corrections and removal · Privacy · records.json

Witted witted.com · broker

What it says about automated access

robots.txt:

AI / answer engines — explicitly allowed so Witted can be surfaced and cited in AI search (ChatGPT, Perplexity, Google AI Overviews, Claude). Flip any of these to "Disallow: /" if Witted decides to opt a given crawler out.
automated-access, ai-training · source, read 2026-10-03

robots.txt https://witted.com/robots.txt read 2026-10-03

Agent	Rules it follows (RFC 9309)	Over the whole file
*	the `*` group	nothing disallowed
GPTBot	its own group	nothing disallowed
OAI-SearchBot	its own group	nothing disallowed
ChatGPT-User	its own group	nothing disallowed
ClaudeBot	its own group	nothing disallowed
Google-Extended	its own group	nothing disallowed
PerplexityBot	its own group	nothing disallowed

With no group of their own, these follow the * group: Googlebot, Bingbot, Claude-SearchBot, Claude-User, Applebot-Extended, CCBot, Bytespider, meta-externalagent.

Official way in

Not found by us: no API, feed or export.

Documents

Not found by us: terms of use.

Witted Privacy Policy policy · linked from https://witted.com/ as "Privacy Policy" · read 2026-10-03

Cookies policy · linked from https://witted.com/ as "Cookies" · read 2026-10-03

Nothing here is legal advice. A mistake? Write to hello@crawlsignals.com (corrections).