crawlsignals · How we read · About, corrections and removal · Privacy · records.json

Glassdoor www.glassdoor.com · job-board

What it says about automated access

We found no statement about automated access in what we read.

robots.txt https://www.glassdoor.com/robots.txt read 2026-10-03

Agent	Rules it follows (RFC 9309)	Over the whole file
*	the `*` group	141 Disallow rules; `/` allowed
GPTBot	its own group	disallowed at `/` (line 226), with 4 Allow rules
ClaudeBot	its own group	disallowed at `/` (line 226), with 4 Allow rules
Google-Extended	its own group	disallowed at `/` (line 226), with 4 Allow rules
Applebot-Extended	its own group	disallowed at `/` (line 226), with 4 Allow rules
CCBot	its own group	disallowed at `/` (line 237)
Bytespider	its own group	disallowed at `/` (line 245)

With no group of their own, these follow the * group: Googlebot, Bingbot, OAI-SearchBot, ChatGPT-User, Claude-SearchBot, Claude-User, PerplexityBot, meta-externalagent.

Official way in

Not found by us: no API, feed or export.

Documents

Not found by us: terms of use.

Nothing here is legal advice. A mistake? Write to hello@crawlsignals.com (corrections).