crawlsignals · How we read · About, corrections and removal · Privacy · records.json

FINN.no www.finn.no · marketplace

What it says about automated access

robots.txt:

robots.txt https://www.finn.no/robots.txt read 2026-10-03

AgentRules it follows (RFC 9309)Over the whole file
*the * group73 Disallow rules; / allowed
GPTBotits own group3 Disallow rules; / allowed; not bound by 51 of the * Disallow rules
OAI-SearchBotits own group1 Disallow rule; / allowed; not bound by 72 of the * Disallow rules
ChatGPT-Userits own group1 Disallow rule; / allowed; not bound by 72 of the * Disallow rules
ClaudeBotits own group1 Disallow rule; / allowed; not bound by 53 of the * Disallow rules
Google-Extendedits own group1 Disallow rule; / allowed; not bound by 53 of the * Disallow rules
Applebot-Extendedits own group1 Disallow rule; / allowed; not bound by 53 of the * Disallow rules
CCBotits own group1 Disallow rule; / allowed; not bound by 53 of the * Disallow rules
Bytespiderits own group1 Disallow rule; / allowed; not bound by 53 of the * Disallow rules
meta-externalagentits own group1 Disallow rule; / allowed; not bound by 53 of the * Disallow rules

With no group of their own, these follow the * group: Googlebot, Bingbot, Claude-SearchBot, Claude-User, PerplexityBot.

Under RFC 9309 an agent with its own group follows only that group, so the * rules do not apply to it.

Official way in

Not found by us: no API, feed or export.

Documents

Not found by us: terms of use.

Nothing here is legal advice. A mistake? Write to hello@crawlsignals.com (corrections).