ClaudeBot not blocked
Anthropic's ClaudeBot must be allowed to access your site to appear in Claude's answers.
Anthropic's crawlers
Anthropic uses two bots: ClaudeBot for general web fetching and Claude-Web for the browsing-enabled features inside Claude.ai. You want both allowed if you want to be cited by Claude in any context.
Unlike GPTBot, Anthropic's crawlers are more recent and less likely to be blocked by legacy rules. But they are also less well known, so many robots.txt files do not explicitly allow them either — and some WAF rules block unfamiliar user agents by default.
How to allow ClaudeBot
User-agent: ClaudeBot Allow: / User-agent: Claude-Web Allow: /
Also check your Cloudflare, Vercel, or Fastly rules for any bot-blocking that might catch unknown user agents. Whitelist ClaudeBot by user agent or IP.