Claude-SearchBot
Operated by Anthropic · Builds a search index
If you block it
You stop being cited in Claude’s search results.
What Anthropic says it is for
Navigates the web to improve search result quality for users.
Published details
- robots.txt
- Says it respects robots.txt
- User agent
- Not published as a full string. Anthropic publishes only the token.Match on the prefix
Claude-SearchBotrather than the whole string: operators version these, and an exact match stops working on the next release. - Verification
- Published address list: https://claude.com/crawling/bots.json
Source: https://support.claude.com/en/articles/8896518 Read .