OAI-SearchBot
Operated by OpenAI · Builds a search index
If you block it
You stop appearing in ChatGPT search results. This is the one that sends readers back.
What OpenAI says it is for
For search: it builds the index behind ChatGPT’s search feature, where answers link back to the source.
Published details
- robots.txt
- Treats robots.txt as the opt-out, without saying it respects it“The documentation treats robots.txt as the way to opt out of search, and recommends allowing this one.”
- User agent
Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/131.0.0.0 Safari/537.36; compatible; OAI-SearchBot/1.4; +https://openai.com/searchbotMatch on the prefixOAI-SearchBot/rather than the whole string: operators version these, and an exact match stops working on the next release.- Verification
- Published address list: https://openai.com/searchbot.json
Source: https://developers.openai.com/api/docs/bots Read .