Google-Extended
Operated by Google · Not a crawler — a robots.txt token
If you block it
Google says it does not affect your inclusion in Google Search, and is not used as a ranking signal.
What Google says it is for
Controls whether content already crawled may be used for Gemini — training future models and grounding Gemini Apps — and for Vertex AI’s Gemini API and Grounding with Google Search.
Published details
- robots.txt
- Says it respects robots.txt“It is itself a robots.txt token: the only thing it does is set a preference.”
- User agent
- None — it never sends a request.
- Verification
- No published method.There is nothing to verify: it never sends a request.
Not addressed in the documentation
- As of , Google’s documentation does not address AI Overviews — Google’s page lists Gemini and Vertex AI, and does not mention AI Overviews either way.
Source: https://developers.google.com/search/docs/crawling-indexing/google-common-crawlers Read .