In one sentence
Google-Extended is the Web crawler identifier for Google's AI-related services (Gemini, AI Overview, Vertex AI, etc.). It can be controlled separately from the regular Googlebot.
What does it look like in practice?
For example, suppose you want:
- To be indexed by ordinary Google Search
- But not used for training or citation in Gemini or AI Overview
In your robots.txt you would write: