Ready for Agents

Google-Extended

Not a separate crawler but a robots.txt product token. It lets you control whether content Google crawls can be used to train Gemini models and for grounding in Gemini apps.

Operated byGoogle
TypeAI training
robots.txt tokenGoogle-Extended
Official docsGoogle's crawler documentation

What blocking it does

Google says Google-Extended doesn't affect whether your site is included in Google Search or how it ranks.

robots.txt rules

To allow it everywhere:

User-agent: Google-Extended
Allow: /

To block it everywhere:

User-agent: Google-Extended
Disallow: /

Put these in the robots.txt file at the root of your site. A group that names Google-Extended replaces your User-agent: * rules for that crawler, so copy any rules you still want into its group.

Questions

What is Google-Extended?

Not a separate crawler but a robots.txt product token. It lets you control whether content Google crawls can be used to train Gemini models and for grounding in Gemini apps.

What happens if I block Google-Extended?

Google says Google-Extended doesn't affect whether your site is included in Google Search or how it ranks.

Does allowing Google-Extended guarantee my business shows up?

No. Allowing a crawler only lets it read your pages. Whether Google's products show or recommend your business depends on many things nobody outside Google can see.

Other Google crawlers

Not affiliated with, endorsed by or sponsored by OpenAI, Anthropic, Google, Apple, Microsoft, Perplexity or Common Crawl. ChatGPT is a trademark of OpenAI. Other names belong to their owners and are used only to identify their crawlers.

Last checked against the vendors' public documentation on November 17, 2026. Crawler names and policies change; follow the source links for the current rules.