Ready for Agents

GPTBot

OpenAI's crawler for content that may be used to train its generative AI models.

Operated byOpenAI
TypeAI training
robots.txt tokenGPTBot
Official docsOpenAI's crawler documentation

What blocking it does

Blocking GPTBot tells OpenAI not to use your pages for model training. OpenAI treats it separately from OAI-SearchBot, so you can block training and still allow search.

robots.txt rules

To allow it everywhere:

User-agent: GPTBot
Allow: /

To block it everywhere:

User-agent: GPTBot
Disallow: /

Put these in the robots.txt file at the root of your site. A group that names GPTBot replaces your User-agent: * rules for that crawler, so copy any rules you still want into its group.

Questions

What is GPTBot?

OpenAI's crawler for content that may be used to train its generative AI models.

What happens if I block GPTBot?

Blocking GPTBot tells OpenAI not to use your pages for model training. OpenAI treats it separately from OAI-SearchBot, so you can block training and still allow search.

Does allowing GPTBot guarantee my business shows up?

No. Allowing a crawler only lets it read your pages. Whether OpenAI's products show or recommend your business depends on many things nobody outside OpenAI can see.

Other OpenAI crawlers

Not affiliated with, endorsed by or sponsored by OpenAI, Anthropic, Google, Apple, Microsoft, Perplexity or Common Crawl. ChatGPT is a trademark of OpenAI. Other names belong to their owners and are used only to identify their crawlers.

Last checked against the vendors' public documentation on November 17, 2026. Crawler names and policies change; follow the source links for the current rules.