---
title: "Allow ChatGPT-User and Claude-Web in robots.txt"
description: "Allow GPTBot, OAI-SearchBot, ChatGPT-User, ClaudeBot and Claude-User in robots.txt. AI systems can only cite pages their crawlers can read."
url: https://aeo.so/tactics/allow-chatgpt-user-and-claude-web-in-robots-txt
author: "Paul Andre de Vera"
updated: 2026-11-15
---

# Allow ChatGPT-User and Claude-Web in robots.txt

Allowing AI crawlers in robots.txt means explicitly permitting bots such as OpenAI's GPTBot, OAI-SearchBot and ChatGPT-User, and Anthropic's ClaudeBot and Claude-User. Blocked crawlers can't read your pages, and an explicit allow rule makes your content available to AI systems for answers and citations.

- Area: [Content Strategy & UX](https://aeo.so/categories/content-strategy)
- Credited to: [Guerin Green](https://aeo.so/experts/guerin-green)
- Part of: [the aeo.so answer engine optimization checklist](https://aeo.so/categories)

The worked example, why this helps with AI search, and the original source are free for members: https://aeo.so/sign-in


Read the guide:

- [AI crawlers explained: GPTBot, OAI-SearchBot, ClaudeBot and more](https://aeo.so/guides/ai-crawlers)
- [Is SEO dead?](https://aeo.so/guides/is-seo-dead)
- [What is query fan-out?](https://aeo.so/guides/query-fan-out)

## More in Content Strategy & UX

- [Avoid overusing affiliate links or ads above the fold](https://aeo.so/tactics/avoid-overusing-affiliate-links-or-ads-above-the-fold)
- [Account for different learning styles in content](https://aeo.so/tactics/account-for-different-learning-styles-in-content)
- [Create a strong value proposition on each page](https://aeo.so/tactics/create-a-strong-value-proposition-on-each-page)
- [Create category pages that organize subtopics](https://aeo.so/tactics/create-category-pages-that-organize-subtopics)
- [Develop content for every stage of the customer path](https://aeo.so/tactics/develop-content-for-every-stage-of-the-customer-path)
