Allow ChatGPT-User and Claude-Web in robots.txt
Allowing AI crawlers in robots.txt means explicitly permitting bots such as OpenAI's GPTBot, OAI-SearchBot and ChatGPT-User, and Anthropic's ClaudeBot and Claude-User. Blocked crawlers can't read your pages, and an explicit allow rule makes your content available to AI systems for answers and citations.Guerin GreenTactic credited to Guerin Green. See every tactic from them.