How does ChatGPT find sources?
ChatGPT finds sources when it searches the web, which it does for questions about current events, products, local information and anything its training data cannot answer well. It runs one or more searches, reads the results, writes an answer and links the pages it used.
The crawler behind this is OAI-SearchBot. OpenAI's documentation is direct: sites that are opted out of OAI-SearchBot will not be shown in ChatGPT search answers. OpenAI also says robots.txt changes take about 24 hours to reach its search systems.
Which OpenAI crawlers matter?
| User agent | What it does | Controlled by robots.txt? |
|---|---|---|
| OAI-SearchBot | Indexes pages for ChatGPT search answers and citations | Yes |
| GPTBot | Collects content for training OpenAI's models | Yes |
| ChatGPT-User | Fetches a page when a user asks ChatGPT to open it | OpenAI says rules might not apply |
The usual setup for AEO: allow OAI-SearchBot, decide separately about GPTBot. AI crawlers explained covers every major AI crawler.
What makes ChatGPT cite a page?
OpenAI does not publish a ranking formula, but the pattern across ChatGPT's answers is consistent:
- The page answers the exact question in a passage ChatGPT can lift, near the top of a section.
- It covers the sub-questions. ChatGPT often runs several searches for one question; pages that answer the follow-ups get picked more.
- It cites primary sources. When aeo.so asked ChatGPT how to get cited, its answer cited Google, OpenAI, Bing and Perplexity documentation, not marketing blogs.
- The brand is recognizable. For recommendation questions such as "best tools for X", ChatGPT names brands it sees mentioned across many sites.
- The content is current. Dated, recently updated pages win for fast-moving topics.
How do you get cited by ChatGPT, step by step?
- Allow OAI-SearchBot in robots.txt, and make sure your firewall or CDN does not block OpenAI's published IP ranges.
- Check indexing in Bing as well, using Bing Webmaster Tools.
- Rewrite key pages answer-first, with question headings and 40 to 60 word answers.
- Cite primary sources and add your own data.
- Build mentions on the sites ChatGPT tends to cite for your topic: industry publications, Reddit, YouTube, review sites.
- Test monthly. Ask ChatGPT your top 20 questions and log who it cites.
How do you track ChatGPT citations and traffic?
Track two things. First, citations: run a fixed set of questions in ChatGPT each month and record whether your site is cited and for which pages. Second, traffic: ChatGPT adds utm_source=chatgpt.com to its links, which makes these visits easy to filter in analytics. How to measure AEO puts both in one dashboard.