What is actually knowable#
There is no public recrawl frequency for ChatGPT, and anyone quoting a fixed number is guessing. What you can measure is the result, whether ChatGPT cites your pages, and Prefer checks that for you. OpenAI does not publish how often GPTBot or OAI-SearchBot returns to a given site. Crawl rate for any web crawler generally follows how often a page changes and how authoritative it is, but OpenAI makes no commitment you can plan around, so treat “ChatGPT recrawls every N days” claims with suspicion unless they come from measured data.
There is an important wrinkle that makes the question less urgent than it sounds. ChatGPT does two different things:
- A background crawl that gathers content, with no published cadence.
- Live web search at answer time. OpenAI documents that ChatGPT decides to search the web while answering and fetches live pages via OAI-SearchBot.
Because of the second path, a fresh, crawlable, well-linked page can be retrieved and cited the same day it publishes, without waiting for any recrawl. We saw this in our own run 1 test: ChatGPT retrieved and cited a newly corrected page for the “What is Prefer” prompt, which only happens with live retrieval, not a fixed schedule.
How to measure it yourself#
Your server logs are the only reliable answer, so instrument them instead of trusting a published figure.
- Watch for the crawler user agents. Look for GPTBot and OAI-SearchBot in your access logs to see when OpenAI’s crawlers actually hit your pages.
- Verify against OpenAI’s IP ranges. OpenAI publishes the IP lists for its crawlers, so you can confirm a visit is genuine and filter out bots that spoof the user agent.
- Track per-page, not just per-site. A high-value page may be fetched far more often than a buried one, so measure the pages you care about being cited.
- Correlate crawls with citations. Being crawled is necessary but not sufficient. Pair the log data with what ChatGPT actually cites so you know whether a recrawl changed the answer, which is the outcome that matters.
If you would rather not parse raw logs, Prefer’s AI crawler and referral analytics surfaces AI crawler activity and the referral traffic that follows. To check whether your pages are even reachable by these crawlers first, run our free AI crawler access checker, or run a free AI visibility audit to see whether recent crawls are actually turning into citations.
Sources
- OpenAI documents that ChatGPT decides to search the web at answer time and fetches live pages via OAI-SearchBot, which is separate from any bulk training crawl. So new content can be retrieved the same day without waiting for a periodic recrawl. OpenAI Help Center: Searching the web with ChatGPT
- OpenAI publishes crawler names and IP ranges (GPTBot, OAI-SearchBot) for allowing them through robots.txt and firewalls, which is what lets you identify their visits in your own server logs. OpenAI Help Center: Advertiser guidance for allowing OpenAI web crawlers
- In our own run 1 test, ChatGPT retrieved and cited a newly corrected page for the "What is Prefer" prompt, confirming live retrieval of updated content rather than a fixed recrawl schedule. (Prefer AEO loop gap report (run 1), dated research note)
- Prefer, our product, tracks citations and mentions of your brand in ChatGPT, Gemini, Perplexity, Google AI Overviews and Google AI Mode, on every plan. Prefer pricing (our product)
People also ask
- How often does GPTBot crawl my website?
- How frequently does ChatGPT update its data about my site?
- How long before ChatGPT sees a new page I published?