Every new page on mojodojo.io starts a clock. We time the first verified visit from each search engine and AI crawler, and the first time an assistant reads the page live for a person. These are aggregates across every new page published in the period.
14 blog posts, 15 city pages, 40 service pages
median. Bingbot was first on 51% of pages
median. ClaudeBot was first on 49%
of new pages had a visit from an AI crawler within a day
Hours from publish to first visit #
The dot is the median across the new pages the crawler has reached (log scale), and the bar covers the middle half of those pages. Diamonds are live fetches for a person. Hollow dots mean fewer than 3 pages reached, so treat them as anecdotes.
- Search engine
- AI crawler
- Live user fetch
| Crawler | Type | Pages reached | Still waiting | Median | Middle half |
|---|---|---|---|---|---|
| Bingbot | Search engine | 56 of 73 | 23% | 14h | 14h to 14h |
| ClaudeBot | AI crawler | 55 of 73 | 25% | 14h | 13h to 14h |
| GoogleOther | Search engine | 49 of 73 | 33% | 36h | 14h to 38h |
| Googlebot | Search engine | 45 of 73 | 38% | 38h | 14h to 2.2d |
| PetalBot | Search engine | 48 of 73 | 34% | 38h | 38h to 2.3d |
| OAI-SearchBot | AI crawler | 45 of 73 | 38% | 38h | 23h to 2.1d |
| GPTBot | AI crawler | 43 of 73 | 41% | 38h | 38h to 38h |
| Amazonbot | AI crawler | 52 of 73 | 29% | 2.4d | 38h to 2.8d |
| Applebot | Search engine | 50 of 73 | 32% | 3.8d | 3.2d to 4.3d |
| PerplexityBot | AI crawler | 52 of 73 | 29% | 3.8d | 12h to 5.4d |
| Meta-ExternalAgent | AI crawler | 57 of 73 | 22% | 4.0d | 3.9d to 4.1d |
| ChatGPT-User | Live user fetch | 14 of 73 | 81% | 19h | 9.6h to 2.8d |
| DuckDuckBot | Search engine | 0 of 73 | 100% | n/a | n/a |
| Claude-User | Live user fetch | 0 of 73 | 100% | n/a | n/a |
| DuckAssistBot | Live user fetch | 0 of 73 | 100% | n/a | n/a |
Share of new pages found, over time since publishing #
Of the new pages published in the period, the share each crawler had visited by that point after publishing. Pages published near the end of the period have had less time.
-
Bingbot
-
ClaudeBot
-
GoogleOther
-
Googlebot
-
PetalBot
-
OAI-SearchBot
Daily median time to discovery #
Median time from publish for the pages published in each bucket (log scale). The number under each bucket is how many new pages it contains. Gaps are buckets with no new pages.
- First crawl, any bot
- First AI crawler
- First live user fetch
About this data. 330 pages were published since tracking began on 6 Jun 2026.
219 are excluded because their URL was already live before they were published. Visits since 12 Oct 2026 carry exact timestamps (89% of the pages in this view have at least one). Before that only the day is known, so first visits are estimated at the middle of the remaining day.
25 blog posts, 15 city pages, 45 service pages
median. Bingbot was first on 49% of pages
median. ClaudeBot was first on 40%
of new pages had a visit from an AI crawler within a day
Hours from publish to first visit #
The dot is the median across the new pages the crawler has reached (log scale), and the bar covers the middle half of those pages. Diamonds are live fetches for a person. Hollow dots mean fewer than 3 pages reached, so treat them as anecdotes.
- Search engine
- AI crawler
- Live user fetch
| Crawler | Type | Pages reached | Still waiting | Median | Middle half |
|---|---|---|---|---|---|
| Bingbot | Search engine | 67 of 89 | 25% | 14h | 12h to 14h |
| ClaudeBot | AI crawler | 66 of 89 | 26% | 14h | 14h to 14h |
| PerplexityBot | AI crawler | 63 of 89 | 29% | 32h | 9.6h to 5.4d |
| Googlebot | Search engine | 55 of 89 | 38% | 38h | 14h to 3.8d |
| GoogleOther | Search engine | 57 of 89 | 36% | 38h | 14h to 2.1d |
| OAI-SearchBot | AI crawler | 56 of 89 | 37% | 38h | 22h to 2.1d |
| GPTBot | AI crawler | 43 of 89 | 52% | 38h | 38h to 38h |
| PetalBot | Search engine | 58 of 89 | 35% | 2.1d | 38h to 2.6d |
| Amazonbot | AI crawler | 63 of 89 | 29% | 2.2d | 38h to 2.8d |
| Applebot | Search engine | 61 of 89 | 31% | 3.8d | 3.4d to 4.3d |
| Meta-ExternalAgent | AI crawler | 68 of 89 | 24% | 3.9d | 3.5d to 4.1d |
| ChatGPT-User | Live user fetch | 24 of 89 | 73% | 2.4d | 12h to 3.1d |
| Claude-User | Live user fetch | 2 of 89 | 98% | 8.4d | 6.9d to 10.0d |
| DuckDuckBot | Search engine | 0 of 89 | 100% | n/a | n/a |
| DuckAssistBot | Live user fetch | 0 of 89 | 100% | n/a | n/a |
Share of new pages found, over time since publishing #
Of the new pages published in the period, the share each crawler had visited by that point after publishing. Pages published near the end of the period have had less time.
-
Bingbot
-
ClaudeBot
-
PerplexityBot
-
Googlebot
-
GoogleOther
-
OAI-SearchBot
Weekly median time to discovery #
Median time from publish for the pages published in each bucket (log scale). The number under each bucket is how many new pages it contains. Gaps are buckets with no new pages.
- First crawl, any bot
- First AI crawler
- First live user fetch
About this data. 330 pages were published since tracking began on 6 Jun 2026.
219 are excluded because their URL was already live before they were published. Visits since 12 Oct 2026 carry exact timestamps (82% of the pages in this view have at least one). Before that only the day is known, so first visits are estimated at the middle of the remaining day.
33 blog posts, 15 city pages, 50 service pages, 6 playbooks
median. Bingbot was first on 48% of pages
median. ClaudeBot was first on 33%
of new pages had a visit from an AI crawler within a day
Hours from publish to first visit #
The dot is the median across the new pages the crawler has reached (log scale), and the bar covers the middle half of those pages. Diamonds are live fetches for a person. Hollow dots mean fewer than 3 pages reached, so treat them as anecdotes.
- Search engine
- AI crawler
- Live user fetch
| Crawler | Type | Pages reached | Still waiting | Median | Middle half |
|---|---|---|---|---|---|
| Bingbot | Search engine | 86 of 108 | 20% | 14h | 10h to 14h |
| ClaudeBot | AI crawler | 85 of 108 | 21% | 14h | 12h to 14h |
| PerplexityBot | AI crawler | 82 of 108 | 24% | 32h | 11h to 5.4d |
| GoogleOther | Search engine | 62 of 108 | 43% | 38h | 14h to 2.1d |
| OAI-SearchBot | AI crawler | 74 of 108 | 31% | 38h | 31h to 2.9d |
| GPTBot | AI crawler | 61 of 108 | 44% | 38h | 38h to 38h |
| Googlebot | Search engine | 73 of 108 | 32% | 2.2d | 24h to 5.6d |
| PetalBot | Search engine | 77 of 108 | 29% | 2.2d | 38h to 10.6d |
| Amazonbot | AI crawler | 82 of 108 | 24% | 2.3d | 36h to 2.8d |
| Meta-ExternalAgent | AI crawler | 86 of 108 | 20% | 4.0d | 3.9d to 4.4d |
| Applebot | Search engine | 80 of 108 | 26% | 4.1d | 3.5d to 5.7d |
| DuckDuckBot | Search engine | 1 of 108 | 99% | 25.4d | 25.4d to 25.4d |
| ChatGPT-User | Live user fetch | 38 of 108 | 65% | 3.1d | 25h to 15.9d |
| Claude-User | Live user fetch | 5 of 108 | 95% | 40.1d | 11.5d to 40.1d |
| DuckAssistBot | Live user fetch | 0 of 108 | 100% | n/a | n/a |
Share of new pages found, over time since publishing #
Of the new pages published in the period, the share each crawler had visited by that point after publishing. Pages published near the end of the period have had less time.
- Bingbot
- ClaudeBot
- PerplexityBot
- GoogleOther
- OAI-SearchBot
- GPTBot
Weekly median time to discovery #
Median time from publish for the pages published in each bucket (log scale). The number under each bucket is how many new pages it contains. Gaps are buckets with no new pages.
- First crawl, any bot
- First AI crawler
- First live user fetch
About this data. 330 pages were published since tracking began on 6 Jun 2026.
219 are excluded because their URL was already live before they were published. Visits since 12 Oct 2026 carry exact timestamps (78% of the pages in this view have at least one). Before that only the day is known, so first visits are estimated at the middle of the remaining day.
35 blog posts, 15 city pages, 50 service pages, 7 playbooks
median. Bingbot was first on 47% of pages
median. ClaudeBot was first on 32%
of new pages had a visit from an AI crawler within a day
Hours from publish to first visit #
The dot is the median across the new pages the crawler has reached (log scale), and the bar covers the middle half of those pages. Diamonds are live fetches for a person. Hollow dots mean fewer than 3 pages reached, so treat them as anecdotes.
- Search engine
- AI crawler
- Live user fetch
| Crawler | Type | Pages reached | Still waiting | Median | Middle half |
|---|---|---|---|---|---|
| Bingbot | Search engine | 89 of 111 | 20% | 14h | 10h to 14h |
| ClaudeBot | AI crawler | 88 of 111 | 21% | 14h | 12h to 15h |
| PerplexityBot | AI crawler | 85 of 111 | 23% | 30h | 10.0h to 5.4d |
| GoogleOther | Search engine | 62 of 111 | 44% | 38h | 14h to 2.1d |
| OAI-SearchBot | AI crawler | 77 of 111 | 31% | 38h | 26h to 2.9d |
| GPTBot | AI crawler | 64 of 111 | 42% | 38h | 38h to 38h |
| Googlebot | Search engine | 76 of 111 | 32% | 2.2d | 19h to 5.6d |
| Amazonbot | AI crawler | 85 of 111 | 23% | 2.2d | 34h to 2.8d |
| PetalBot | Search engine | 80 of 111 | 28% | 2.3d | 38h to 29.0d |
| Applebot | Search engine | 83 of 111 | 25% | 4.0d | 3.5d to 5.5d |
| Meta-ExternalAgent | AI crawler | 89 of 111 | 20% | 4.1d | 3.9d to 6.3d |
| DuckDuckBot | Search engine | 2 of 111 | 98% | 74.3d | 49.8d to 98.7d |
| ChatGPT-User | Live user fetch | 41 of 111 | 63% | 3.1d | 12h to 14.4d |
| Claude-User | Live user fetch | 5 of 111 | 95% | 40.1d | 11.5d to 40.1d |
| DuckAssistBot | Live user fetch | 1 of 111 | 99% | 123.2d | 123.2d to 123.2d |
Share of new pages found, over time since publishing #
Of the new pages published in the period, the share each crawler had visited by that point after publishing. Pages published near the end of the period have had less time.
- Bingbot
- ClaudeBot
- PerplexityBot
- GoogleOther
- OAI-SearchBot
- GPTBot
Monthly median time to discovery #
Median time from publish for the pages published in each bucket (log scale). The number under each bucket is how many new pages it contains. Gaps are buckets with no new pages.
- First crawl, any bot
- First AI crawler
- First live user fetch
About this data. 330 pages were published since tracking began on 6 Jun 2026.
219 are excluded because their URL was already live before they were published. Visits since 12 Oct 2026 carry exact timestamps (77% of the pages in this view have at least one). Before that only the day is known, so first visits are estimated at the middle of the remaining day.
Method. Publish times come from the CMS (published_at). First visits come from our own server log and leave out any hit that fails verification against the operator's published IP ranges or reverse DNS, so fake bots never count. Pages whose URL was already being crawled before their publish date (republished or migrated pages) are excluded, so the clock only starts for pages that were genuinely new. Medians use only the pages a crawler has reached; "still waiting" counts the rest.
Cite this. Mojo Dojo, “AI Discovery Index”, mojodojo.io/ai-discovery-index, accessed 20 Oct 2026. Free to reuse under CC BY 4.0 with a link back.