AI Bot Traffic Statistics 2026: The Numbers That Matter

Automated traffic passed human traffic online in 2024, and AI crawlers now make up close to 80% of all AI bot activity. GPTBot is the single largest AI-only crawler.

AI bot traffic statistics for 2026 show that automated traffic now exceeds human traffic online, AI crawlers account for nearly 80 percent of all AI bot activity, and GPTBot from OpenAI is the largest AI-only crawler at roughly 30 percent share.

Quick answer: In 2024, automated traffic reached 51 percent of all web traffic and human activity fell to 49 percent, the first time bots surpassed humans in a decade, per the Imperva 2025 Bad Bot Report. Fastly found AI crawlers make up almost 80 percent of AI bot traffic, with Meta at 52 percent of AI crawler volume, Google at 23 percent, and OpenAI at 20 percent, while OpenAI accounts for 98 percent of real-time fetcher requests. Among AI-only crawlers in May 2025, Cloudflare ranked GPTBot first at 30 percent, ClaudeBot at 21 percent, Meta-ExternalAgent at 19 percent, Amazonbot at 11 percent, and Bytespider at 7.2 percent. GPTBot requests grew 305 percent year over year.

The headline figures for 2026

Two shifts define the year. Automated clients now outnumber people on the web, and AI crawlers are the fastest-growing slice of that automation. The table below collects the load-bearing numbers, each attributed to a named research source.

AI bot traffic statistics table

Bots overtook humans

The Imperva 2025 Bad Bot Report put automated traffic at 51 percent of all web traffic in 2024, the first year in a decade that machines outweighed people. Bad bots alone reached 37 percent, up from 32 percent the year before. Imperva attributes the jump to how cheaply large language models let attackers and scrapers spin up traffic.

Crawlers vs fetchers: the training and search split

Fastly separates AI bots into two jobs. Crawlers gather content in bulk, largely for training and indexing, and they make up almost 80 percent of AI bot traffic. Fetchers pull a single page in real time when a user asks a question, and they make up the remaining fifth. Meta leads bulk crawling at 52 percent of AI crawler volume, ahead of Google at 23 percent and OpenAI at 20 percent. On the live side the picture flips: OpenAI drives 98 percent of real-time fetcher requests, and Fastly recorded fetcher bursts above 39,000 requests per minute against single sites.

Who is crawling, and how fast it changed

Cloudflare's May 2025 breakdown of AI-only crawlers ranked GPTBot first at 30 percent, ClaudeBot at 21 percent, Meta-ExternalAgent at 19 percent, Amazonbot at 11 percent, and Bytespider at 7.2 percent. The year-over-year swing was steep. GPTBot requests grew 305 percent and its share climbed from 5 percent to 30 percent. Bytespider went the other way, dropping 85 percent in requests as its share collapsed from 42 percent to 7.2 percent. Across AI and search crawlers combined, traffic rose 18 percent year over year, and Googlebot still held half the combined category.

The crawl-to-referral gap

Cloudflare Radar tracks how many pages a company crawls for every visitor it sends back. For the week of June 19 to 26, 2025, Anthropic crawled roughly 70,900 pages for every one referral it returned. That ratio is the core tension of the AI era: models read your content at scale and send far fewer clicks back than classic search did. Knowing which bots take from your site, and how often, starts with measuring the crawl side directly.

Why these numbers are invisible in Google Analytics

Every figure above comes from server-side and network-level data. None of it appears in Google Analytics, because AI crawlers do not run the JavaScript tag GA depends on. If you want your own version of these statistics, for your own domain, you have to read the server. citAEOtion reads your real server traffic and classifies every AI and search crawler by actual hits, showing which bot hit which page, when, how often, and with what HTTP status. It measures your site the way Cloudflare, Fastly, and Imperva measure the web. citAEOtion does this for you on WordPress, so your AI crawler report is a live dashboard, not a research PDF. Plans start at $34.99 per month.

See your own AI bot numbers

Frequently Asked Questions

What percentage of web traffic is bots in 2026?

Automated traffic reached 51 percent of all web traffic in 2024 against 49 percent human, the first time bots surpassed humans in a decade, according to the Imperva 2025 Bad Bot Report. Bad bots alone made up 37 percent.

Which AI crawler has the most traffic?

It depends on the cut. Cloudflare ranked GPTBot first among AI-only crawlers at 30 percent share in May 2025. Fastly, counting all AI crawler volume, put Meta ahead at 52 percent, with OpenAI leading real-time fetchers at 98 percent.

How fast is AI crawling growing?

Cloudflare recorded GPTBot requests up 305 percent year over year to May 2025, with combined AI and search crawler traffic up 18 percent over the same period.

What is the training versus search split for AI bots?

Fastly found bulk crawlers, used mainly for training and indexing, are almost 80 percent of AI bot traffic, while real-time fetchers that answer live user questions are the remaining roughly 20 percent.

What is a crawl-to-referral ratio?

It is how many pages an AI company crawls for each visitor it refers back. Cloudflare Radar reported Anthropic at about 70,900 crawls per referral for the week of June 19 to 26, 2025.

How do I measure AI bot traffic on my own site?

Read your server access logs or use a log-based tracker. Google Analytics cannot show it, because AI crawlers do not execute its JavaScript tag. For a full walkthrough, see how to measure AEO results.

Live data source: Cloudflare Radar publishes ongoing AI crawler and traffic trends.