Bots now generate 57.5% of web traffic — a year ahead of Cloudflare's own forecast
Cloudflare Radar shows automated systems now account for 57.5% of HTTP requests globally — crossing 50% more than a year before CEO Matthew Prince's own 2027 prediction — driven by agentic AI programs that visit thousands of pages per user task where a human opens a handful. Cloudflare's HTTP 402 pay-per-crawl system is live today, with customers sending over one billion 402 responses per day, giving any site operator a concrete mechanism to charge crawlers rather than just block them.
Source: techtimes.com ↗
Welp, that happened faster than I predicted.
Matthew Prince, Cloudflare CEO
Why this matters
- → Machines now consume majority of web bandwidth, upending ad-based economics.
- → Agentic AI browses thousands of pages per user task, straining infrastructure.
- → Pay-per-crawl mechanisms now give publishers pricing power over bots.
Bots won the web