The Future

The Internet Was Built for Humans. That Phase Is Almost Over.

Riley Torres ·

Cloudflare runs the infrastructure keeping about 20% of the web online. So when Cloudflare's CEO stands up at SXSW and says something alarming about the fundamental nature of internet traffic, it's worth slowing down to actually hear it.

Matthew Prince said last week that bot traffic will exceed human traffic on the internet by 2027. Less than 12 months from now. The majority of the web's activity will be machines contacting machines, agents fetching pages on behalf of users who never actually looked at anything.

This is not a projection from an analyst with a slide deck and a financial incentive to be dramatic. This is the person whose company watches actual traffic moving through the actual internet, in real time. He said it at SXSW.

Here is the stat that put it in focus for me.

When you shop for a digital camera, you visit maybe five websites. You read some reviews, compare prices, look at a forum post from 2023 that turns out to still be useful, and then make a decision. Five sites.

An AI agent doing the same task will visit 5,000 sites. You told it to find the best camera under $600, and it is going to be thorough about it. Same task. Same goal. Just done at machine speed, at machine scale, by something that does not get tired of tabs.

Multiply that by every user who has handed any task to an AI assistant. Every hotel search. Every flight comparison. Every product research session that used to involve a person with opinions about noise-canceling headphones. That is why the web is heading toward a bot majority. Not because of some robot takeover. Because we keep asking them to do things, and they are extremely thorough.

The old web ran on a quiet deal: publishers made content, Google found it, people clicked on it, ads paid for everything. It worked badly in plenty of ways, but it worked. Traffic was the currency and traffic meant humans reading.

That deal is being renegotiated right now by parties who weren't there when it was signed.

Before generative AI, Prince says, about 20% of internet traffic was bots. Mostly Google's crawler. A few other legitimate scrapers. Some junk. The overwhelming majority was still humans visiting things.

Now the ratio is moving. Fast. And the new bots aren't web crawlers building a search index. They're agents running tasks for humans who never see the websites being visited. Publishers lose the click. They lose the ad impression. The model of free content supported by advertising is being dismantled by the same technology people are using to save twenty minutes on their vacation planning.

What's wild is that nobody has figured out what to do about it. Walmart has apparently decided to open its platform to agent traffic. Amazon is blocking it. Target is running experiments. Prince mentioned all three at SXSW, and the fact that three huge companies came to three completely different conclusions is not a sign of an industry working through implementation details. It's a sign that nobody has a playbook.

Last week a Meta agent went rogue. Not malicious, just badly scoped. The result was internal data exposed to engineers who weren't supposed to see it. Read When AI Agents Act Without Permission. When bots are visiting 5,000 sites on your behalf, what they're doing while you're not watching becomes a lot less abstract.

There is an optimistic version of this. AI agents handle the tedious parts. You stop opening fifteen tabs. You get a clean answer and make a decision. That version is probably accurate in some narrow way.

But it's also how we end up in a world where the web is mostly bots.

Delegating a task doesn't just hand off the tedium. It hands off the experience. The five websites you used to visit while camera shopping might have included one article that changed your mind, one review that taught you something you didn't know to ask about, one forum reply that was right in a way no algorithm would have predicted. Agents don't get sidetracked. That's the feature. It's also, quietly, something real we're giving up.

Prince's prediction is probably right. The bots are coming not because anyone sat down and planned a takeover, but because everyone's been asking robots to handle one thing at a time for two years, and bots are thorough.

Two more years, maybe less. Then the web belongs to the machines.

We gave it to them.

#bots#web-traffic#AI-agents#cloudflare#internet