Cloudflare unveils new tools and integrations to help companies adapt to the agentic internet

Cloudflare is addressing the rise of the agentic internet, where automated AI agents now account for more than half of all web traffic. To manage this shift, the company has introduced new tools and commercial partnerships designed to help website owners regain control over their content and data consumption.

Beginning September 15, 2026, Cloudflare will implement a new default policy for its customers. This update distinguishes between standard search crawlers, AI training bots, and automated agents. New users will automatically allow search traffic while restricting AI training and agent activity on ad-supported pages. Existing free users will also adopt these defaults unless they choose to adjust their individual settings.

These updates include the Attribution Business Insights dashboard. This feature provides publishers with clear data on how AI bots consume their content and generate referral traffic. By offering visibility into these interactions, site owners can better understand the impact of AI on their digital properties.

Cloudflare is also moving into a pay-per-use model. Through partnerships with firms like Ceramic.ai and You.com, publishers can now automate payment collection for content used in AI responses. This approach aims to create a sustainable ecosystem where content creators receive compensation when their work feeds AI models, ensuring transparency between publishers and AI companies.