Cloudflare Just Shipped a Web Search API for AI Agents. Here's What the Hype Skips.

On October 2, Cloudflare launched a beta version of a Web Search API, receiving over 540 points on Hacker News within a day. The hype often focuses on Cloudflare "eating another layer" or being a hypocrite about crawling, but the key question is whether to integrate this into your agent. The answer is likely yes for prototypes, with caution before deploying to products.

The API is not a search index from Cloudflare, but rather a router that uses three providers - Ceramic.ai, Exa, and Linkup. Requests go through AI Gateway and can be billed using AI Gateway credits. You can also bring your own provider keys, offering a swappable providers feature. All three providers support Zero Data Retention for Cloudflare requests.

To use the API, you make a POST request to a specific endpoint with your query, provider, limit, and gateway options. Switching providers involves changing one string in the request. The API can be used in Workers with a simple binding call. Rotating providers based on cost and quality is a practical use case.

The changelog mentions it's a beta with no pricing tiers, rate limits, or regional availability. The HN discussion provided rough estimates, with Ceramic.ai being the cheapest (~$0.25 per 1,000 requests) but with quality concerns, while Exa was the most expensive (~$7.00 per 1,000 requests). Other sources suggest Brave's API is around $5 per 1,000 requests.

The most important takeaway is that Zero Data Retention is great for privacy but can block useful product features like storing search results. If you need to persist results, check the provider's terms. Exa charges for not storing data, while Brave's API allows storage at a premium.

Ultimately, the decision depends on whether you need to store results, have a budget cap, and if you trust the platform concentration. If you already use Workers or AI Gateway for your agent, integrating this search API can be beneficial with minimal changes to your agent's logic. But be cautious about storing or republishing results and verify pricing before committing to a product.