Urgent.News

What's breaking now, across thousands of outlets.

AI

We fetched 104 AI-built sites the way GPTBot does. 61% were empty.

On 20 September 2026 we fetched 120 sites made with AI app builders the way AI crawlers do: plain HTTP, no JavaScript. 61% of the live ones were empty. The data, the control group and the fixes. On 20 September 2026 we fetched 120 websites built with AI app builders the way GPTBot, ClaudeBot and PerplexityBot fetch a page: one plain HTTP request, no browser, no JavaScript. 104 of them answered.…

We haven't written up this one. Dev.to has the full story — the link below goes straight to it.

Read the original at dev.to →

More in AI

Giving Your AI Coding Assistant Live Web Access with an MCP Server

Large language models know a lot, but they don't know what changed on a website this morning. If you use Claude Code, Claude Desktop, Cursor or another MCP client, you can close that gap by connecting…

  • MCP protocol enables AI clients to call external tools
  • XCrawl MCP server offers web scraping and search functions
  • Simple setup uses hosted MCP URL without installation

Do you know that you can integrate RAG into Gemini?

I was asking random AI questions to my AI (Gemini) just to understand how it works with the skill that integrates data from Google Workspaces (emails, notes, google docs) just because I was wondering…

  • Gemini can integrate Retrieval-Augmented Generation (RAG) for enhanced inference results.
  • Users can provide Gemini with access to Google Workspaces data for improved understanding.
  • Users can curate Gemini's writing tone based on their existing documents.

More from Saturday 17 October →