Urgent.News

What's breaking now, across thousands of outlets.

AI

I checked 15 AI search guides

I searched Google for three things people ask about AI search: "llm seo", "ai visibility" and "how to rank in chatgpt". For each search I took the first five guides. We were writing guides on the same three topics for Shruwd ( https://shruwd.io/ ), the tool we are building, so I checked the 15 on a few points our own guides would cover. Four checks came out of it that you can run on any AI search…

I examined 15 AI search guides to identify key factors to consider. I looked up three common questions: llm seo, ai visibility, and how to rank in chatgpt. For each question, I evaluated the first five guides that appeared. From my research, here are four important points to assess before following any AI search guide:

1. Source verification - Does the guide provide a source for the claimed numbers? One of the llm seo guides suggests using schema markup, but two also claim schema is on nearly every page cited by ChatGPT. However, a study showed adding schema didn't significantly increase citations in ChatGPT or Google's AI Mode. Therefore, the claim lacks solid evidence and shouldn't be a primary focus.

2. Range of numbers - Three of the five ai visibility guides recommend tracking a single visibility score, but none of them provide a range for the numbers or indicate what constitutes a significant change. In a study with 600 volunteers running prompts through ChatGPT, Claude, and Google's AI, the chance of two responses naming the same list of brands was under 1 in 100. A single number can fluctuate significantly, so it's crucial to consider the sample size and assess if the change is meaningful.

3. Vendor documentation - One of the how to rank in chatgpt guides links to OpenAI's crawler documentation. None of the guides explain how to interpret ChatGPT-User visits in your logs. OpenAI's page describes different crawlers, but it doesn't tie GPTBot to search. When reviewing your logs, differentiate between OAI-SearchBot, ChatGPT-User, and GPTBot to ensure accurate tracking.

4. Date of the check - AI answers can change rapidly, so it's essential to know when the guide's findings were gathered. In the Semrush study, the share of ChatGPT responses citing Reddit dropped dramatically from nearly six in ten in August to about one in ten in September. Without a date on the guide's checks, it's impossible to determine if the information is still relevant.

The article also includes links to three guides written based on these checks: LLM SEO, AI visibility, and how to rank in chatgpt.

Written by urgent.news from Dev.to's reporting — not their text. Machine-written — may contain errors; check the original before relying on it.

Read the original at dev.to →

More in AI

Your Finance Agent Needs an Evaluation Harness, Not Just a Prompt

Your Finance Agent Needs an Evaluation Harness, Not Just a Prompt A finance agent can produce a convincing answer and still be wrong in the one way that matters: it can make a decision without enough…

  • Implement evaluation harness for finance agents, not just prompt improvements.
  • Define decision-making scope with desired action, confidence level, evidence IDs, and rationale.
  • Create dataset with transaction types and expected behavior for regression testing.

How monday.com Runs Agent Evals Against Real Dependencies: Webinar Recap

An agent eval suite's outcome can only be trustworthy if it's operating in an environment similar to production. You can have the best grading logic in the world, but if the agent is calling mocked…

  • Monday.com used real staging clusters for agent evaluations instead of mocks.
  • Mirrord tool connects local processes to real Kubernetes cluster for testing.
  • Staging environments provide real data, current with production, allowing real end state checks.

More from Monday 21 September →