{
  "id": 19742624,
  "title": "I'm about to ask ChatGPT, Perplexity and Gemini the same five product questions. Tear my method apart first.",
  "url": "https://urgent.news/2026/11/13/im-about-to-ask-chatgpt-perplexity-and-gemini-the-same-five-product",
  "topic": "ai",
  "section": "AI",
  "published": "2026-11-13T02:21:43.000Z",
  "source": {
    "name": "Dev.to",
    "slug": "dev-to",
    "url": "https://dev.to/thiagolongom/im-about-to-ask-chatgpt-perplexity-and-gemini-the-same-five-product-questions-tear-my-method-4gon"
  },
  "original_language": "en",
  "account": "The author plans to conduct an experiment comparing ChatGPT, Perplexity, and Gemini AI assistants by asking them the same five product-related questions. The purpose is to analyze the sources cited in their responses, rather than simply checking if the AI mentions the product. The protocol involves running each question through each AI five times, with each run logged with precise timestamps and settings. Factors that can affect the answers, such as personalized responses, model changes, and user screenshots of successful interactions, are acknowledged as limitations. By recording the specific sentences lifted from sources, the author aims to identify patterns in which types of pages are more frequently cited. The experiment will focus on five question types that represent different page formats: listicles, comparison posts, documentation, definitions, and research summaries. The goal is to determine which page formats are preferred by the AIs for providing definitions or explanations. The author plans to publish the results alongside the raw data and the exact methodology, in order to ensure transparency and accountability in the analysis.",
  "summary": "Everyone has a screenshot of what an AI said about their product. Almost nobody has a method. Before I run mine, here's the protocol, so you can tell me where it's broken. This post has no results. That's deliberate. If I publish the method first, I can't quietly adjust it after seeing numbers I don't like. Think of it as a pre-registration, the way good studies do it, just much smaller. Why…",
  "key_points": [
    "Responses will be analyzed based on the sources cited, not just the mention of the product.",
    "The experiment will focus on five question types representing different page formats."
  ],
  "editors_take": "Standardizing question types and response logging shifts the focus from simple accuracy to a deeper understanding of how different AI models prioritize specific web content formats.",
  "illustration": null,
  "coverage": {
    "outlets": 1,
    "also_reported_by": []
  },
  "ai_generated": true,
  "disclaimer": "Summaries, key points and the editor’s take are written by software from other outlets’ reporting and may contain errors — always check the linked original."
}