{
  "id": 15395370,
  "title": "Customer research on Reddit with an AI agent: pull full comment threads through MCP",
  "url": "https://urgent.news/2026/10/18/customer-research-on-reddit-with-an-ai-agent-pull-full-comment",
  "topic": "ai",
  "section": "AI",
  "published": "2026-10-18T10:43:05.000Z",
  "source": {
    "name": "Dev.to",
    "slug": "dev-to",
    "url": "https://dev.to/toph_a_0607897a5c9c5aca5c/customer-research-on-reddit-with-an-ai-agent-pull-full-comment-threads-through-mcp-2451"
  },
  "original_language": "en",
  "account": "Reddit comments often hold valuable insights, with discussion threads spanning multiple levels and providing details on why products were returned and alternatives purchased. To extract these comments for AI analysis, one must navigate through the nested structures, handle pagination, and manage access and rate limits. ProLevelMax offers different methods to interact with Reddit comments via MCP or a REST API. Using the REST API is easier in this scenario. The process starts with discovering available sources by describing the desired data in plain language. The response includes candidate sources, each with a scraper ID, title, pricing, and a verdict on their suitability. Next, inspecting the chosen source provides information about its input fields and an example input. This step is crucial to understand what data is required before running the extraction. The actual extraction is performed by sending a request to the run endpoint, providing the scraper and input details. The system returns a run ID, the extracted comments, the total count, a page object for pagination, costs, and download links for various file formats. If the quote for the run exceeds a certain threshold, the script stops to allow for review. The script provided in the source pulls comments from a single Reddit post, limiting the number of pages to ten and stopping the process if confirmation is required.",
  "summary": "If you have ever tried to answer \"what do people complain about in our category?\" by reading Reddit, you know the useful part is rarely the post. It is the comment thread underneath, three or four levels deep, where someone explains why they returned the product and five people reply with what they bought instead. This post walks through how to get those threads into an AI agent as structured…",
  "key_points": [
    "Reddit comments contain valuable insights for AI analysis",
    "ProLevelMax offers MCP and REST API methods to extract comments",
    "Script limits to 10 pages and requires confirmation if needed"
  ],
  "editors_take": null,
  "illustration": null,
  "coverage": {
    "outlets": 1,
    "also_reported_by": []
  },
  "ai_generated": true,
  "disclaimer": "Summaries, key points and the editor’s take are written by software from other outlets’ reporting and may contain errors — always check the linked original."
}