{
  "id": 12257394,
  "title": "8. Synthetic customers, part 1: can a fake shopper judge your recommender?",
  "url": "https://urgent.news/2026/10/05/8-synthetic-customers-part-1-can-a-fake-shopper-judge-your-recommender",
  "topic": "ai",
  "section": "AI",
  "published": "2026-10-05T23:49:20.000Z",
  "source": {
    "name": "Dev.to",
    "slug": "dev-to",
    "url": "https://dev.to/4thwithme/8-synthetic-customers-part-1-can-a-fake-shopper-judge-your-recommender-24mg"
  },
  "original_language": "en",
  "account": "The post, part 1 of 2, discusses a method to test new recommender systems faster using simulated customers. It explains two flawed options - simulators that replay old logs, and A/B tests with real users. Simulators score well offline but lose performance online due to factors like site changes, lack of consideration for novelty, missing feedback loops, and biased data. A simulator, with five components called C1-C5, learns fake users from real data and lets them interact with a recommender. The five parts include generating fake data, running a recommender on it, and measuring the results. The post details three types of simulated users - fake data without fake people, language models acting as shoppers, and train a small model on real feedback. It also briefly mentions UserSimCRS v2, which focuses on conversational recommender systems with LLMs for text generation.",
  "summary": "source link: https://4thwithme.dev/blog/synthetic-customers-theory/ Picture a shop that sells colored and flavored toilet paper. Mint. Lavender. Bacon. You build a new \"customers also liked\" box. Offline, it scores well. You ship it to half the traffic. Three weeks later, the A/B test (a live split test) shows no difference. That is the normal story. This post is about a faster check: fake…",
  "key_points": [],
  "editors_take": "This approach enables faster testing of recommender systems by simulating customer interactions, potentially reducing reliance on A/B tests with real users and mitigating performance losses caused by site changes and biased data.",
  "illustration": null,
  "coverage": {
    "outlets": 1,
    "also_reported_by": []
  },
  "ai_generated": true,
  "disclaimer": "Summaries, key points and the editor’s take are written by software from other outlets’ reporting and may contain errors — always check the linked original."
}