{
  "id": 12422202,
  "title": "Why \"works on my machine\" often means \"I'm still in variant B\" — QA rules for testing behind A/B experiments and feature flags",
  "url": "https://urgent.news/2026/10/06/why-works-on-my-machine-often-means-im-still-in-variant-b-qa-rules",
  "topic": "tech",
  "section": "Tech",
  "published": "2026-10-06T16:50:24.000Z",
  "source": {
    "name": "Dev.to",
    "slug": "dev-to",
    "url": "https://dev.to/denis_skvortsov/why-works-on-my-machine-often-means-im-still-in-variant-b-qa-rules-for-testing-behind-ab-2epm"
  },
  "original_language": "en",
  "account": "When your product is released behind A/B experiments and feature flags, a common issue arises: variant amnesia. As a QA team member, you may add yourself to an experiment's testing group to test a feature, switch between variants, and then move on to another task. Several weeks later, while testing a different aspect of the product, you may encounter unexpected behavior. This strange behavior leads to filing a bug report, unaware that you are still enrolled in variant B of an experiment you have forgotten about. Lead QA engineer explains the costs of this variant amnesia, the rules implemented to combat it, and the tool they built to streamline the process.",
  "summary": "If your product ships behind A/B experiments and feature flags, your QA team has a failure mode nobody tracks: variant amnesia . You add yourself to an experiment's testing group to check a feature, switch variants a couple of times, move on. A week later you're testing something else, the app behaves strangely, and you file a bug — not knowing you're still enrolled in variant B of an experiment…",
  "key_points": [
    "Variant amnesia occurs when QA team members forget which experiment variant they are in.",
    "Unexpected behavior leads to bug reports without realizing the user is still in variant B.",
    "QA team implemented rules and a tool to streamline testing behind A/B experiments."
  ],
  "editors_take": null,
  "illustration": null,
  "coverage": {
    "outlets": 1,
    "also_reported_by": []
  },
  "ai_generated": true,
  "disclaimer": "Summaries, key points and the editor’s take are written by software from other outlets’ reporting and may contain errors — always check the linked original."
}