{
  "id": 5893209,
  "title": "The Fixpoint No Test Suite Can Check",
  "url": "https://urgent.news/2026/09/06/the-fixpoint-no-test-suite-can-check",
  "topic": "tech",
  "section": "Tech",
  "published": "2026-09-06T03:00:00.000Z",
  "source": {
    "name": "Dev.to",
    "slug": "dev-to",
    "url": "https://dev.to/megapixel99/the-fixpoint-no-test-suite-can-check-31o4"
  },
  "original_language": "en",
  "account": "The fixpoint test suite for the LM language, which supports C, WebAssembly, ARM64, and bytecode VM backends, consists of 94 tests that compare outputs byte for byte across all backends. It can detect subtle backend differences but cannot catch a compiler that quietly disagrees with its own output. The most notable issue is that the compiler written in LM does not compile itself correctly, passing all tests while producing incorrect results. Other tests include ARM64 losing a register in memmove and the compiler driver truncating large output. The fixpoint test goes beyond a regular test suite by checking if a compiler, when run on its own source, produces identical output. This self-hosting approach proves the compiler's consistency but does not guarantee its correctness. The fixpoint test reveals limitations in the language, such as a bug where a growable arena and stored address mix, causing incorrect storage behavior.",
  "summary": "Code: Megapixel99/lambda-language lm is a small low-level language with four independent backends: C, WebAssembly, ARM64, and bytecode for a VM. Its test suite is built around the fact that there are four of them. Every program runs through all four and the outputs are compared byte for byte against each other and against a recorded expectation, so a backend that gets something subtly wrong…",
  "key_points": [
    "Fixpoint test suite checks compiler consistency across backends",
    "LM compiler fails to compile itself correctly, passing tests with wrong results",
    "Test reveals language limitations like arena and address storage bug"
  ],
  "editors_take": "The limitations of the fixpoint test suite, revealed through its inability to catch certain compiler errors, highlight a need for more comprehensive testing methods to ensure compiler correctness.",
  "illustration": null,
  "coverage": {
    "outlets": 1,
    "also_reported_by": []
  },
  "ai_generated": true,
  "disclaimer": "Summaries, key points and the editor’s take are written by software from other outlets’ reporting and may contain errors — always check the linked original."
}