{
  "id": 10996896,
  "title": "Launch HN: Magnitude (YC S25) – Self-optimizing inference engine for agents",
  "url": "https://urgent.news/2026/09/30/launch-hn-magnitude-yc-s25-self-optimizing-inference-engine-for-agents",
  "topic": "ai",
  "section": "AI",
  "published": "2026-09-30T17:37:40.000Z",
  "source": {
    "name": "Hacker News",
    "slug": "hacker-news",
    "url": "https://github.com/magnitudedev/magnitude"
  },
  "original_language": "en",
  "account": "Magnitude, an open-source inference engine for agents, has been released by Y Combinator startup S25. This innovative tool optimizes itself to run open models as fast as possible on any hardware available, including Apple Silicon, NVIDIA, AMD, or even just a CPU. By compiling and tuning its kernels on the user's device, Magnitude enables open models to run up to twice as fast as llama.cpp.\n\nUpon installation, users can connect their preferred agent, such as Pi, OpenCode, Hermes, Codex, or any other compatible agent, with a single click. The desktop app also includes the Magnitude Command Line Interface (CLI), eliminating the need for separate installations. As an open-source project, Magnitude is eager to grow its community; users can show their support by starring the repository.\n\nThe desktop application ships with precompiled kernels for a wide range of hardware classes, ensuring optimal performance without the need for extensive customization. Magnitude's kernels are specifically optimized for the most popular open-weight families, giving it an edge over generalist engines. The framework supports a variety of models, from smaller ones compatible with limited memory devices to larger models that benefit from additional memory resources.\n\nUsers can expect improved performance on any Apple Silicon, NVIDIA, or AMD GPU, or even without a dedicated GPU. Magnitude's platform allows prompts, files, and models to remain on the user's machine, ensuring privacy and eliminating the need for internet connectivity once a model has been downloaded.",
  "summary": null,
  "key_points": [
    "Magnitude is an open-source inference engine for agents developed by Y Combinator startup S25.",
    "The engine optimizes itself to run open models up to twice as fast as llama.cpp on various hardware."
  ],
  "editors_take": null,
  "illustration": null,
  "coverage": {
    "outlets": 1,
    "also_reported_by": []
  },
  "ai_generated": true,
  "disclaimer": "Summaries, key points and the editor’s take are written by software from other outlets’ reporting and may contain errors — always check the linked original."
}