{
  "id": 18887121,
  "title": "Why a System-1 Decision Model Beat a Small Local LLM on My Laptop",
  "url": "https://urgent.news/2026/11/08/why-a-system-1-decision-model-beat-a-small-local-llm-on-my-laptop",
  "topic": "ai",
  "section": "AI",
  "published": "2026-11-08T07:32:26.000Z",
  "source": {
    "name": "Dev.to",
    "slug": "dev-to",
    "url": "https://dev.to/myne06/why-a-system-1-decision-model-beat-a-small-local-llm-on-my-laptop-22od"
  },
  "original_language": "en",
  "account": "The author aimed to run a small local SLM (System-1 decision model) and connect it to a cloud LLM (large language model) environment. However, their initial plan did not work out as expected. They started by setting up Qwen 3.5-4B, but it performed poorly. They then switched to a smaller model, Qwen 3.5-2B, but the performance improvement was marginal. The author discovered Jev and decided to try an open-source System-1 decision model called Laya, which ran comfortably on their hardware.\n\nRunning the model on the iGPU via Vulkan was not faster due to shared DDR4 RAM with the CPU, which added extra driver overhead and pushed RAM usage to 12.5 GB. By switching to CPU threads directly, generation speed remained the same, but RAM usage dropped to 9.4 GB and CPU load settled around 25%. This left the laptop cooler and more responsive.\n\nWhen asking the bot to perform real tasks, like fetching Hacker News and summarizing the top post, it took over 60 seconds to respond. The bottleneck was not typing speed but prompt evaluation time. The model spent 17.87 seconds reading the prompt and tool instructions (1,337 tokens) and another 28.88 seconds reading the web text (1,548 tokens) before generating a summary. This made the author realize that even small text-generation models were not suitable for multi-step agent tasks when they bottleneck on hardware. They decided to stick to fast System-1 decision models locally and offload heavy reasoning to cloud models.",
  "summary": "Why a System-1 Decision Model Beat a Small Local LLM on My Laptop Author: myne ( mvyne06 ) Hardware: AMD Ryzen 5 5625U (6 Cores / 12 Threads), 16 GB DDR4-3200 RAM, Integrated AMD Radeon Graphics Repository: github.com/mvyne06/edge-agent-bottlenecks Tooling & Attribution: Project narrative, hardware setup, and testing by myne ; terminal log profiling, architectural diagrams, and benchmark…",
  "key_points": [
    "Author attempted to run small local SLM and connect to cloud LLM",
    "Switched to Jev open-source System-1 decision model, ran on hardware",
    "Model performed real tasks slowly due to bottleneck on hardware"
  ],
  "editors_take": null,
  "illustration": null,
  "coverage": {
    "outlets": 1,
    "also_reported_by": []
  },
  "ai_generated": true,
  "disclaimer": "Summaries, key points and the editor’s take are written by software from other outlets’ reporting and may contain errors — always check the linked original."
}