{
  "id": 12801868,
  "title": "I put seven LLMs on a USB stick. Here is everything that broke.",
  "url": "https://urgent.news/2026/10/08/i-put-seven-llms-on-a-usb-stick-here-is-everything-that-broke",
  "topic": "ai",
  "section": "AI",
  "published": "2026-10-08T06:09:51.000Z",
  "source": {
    "name": "Dev.to",
    "slug": "dev-to",
    "url": "https://dev.to/alfred_odong_322108a5cc3d/i-put-seven-llms-on-a-usb-stick-here-is-everything-that-broke-39cc"
  },
  "original_language": "en",
  "account": "Seven large language models were placed onto a USB stick, causing various issues. The problems encountered are:\n\n1. Missing Microsoft runtime DLLs on Windows led to a successful start but no output from the program.\n2. Windows shells commands failed to run, resulting in exit code -1, which could be resolved by using a separate engine for Windows.\n3. Linux systems lack a double-click mechanism and may not launch .desktop files or executable scripts from outside the standard app folders.\n4. FAT32 file systems only mark specific file extensions as executable, causing issues with Linux launchers.\n5. The copying process sometimes reads files from the operating system's write cache instead of the actual USB stick.\n6. Launchers that attempt to open a chat page in a browser may freeze on computers without a default browser.\n7. The speed of the USB stick affects the loading time of the models, with faster drives providing quicker start times.\n8. Models with reasoning enabled may take longer to respond, as seen with Qwen3 which spent 441 tokens deliberating before providing an incorrect response.\n9. macOS may experience crashes during fork() operations when running shell commands, causing the server to restart automatically.\n10. Small issues like duplicate lines in memory files can also cause problems, requiring additional troubleshooting time.",
  "summary": "The idea fits in one sentence: plug a stick into any computer, double-click one file, and a real language model runs on that machine. No account, no internet, no install, and nothing left behind when you unplug it. That sentence took weeks to make true. Not because the AI part is hard, since llamafile and llama.cpp do the heavy lifting. It took weeks because every operating system has its own way…",
  "key_points": [
    "Seven large language models were placed onto a USB stick",
    "Missing Microsoft runtime DLLs on Windows caused no output",
    "macOS experienced crashes during fork() operations"
  ],
  "editors_take": "Putting large language models on a USB stick reveals compatibility issues across different operating systems, highlighting challenges in deploying portable AI applications and the need for tailored solutions.",
  "illustration": null,
  "coverage": {
    "outlets": 1,
    "also_reported_by": []
  },
  "ai_generated": true,
  "disclaimer": "Summaries, key points and the editor’s take are written by software from other outlets’ reporting and may contain errors — always check the linked original."
}