{
  "id": 576692,
  "title": "I Benchmarked Two Local LLMs on Real Dev Work — Qwopus 27B vs Muse Glimmer 30B",
  "url": "https://urgent.news/2026/08/11/i-benchmarked-two-local-llms-on-real-dev-work-qwopus-27b-vs-muse",
  "topic": "ai",
  "section": "AI",
  "published": "2026-08-11T15:22:01.000Z",
  "source": {
    "name": "Dev.to",
    "slug": "dev-to",
    "url": "https://dev.to/chpomob/i-benchmarked-two-local-llms-on-real-dev-work-qwopus-27b-vs-muse-glimmer-30b-36ni"
  },
  "original_language": "en",
  "account": "Two open-weight language models, Qwopus 27B and Meta's Muse Glimmer 30B, were benchmarked on real development tasks by a reporter. The models were run locally on an AMD Radeon RX 7900 XT GPU using llama.cpp multi-model router. A third model, Codex, reviewed both outputs and provided a verdict.\n\nIn the first task, both models fixed a broken Progressive Web App (PWA) with a single regression. Qwopus completed the task in 8.5 minutes and Muse took 21 minutes. Both produced a byte-identical diff and fixed the manifest issue. However, Codex rejected both models' solutions due to a latent conflict that neither model noticed. The contradiction was that the tests hard-coded the root path, while the deployment lived under a subpath.\n\nIn the second task, both models added a single-player mode against an AI opponent to the game. Qwopus completed the task in 32 minutes and Muse in 26 minutes. Qwopus wrote 18 tests, while Muse wrote 7 tests, one of which had a contradiction in its comment. Both models had their strengths and weaknesses, with Qwopus demonstrating adaptive thresholding and better test coverage, while Muse had a more straightforward approach with fixed thresholds. The reviewer model, Codex, caught the latent manifest/base-path conflict missed by both models and identified real bugs in the second task.",
  "summary": "I Benchmarked Two Local LLMs on Real Dev Work — Qwopus 27B vs Muse Glimmer 30B Two open-weight models, one 20 GB GPU, two real development tasks, and a third model as the referee. Here is what actually happened when I made Qwopus 3.6 27B and Meta's Muse Glimmer 30B implement a bug fix and then a full feature in my own project. The setup Both models ran fully local on an AMD Radeon RX 7900 XT (20…",
  "key_points": [],
  "editors_take": null,
  "illustration": null,
  "coverage": {
    "outlets": 1,
    "also_reported_by": []
  },
  "ai_generated": true,
  "disclaimer": "Summaries, key points and the editor’s take are written by software from other outlets’ reporting and may contain errors — always check the linked original."
}