{
  "id": 20494763,
  "title": "My 8GB GPU is now running a 27B model, and it's doing the work I used to pay ChatGPT for",
  "url": "https://urgent.news/2026/11/17/my-8gb-gpu-is-now-running-a-27b-model-and-its-doing-the-work-i-used",
  "topic": "ai",
  "section": "AI",
  "published": "2026-11-17T21:00:21.000Z",
  "source": {
    "name": "XDA Developers",
    "slug": "xda-developers",
    "url": "https://www.xda-developers.com/8gb-gpu-running-27b-model-doing-the-work-i-used-to-pay-chatgpt-for/"
  },
  "original_language": "en",
  "account": "ChatGPT's monthly $20 subscription now includes features such as saved setups, adjusting model reasoning, file uploading for synthesis, and access to more advanced models. Local models, however, often lack these features and are limited to smaller, less capable versions. However, an 8GB graphics card may not seem powerful enough to change this. But a startup named PrismML has developed a model called Bonsai 27B that comes close. This model, a compressed version of Alibaba's Qwen 3.6 27B, is 14 times smaller than the full model and can run on a small GPU. PrismML compresses the model during training, rather than compressing a finished file after training. Bonsai can handle 30-40k context and can run custom setups or 'presets' which contain instructions and reference files, features that ChatGPT's Custom GPTs will no longer have access to after December 11. Bonsai performs well on tasks that require multi-step reasoning, such as comparing phone contracts or interpreting documents, and handles images better than other local models. With Bonsai capable of handling most of ChatGPT's core functions, the need for a subscription may no longer be necessary.",
  "summary": "The model that outlived my ChatGPT subscription",
  "key_points": [
    "PrismML's Bonsai 27B model runs on 8GB GPU",
    "Model is 14 times smaller than full Qwen 3.6 27B",
    "Bonsai handles multi-step reasoning and images well"
  ],
  "editors_take": null,
  "illustration": null,
  "coverage": {
    "outlets": 1,
    "also_reported_by": []
  },
  "ai_generated": true,
  "disclaimer": "Summaries, key points and the editor’s take are written by software from other outlets’ reporting and may contain errors — always check the linked original."
}