{
  "id": 8117288,
  "title": "PrismML hopes its tiny LLM will change how we all use AI",
  "url": "https://urgent.news/2026/09/17/prismml-hopes-its-tiny-llm-will-change-how-we-all-use-ai",
  "topic": "ai",
  "section": "AI",
  "published": "2026-09-17T22:34:09.000Z",
  "source": {
    "name": "TechCrunch",
    "slug": "techcrunch",
    "url": "https://techcrunch.com/2026/09/17/prismml-hopes-its-tiny-llm-could-change-how-we-all-use-ai/"
  },
  "original_language": "en",
  "account": "PrismML, a small AI lab, has made a big splash in the industry with its development of tiny language models (LLMs) that can run on personal devices. Unlike other companies, PrismML hasn't raised significant funds yet, but the team behind it, led by Caltech professor Babak Hassibi, boasts impressive credentials and a unique technology aimed at making LLMs more accessible and efficient.\n\nPrismML's latest release, Bonsai 2 27B, is a compressed version of Qwen3.8 27B, an open-source model developed by Alibaba. By using ternary weights—values of +1, -1, or 0—the model size has been reduced from 27 billion parameters to just 5.9 GB, a nine to ten times decrease in memory usage. This compression has only marginally affected the model's performance, retaining 98% of Qwen's benchmark scores — up from 95% in the previous version.\n\nThe startup's founder and leader, Hassibi, is optimistic about the future of larger models. He anticipates that as models grow, the compression technique will become even more effective, potentially reaching 100% benchmark performance parity with uncompressed models. Key advisor Ion Stoica, who co-founded Databricks and has ties to Berkeley's Sky Computing Lab, supports the project, emphasizing the privacy and convenience of running advanced models directly on users' devices, eliminating the need for cloud-based processing.",
  "summary": "If AI lab PrismML isn't on your radar yet, it should be.",
  "key_points": [],
  "editors_take": null,
  "illustration": null,
  "coverage": {
    "outlets": 1,
    "also_reported_by": []
  },
  "ai_generated": true,
  "disclaimer": "Summaries, key points and the editor’s take are written by software from other outlets’ reporting and may contain errors — always check the linked original."
}