{
  "id": 18738153,
  "title": "Fireworks says you’re wasting money on AI unless you’re using all the models",
  "url": "https://urgent.news/2026/11/07/fireworks-says-youre-wasting-money-on-ai-unless-youre-using-all-the",
  "topic": "ai",
  "section": "AI",
  "published": "2026-11-07T15:00:00.000Z",
  "source": {
    "name": "The Register Science",
    "slug": "the-register-science",
    "url": "https://www.theregister.com/ai-and-ml/2026/11/07/fireworks-says-youre-wasting-money-on-ai-unless-youre-using-all-the-models/5308277"
  },
  "original_language": "en",
  "account": "Fireworks AI, a managed inference provider, advises companies to reconsider spending money on AI unless they are utilizing multiple models. Rob Ferguson, the VP of Fireworks AI, argues that GPUs are expensive and it's a waste of money to keep them underutilized. He explains that Fireworks supports on-prem AI but recommends against it due to economic reasons. Instead, Fireworks recommends using a portfolio of models, even if it seems counterintuitive to use multiple models rather than a single best model. The company's Nexus platform and API route inference tasks to the optimal model based on task difficulty and model affinity, such as Kimi being slightly better at JavaScript than Python. Fireworks' engineering team, with experience in PyTorch, specializes in performance optimization for training and inference. The company emphasizes the importance of tracking cost per task rather than just token costs, as model rework is often the biggest cost in AI. Companies should also consider the value of their data, as models are becoming memorizers and should be compensated for using it. Finally, Fireworks claims that its model routing activities can lead to at least a 50% reduction in costs for customers.",
  "summary": "The case for managed inference, or automatically routing queries to the right model for the right job",
  "key_points": [],
  "editors_take": null,
  "illustration": null,
  "coverage": {
    "outlets": 1,
    "also_reported_by": []
  },
  "ai_generated": true,
  "disclaimer": "Summaries, key points and the editor’s take are written by software from other outlets’ reporting and may contain errors — always check the linked original."
}