{
  "id": 18147106,
  "title": "How well can we measure open model inference share?",
  "url": "https://urgent.news/2026/11/04/how-well-can-we-measure-open-model-inference-share",
  "topic": "ai",
  "section": "AI",
  "published": "2026-11-04T16:35:44.000Z",
  "source": {
    "name": "Interconnects",
    "slug": "interconnects",
    "url": "https://www.interconnects.ai/p/how-well-can-we-measure-open-model"
  },
  "original_language": "en",
  "account": "The Interconnects Dashboard, a compilation of open model adoption and performance data from the web, provides valuable insights into the open model inference space. However, the metrics used to measure this market remain highly imprecise due to the reliance on noisy platform metrics, startup marketing data, and imperfect public evaluations. The dashboard aims to offer free, valuable data that can be used to better understand the industry's trajectory.\n\nOpen model startups such as Baseten, Fireworks, and Together AI serve as key indicators for the growth of open model inference. These companies' fates are closely tied to the success of open model inference as a category. The latest data comes from slides presented in a talk on the open model economy, which showcase the exponential growth in token volume for these startups over time. For instance, Fireworks reported serving more than 40 trillion tokens per day to customers' customized models, with a projected increase to well over 100 trillion tokens in the upcoming period.\n\nTo put these numbers in context, token volumes from closed model providers and hyperscalers like Amazon Bedrock and Azure's model garden are necessary for a comprehensive comparison. Unfortunately, these companies have not broken down their usage by model category, making it difficult to gauge their impact on the open model inference market. Nonetheless, Google's public disclosures on platform token volumes and API usage offer a valuable reference point for comparing open model inference providers against closed model players.",
  "summary": "Our first open model economy research note for paid subscribers.",
  "key_points": [],
  "editors_take": null,
  "illustration": null,
  "coverage": {
    "outlets": 1,
    "also_reported_by": []
  },
  "ai_generated": true,
  "disclaimer": "Summaries, key points and the editor’s take are written by software from other outlets’ reporting and may contain errors — always check the linked original."
}