{
  "id": 14753363,
  "title": "Welcome Muse Spark Open: open-weight frontier multimodal mixture-of-experts model from Meta",
  "url": "https://urgent.news/2026/10/15/welcome-muse-spark-open-open-weight-frontier-multimodal-mixture-of",
  "topic": "ai",
  "section": "AI",
  "published": "2026-10-15T00:00:00.000Z",
  "source": {
    "name": "Hugging Face",
    "slug": "hugging-face",
    "url": "https://huggingface.co/blog/meta-muse-spark-open"
  },
  "original_language": "en",
  "account": "Meta has introduced Muse Spark Open, an open-weight multimodal mixture-of-experts model that integrates text, images, audio, and video into a single framework. With around 816 billion parameters and a context window of up to one million tokens, this model is capable of generating text based on various input types. Muse Spark Open builds upon Muse Glimmer, incorporating a larger-scale mixture-of-experts architecture and establishing itself as the most powerful open-weight model in the United States.\n\nTrained for agentic coding tasks, such as reading codebases, writing and debugging code, and invoking tools, Muse Spark Open can also process images, audio, and video inputs. This allows the same model to handle a variety of tasks, such as analyzing screenshots, listening to voice notes, or reviewing screen recordings while working on code. The article provides instructions on running, fine-tuning, and utilizing the model, along with the available models and their checkpoints.\n\nMuse Spark Open is optimized for coding tasks, trained on real developer workflows like multi-file refactors and long debugging sessions. It operates as an agentic model, planning, acting, observing, and self-correcting over extended tasks, including web browsing with images. The checkpoint repositories are Muse-Spark-Open-816B-A42B and Muse-Spark-Open-816B-A42B-NVFP4.\n\nThe model's architecture includes a 62-layer language model with 8192 hidden dimensions, 128 query heads, and 16 key-value heads. Each head consists of 64 dimensions, with a separate input embedding and output layer, each having around 1.66 billion parameters. The model replaces a dense network with Mixture-of-Experts blocks, each containing 256 experts that select 8 experts per token. This allows the model to compute tokens using approximately 42 billion parameters while keeping all 256 experts in memory for faster deployment.\n\nThe model's BF16 checkpoint is roughly 1.5 TB in safetensors format, while the NVFP4 checkpoint uses 4-bit precision for NVIDIA Blackwell GPUs, resulting in negligible accuracy loss. To deploy Muse Spark Open, refer to the llama.cpp, vLLM, and SGLang recipes. The model's perception encoder converts images and video frames into tokens, which are then processed through an audio encoder for audio input. The context window allows for 1 million tokens, including image, video, and audio inputs, at inference time.",
  "summary": null,
  "key_points": [],
  "editors_take": null,
  "illustration": null,
  "coverage": {
    "outlets": 8,
    "also_reported_by": [
      {
        "outlet": "CNBC",
        "title": "Apple and Meta team up to make Muse AI model run on Mac computers",
        "url": "https://urgent.news/2026/10/15/apple-and-meta-team-up-to-make-muse-ai-model-run-on-mac-computers-14744381",
        "published": "2026-10-15T17:00:01.000Z"
      },
      {
        "outlet": "Techmeme",
        "title": "Meta releases Muse Spark Open, saying it is the most capable US open-weight model, with 816B total and 42B active parameters and a 1M-token context window (Meta AI Research)",
        "url": "https://urgent.news/2026/10/15/meta-releases-muse-spark-open-saying-it-is-the-most-capable-us-open",
        "published": "2026-10-15T17:10:01.000Z"
      },
      {
        "outlet": "AWS Machine Learning",
        "title": "Meta’s Muse Spark Open now available in Amazon SageMaker JumpStart",
        "url": "https://urgent.news/2026/10/15/metas-muse-spark-open-now-available-in-amazon-sagemaker-jumpstart",
        "published": "2026-10-15T17:43:35.000Z"
      },
      {
        "outlet": "MacRumors",
        "title": "Meta and Apple Bring Muse Spark Open AI Model to Mac Studio",
        "url": "https://urgent.news/2026/10/15/meta-and-apple-bring-muse-spark-open-ai-model-to-mac-studio",
        "published": "2026-10-15T17:47:29.000Z"
      },
      {
        "outlet": "The Verge",
        "title": "Meta and Apple team up to make Muse AI models run better on Macs",
        "url": "https://urgent.news/2026/10/15/meta-and-apple-team-up-to-make-muse-ai-models-run-better-on-macs",
        "published": "2026-10-15T18:15:36.000Z"
      },
      {
        "outlet": "Slashdot",
        "title": "Meta and Apple Bring Muse Spark Open AI Model to Mac Studio",
        "url": "https://urgent.news/2026/10/15/meta-and-apple-bring-muse-spark-open-ai-model-to-mac-studio-14770713",
        "published": "2026-10-15T19:00:00.000Z"
      },
      {
        "outlet": "Punch Nigeria",
        "title": "Meta unveils new AI model Muse Spark Open",
        "url": "https://urgent.news/2026/10/15/meta-unveils-new-ai-model-muse-spark-open",
        "published": "2026-10-15T21:08:54.000Z"
      }
    ]
  },
  "ai_generated": true,
  "disclaimer": "Summaries, key points and the editor’s take are written by software from other outlets’ reporting and may contain errors — always check the linked original."
}