Meta details Prometheus, its gigawatt-scale supercluster in Ohio, which will have ~1M GPUs at full scale and was used to train its Muse foundational models (Engineering at Meta)
With the recent release of the Muse family of foundational models, we want to take you inside the infrastructure that has made it all possible.
We haven't written up this one. Techmeme has the full story — the link below goes straight to it.