32 TB RAM for your GPUs: Marvell shows revolutionary Photonic Fabric Memory Module that uses light to link up to 16 GPUs and slash CAPEX — but Nvidia won't stick around doing nothing
Marvell wants to stop GPUs acting as "the world's most expensive memory controller" with 32TB of optically pooled memory, but sampling doesn't start until 2027.
Marvell unveils Photonic Fabric Memory Module, a revolutionary technology that could enable up to 32 TB of DDR5 and 1,152 GB of HBM3e memory to be shared among 16 GPUs via fiber optics. This innovative design, first introduced at Celestial AI's 2025 presentations, is currently in the pre-silicon stage and is expected to reach customer sampling by 2027.
Nvidia has taken notice, having invested $2 billion in Marvell and is developing its own memory solutions, including BlueField-4 STX and Enfabrica's pooling technology. The Photonic Fabric Memory Module aims to address the high cost of HBM by decoupling memory from GPUs, allowing for shared memory pools that can be accessed by multiple accelerators.
While the module is still in development, the potential benefits of shared memory for large language models and other AI workloads are significant. Nvidia's investment in Marvell and its own memory solutions suggest that the company is not idle while Marvell develops this new technology.
Written by urgent.news from TechRadar's reporting — not their text. Machine-written — may contain errors; check the original before relying on it.
This story
This is one outlet's version. Read the fullest account.
