Scripts can’t run AI factories: Dell moves cluster management from the server to the rack
As artificial intelligence clusters grow to supercomputing scale, the hard part of the AI factory is no longer buying hardware. It is keeping racks, switches, GPUs and cooling running once they are switched on. That operational burden is reshaping what infrastructure providers sell. Dell Technologies Inc. has spent the past year pushing its AI Factory […] The post Scripts can’t run AI factories:…
Artificial intelligence clusters are reaching supercomputing levels, and the main challenge is maintaining the hardware once it is operational. Dell Technologies is addressing this issue by shifting from selling servers and storage to providing best practices and tools for managing and operating AI clusters, according to Andrew Vaz, vice president of product management for the Telecom Systems Business at Dell.
Vaz and Saurabh Kapoor, director of product management and strategy for AI compute and networking solutions at Dell, discussed supercomputing, rack-scale management, AI observability, and networking at SC26. Dell has introduced two tools for AI infrastructure management: Dell OpenManage Rack Scale, which can manage 100,000 devices, and Dell Fabric Manager.
These tools help monitor and maintain the complex systems, such as Nvidia's NVL72 racks, which bundle compute, power, switches, and coolant distribution units into one unit. Dell's iDRAC controller gathers over 320 metrics from each server, and an AI-assist chatbot can analyze telemetry using local large language models. Vaz emphasized the importance of visibility and telemetry in detecting issues, such as a cooling leak, which could damage millions of dollars worth of equipment.
The network is a critical component for AI clusters, and Dell Fabric Manager helps deploy validated designs across different network operating systems and silicon. The demand for bandwidth is growing rapidly, with Vaz noting that enterprise bandwidth is increasing at a nine to ten times rate.
Written by urgent.news from SiliconANGLE's reporting — not their text. Machine-written — may contain errors; check the original before relying on it.
This story
This is one outlet's version. Read the fullest account.