"Dark GPUs" at Amazon show the limits of the AI buildout: chips are easy to buy, power is not

Amazon is experiencing challenges with its ambitious AI cloud expansion, as reported by Business Insider. The tech giant is investing heavily in Nvidia GPUs, with internal emails indicating it is shelling out $5 billion in August alone for the high-performance servers. However, some U.S. data centers do not have adequate electrical capacity to support the new hardware, resulting in these costly GPUs being stored in warehouses until final data center sites are completed.

This situation is part of a trend known as "dark GPUs," where data centers accumulate significant amounts of hardware without effective use. Amazon's aggressive financial strategy is driving up capital expenditures, with the company expecting them to reach $220 billion this year. The financial pressure is evident as Amazon's trailing free cash flow turned negative for the first time in over two years in Q2.

Despite these challenges, Amazon defends its approach, claiming it is a best business practice and expects significant returns from its massive AI infrastructure build-up, emphasizing AI as an unprecedented opportunity that no IT company should overlook.