When talking about local inference, Sam Altman says supply-constrained DRAM is better used in data centers than sitting in PCs and "being used 5% of the time" (Andrew E. Freedman/Tom's Hardware)

In a recent interview, Sam Altman, the CEO of OpenAI, expressed his frustration over the growing usage of RAM in personal computers for artificial intelligence applications during a global RAM shortage. According to Altman, it was "quite terrible" that a limited amount of RAM was being utilized in individuals' PCs, rather than being allocated to data centers where it could be utilized more efficiently.

During the interview, Altman discussed the increasing demand for open-source AI on personal hardware. However, he argued that this utilization was not ideal from a global perspective, as it limited the limited supply of DRAM from being used to its maximum potential in cloud environments. Altman believed that RAM placed in data centers would be put to task for more extended periods, which would be more beneficial for addressing the supply constraints.

Altman's statement highlights his preference for RAM in data centers over personal computers, potentially indicating a bias towards consumers, particularly in regard to the last sentence of his interview: "And somehow many people's intuition is the opposite of that." This sentiment suggests that Altman might perceive RAM sticks in his data centers as more valuable than those in individuals' PCs, regardless of whether they are used for AI or not.

In his eyes, this could lead to an unfair situation where OpenAI would have the majority of the RAM available, allowing it to run more powerful AI models in the cloud.

While this statement is inferred and speculative based on a single interview, it may not represent OpenAI's entire stance on the RAM shortage. However, it is reasonable to assume that Altman's perspective on the matter could be disconcerting for consumers. Nevertheless, it is crucial to acknowledge that this is a single perspective and not indicative of the entire organization's stance on the issue.