Why AI is guzzling your device’s memory (and driving up prices)

The increasing prevalence of AI technology on personal devices is placing a heavy burden on their memory resources, particularly RAM—unified memory in Apple's parlance. This is an unavoidable consequence of local AI tasks, which necessitate a substantial amount of memory for immediate processing. Apple's integrated ChatGPT, for instance, demands constant access to the system's processing power, necessitating that AI models reside directly within active memory.

In essence, RAM acts as a temporary staging area for quick data access and processing. The larger the RAM, the more data can be handled simultaneously, much like a spacious desk allows for more documents to be spread out for simultaneous work. Conversely, long-term storage occurs on hard drives or SSDs, akin to a filing cabinet beneath the desk where the bulk of files are stored.

To meet the escalating demand for powerful memory, tech manufacturers are proactively future-proofing their newest models with significantly increased memory capacities. This surge in demand has naturally led to higher prices for these critical components across the technology industry. Consequently, the increased cost of RAM is being passed onto consumers, driving up the retail prices of everything from modern smartphones and laptops to media players and high-end gaming consoles.

Central to this price hike is the growing reliance on local AI, a technology that many consumers have yet to fully embrace.