Nvidia says 'local AI is here' — and it could change how you use AI at home

At home, Nvidia VP of Product Adel el Hallak keeps a DGX Spark, an AI supercomputer the size of a Mac Mini. It runs overnight, performing AI tasks without disturbing him. This personal AI computer reflects where AI is headed, potentially becoming common in households. Most currently interact with AI through browsers or apps, sending data to data centers, raising privacy and financial concerns.

Running AI locally eliminates these costs. The DGX Spark, priced at $4,699, offers unlimited queries without monthly fees or usage caps. While more capable than some cloud-based models, it may not match the power of GPT-6 or Claude. However, for tasks like document summarization, email drafting, and coding assistance, a local model is sufficient.

Perplexity's Portable Computer, launched recently, packages local AI models into a consumer-friendly system. Nvidia's upcoming RTX Spark laptops, expected to ship this fall, will bring this technology to laptops alongside conventional computing. El Hallak envisions a future where "data centers in the house" will offer more autonomy and control over personal data.