{
  "id": 16029536,
  "title": "Ditch the data center: I fired my cloud chatbot and built a free local AI agent to run on my PC — and you can too",
  "url": "https://urgent.news/2026/10/22/ditch-the-data-center-i-fired-my-cloud-chatbot-and-built-a-free-local",
  "topic": "ai",
  "section": "AI",
  "published": "2026-10-22T10:30:00.000Z",
  "source": {
    "name": "Tom's Guide",
    "slug": "tom-s-guide",
    "url": "https://www.tomsguide.com/ai/ditch-the-data-center-i-fired-my-cloud-chatbot-and-built-a-free-local-ai-agent-to-run-on-my-pc-and-you-can-too"
  },
  "original_language": "en",
  "account": "In today's technological landscape, many individuals pay a monthly fee to rent server space in a data center for cloud AI services. While these services are fast and convenient, they put users' personal data and workflows at risk by handing over control to large tech companies. This creates a potential bubble in the AI market and exposes sensitive information to an ever-learning black box. However, there is a better alternative: building a local AI agent on your personal computer.\n\nThe future of AI is local, and recent advancements in hardware have made this possible. With the release of Nvidia RTX Spark laptops and Apple's upcoming M6 MacBook Pro models, there is now sufficient processing power to run AI agents without relying on the cloud.\n\nAn AI agent differs from a standard chatbot in that it has autonomy. Instead of waiting for a user to ask a question, an agentic AI takes on a goal, uses tools like a file system or web browser, and executes tasks independently through a ReAct (Reason + Act) loop. This provides greater control and privacy compared to cloud-based options.\n\nTo set up a local AI agent, Hermes Agent is a recommended open-source solution that runs on Windows and Mac. The installation process is straightforward, involving downloading the package, selecting app connectors, and choosing a color theme. Next, users must switch the provider setting to \"local\" and download a local model to act as the agent's brain.\n\nThe choice of model depends on the laptop's RAM. For laptops with 8-16GB RAM, smaller 7-8B parameter models like Llama 3.1 8B are suitable. Laptops with 32-64GB RAM can run 30B-70B parameter models like Qwen 3.8 27B, while those with 128GB+ RAM can utilize enterprise-grade models that rival GPT-4, all without internet access.\n\nQuantization, a process that reduces the size of large models, is essential for running massive AI brains on consumer hardware. By quantizing models, the memory-hogging mathematical weights are rounded down, resulting in a drastic reduction in file size. This allows for efficient use of limited laptop resources.",
  "summary": "Ditch the cloud subscription tax. Here is how I fired my cloud chatbot, built a free local AI agent on my PC with Hermes, and took back my data privacy.",
  "key_points": [
    "Cloud AI services risk personal data and workflows",
    "Local AI agents offer autonomy and privacy",
    "Hermes Agent enables local AI on Windows and Mac"
  ],
  "editors_take": "Shifting AI processing from centralized data centers to consumer hardware restores user privacy and data control while reducing the reliance on subscription-based cloud services.",
  "illustration": null,
  "coverage": {
    "outlets": 1,
    "also_reported_by": []
  },
  "ai_generated": true,
  "disclaimer": "Summaries, key points and the editor’s take are written by software from other outlets’ reporting and may contain errors — always check the linked original."
}