{
  "id": 7478395,
  "title": "Ollama keep_alive: My Model Reloaded 214 Times in One Day",
  "url": "https://urgent.news/2026/09/15/ollama-keep-alive-my-model-reloaded-214-times-in-one-day",
  "topic": "tech",
  "section": "Tech",
  "published": "2026-09-15T04:56:17.000Z",
  "source": {
    "name": "Dev.to",
    "slug": "dev-to",
    "url": "https://dev.to/ji_ai/ollama-keepalive-my-model-reloaded-214-times-in-one-day-il4"
  },
  "original_language": "en",
  "account": "A local chat application experienced varying performance, with fast responses during testing and slow responses during actual use. The issue stemmed from Ollama, a local model loader, evicting loaded models from VRAM after 5 minutes of inactivity. This caused significant delays when reloading models from disk for each request. The reporter discovered that Ollama had three options for handling model persistence, but only two of them affected the OpenAI-compatible endpoint. By adjusting the `keep_alive` variable to a longer duration or setting it to `-1` to prevent model eviction, the reporter was able to improve the performance of their local LLM significantly.",
  "summary": "My local chat app was fast every single time I tested it, and slow every single time I actually used it. That's the tell, and I ignored it for weeks. I'd type a question during development, get a first token in under a second, ship the change. Then I'd come back after lunch, ask one thing, and sit there for eleven seconds watching a cursor blink. Same box. Same model. Same prompt. It wasn't the…",
  "key_points": [
    "Ollama experienced performance issues due to model eviction from VRAM.",
    "Reporter discovered three model persistence options for Ollama.",
    "Adjusting keepalive resolved model reloading delays."
  ],
  "editors_take": null,
  "illustration": null,
  "coverage": {
    "outlets": 1,
    "also_reported_by": []
  },
  "ai_generated": true,
  "disclaimer": "Summaries, key points and the editor’s take are written by software from other outlets’ reporting and may contain errors — always check the linked original."
}