Urgent.News

What's breaking now, across thousands of outlets.

AI

Janas: Run LLMs Bigger Than Your RAM by Streaming from SSD

What Is Janas Janas is a tool that runs LLMs bigger than your RAM by streaming expert models from SSD. It launched in October 2026 and has been quietly gaining traction among developers who want to run large models locally without buying expensive GPUs. The pitch is simple: instead of fitting the entire model in RAM, Janas streams the experts from SSD as needed. This means you can run models that…

Janas is a tool that allows developers to run large language models (LLMs) that exceed the capacity of their RAM by streaming the experts from an SSD. Launched in October 2026, Janas has been gaining popularity among developers who want to run large models locally without investing in expensive GPUs. The primary concept behind Janas is to stream the required experts from SSD during runtime, enabling the execution of models that normally demand 100GB of RAM on machines with only 16GB of memory.

However, this approach comes at the cost of slower speed compared to RAM but is significantly faster than swapping to disk.

Written by urgent.news from Dev.to's reporting — not their text. Machine-written — may contain errors; check the original before relying on it.

Read the original at dev.to →

More in AI

More from Thursday 15 October →