Jailbroken PS5s can now run local AI models at over 100+ tokens per second
PS5LM gets a fork, allowing it to run natively and use the GPU and more RAM to run larger LLMs, even running Qwen3.8-27B at 20 tokens per second.
A jailbroken PS5 user has managed to run local AI models at over 100 tokens per second, thanks to a modified version of the llama.cpp port called PS5LM. This improvement allows the PS5 to utilize its GPU to run larger AI models such as Qwen3.8-27B at a speed of 20 tokens per second. A Reddit user, u/AdIllustrious7246, utilized PS5_Vulkan, a port of the RADV graphics driver, to send instructions to the PS5 GPU, which is typically locked down.
By doing so, u/AdIllustrious7246 beat the previous unofficial port of llama.cpp in terms of speed and efficiency. The modified app can now run natively on the PS5, making use of more RAM up to 11.4 GiB. The developer also added a dashboard to display useful data such as token-per-second generation, GPU and CPU usage, power draw, temperatures, and memory allocation between the model and KV cache.
The dashboard can also be accessed through llama.cpp's web UI, allowing users to interact with the LLM from other local devices via a browser. This achievement is significant as it opens up new possibilities for the PS5 as an AI assistant when not being used for gaming. However, it also brings back memories of the previous crypto mining GPU crisis due to the increased demand for GPUs and RAM, which is already a concern in the context of large AI data centers.
Despite the impressive results, the PS5's GPU and RAM capabilities might not be on par with dedicated AI hardware.
Written by urgent.news from Tom's Hardware's reporting — not their text. Machine-written — may contain errors; check the original before relying on it.
