Urgent.News

What's breaking now, across thousands of outlets.

AI

Show HN: 53ON AI Server – OpenAI-compatible server for AMD Ryzen AI Max

Hi HN. I run my own AI at home on a Ryzen AI Max+ 395 mini PC with 128 GB of unified memory, and this is the server it talks to. It's a single Node.js process with no dependencies, on top of llama.cpp. It speaks the OpenAI and Anthropic APIs, and it has a panel to load models, give each client an API key with a token quota, and relay cloud providers when a local model isn't enough. We also…

We haven't written up this one. Dev.to has the full story — the link below goes straight to it.

Read the original at dev.to →

More in AI

More from Sunday 15 November →