← Saturday, October 17, 2026InferenceTool

PS5LM serves GGUF models from a jailbroken PS5 using llama.cpp

github.com 4 min read Editor score 7/10

PS5LM runs llama.cpp's Vulkan backend on the PS5 GPU, uses 11.4 GB of shared memory, and exposes OpenAI- and Anthropic-compatible APIs to devices on the network. It is a concrete edge-inference deployment, though tied to jailbroken console hardware.

What: PS5LM runs GGUF language and decision models on a jailbroken PS5 and serves them to devices on the network.
How: It uses llama.cpp's Vulkan backend on the console's RDNA 2 GPU, and supports OpenAI and Anthropic APIs as well as a browser chat page.
Why it matters: It gives engineers a private, local endpoint for testing models and clients without a PC running alongside the console or a cloud service.

A network client sends requests through PS5LM to the console GPU for model inference. Sketched from the article's own text.

Read on github.com → Hacker News · 63 comments

Discussion

Discussion is not switched on yet. Use Note above to keep your own thoughts on this story.

Headline, summary, brief and diagram are written by a model from the source's own text; the link, byline and numbers come from the source. Read the original before relying on a claim.