Jailbroken PS5 Becomes a Local AI Server: Qwen3.8-27B Hits ~20 tok/s, Small Models Top 100

What happened

The base project, PS5LM, was started by developer Mert Cobanov, porting llama.cpp to jailbroken PS5 consoles. The first version ran as a CPU payload on the console's 8-core Zen 2 CPU with only about 6 GiB of usable memory; a 27B model managed roughly one token per minute on the CPU — barely conversational.

The breakthrough came from the fork PS5LM Plus (by developer abhi245y, introduced in a post by Reddit user u/AdIllustrious7246). It packages the port as a native console app that drives the GPU through a community port of Mesa's RADV driver (PS5_Vulkan) via the Vulkan compute pipeline, raising usable memory to about 11.4–12 GiB. The project adds an on-TV dashboard (generation speed, hardware usage, temperature, memory allocation) and a chat interface; phones or computers on the same local network can reach it through a browser or via OpenAI/Anthropic-compatible APIs — coding tools like Claude Code can point at it as a local server.

The numbers are developer-reported and cross-checked across outlets: Qwen3.8-27B under heavy ~2-bit quantization (IQ2_XXS, weights occupying ~6.8GB) reaches about 20–21 tok/s; Gemma 4 E4B about 61 tok/s; Llama 3.2 3B about 124 tok/s. During tests the GPU sat at 100% while the CPU stayed at 2%, with total power draw around 86W and temperatures around 54°C. One caveat: memory usage hits 91% at 64K context, and slow prompt processing on long inputs is a known weakness.

Key facts

Barriers and costs: this remains a homebrew experiment for jailbroken hardware, not an official Sony feature. It requires a PS5 on firmware 13.60 or lower with jailbreak payloads installed; jailbreaking voids the warranty and can lead to online gaming bans. Both repositories use GPL-family licenses and state they contain no Sony SDK files, keys, firmware, or model weights, and are unaffiliated with Sony.

Traction: the project shot to the top of r/artificial within 24 hours (community aggregators put it near 900 upvotes), and the related Hacker News post drew 300+ points; from Oct 14 to 18, outlets including pbxscience, timesofai, alextech.ai, and back2gaming covered it. Commentators compared the PS5's 16GB of GDDR6 (448GB/s bandwidth) against desktop inference hardware — a console never designed for AI now benchmarks in desktop territory.