CONNECT WITH US
Tech

Tech

Jailbroken PS4 runs 9-billion-parameter AI model at up to 43 tokens per second

Tom's Hardware logo

Published on

Add as a preferred source on Google
Jailbroken PS4 runs 9-billion-parameter AI model at up to 43 tokens per second

Developer Leonardo Alegría’s open-source project Garlic LLM lets a jailbroken PS4 run the 9-billion-parameter Qwen3.5-9B AI model offline on the console’s 2013-era GPU. The app talks to the GPU directly, and the model is shrunk to about 4.5GiB to fit in the console’s memory, running at 31 to 39 tokens per second.

The project, named after the memory the GPU reads directly — its sibling memory type is “Onion” — relies on a PS4 running GoldHEN, which is a homebrew enabler for exploited consoles. Garlic LLM is a free, single 5.66GB download, available on Hugging Face and installable through the PS4’s Package Installer, with about 6GB free needed, or 12GB if the package is first copied to the console’s internal disk. The developer tested it on a base/Slim PS4 on firmware 11.52.

It’s capable of voice conversation, with spoken replies in seven languages through the Chatterbox speech model and the chat model running at about 22 tokens per second. A held controller button also lets it take dictation with Nvidia’s Parakeet TDT 0.6B v3 speech-to-text model, which supports 25 European languages. Parakeet models also power local transcription and dictation apps such as Meetily and Hex. The main model is Alibaba’s small open-weight Qwen3.5-9B, which, at the claimed 31 to 39 tokens per second in text chat — the prompt and test method are not given — is usable on the console.

cpp as a native app on the PS5 and reaches the console’s AMD GPU through PS5_Vulkan, a port of the RADV driver.


Source link

Disclaimer

We strive to uphold the highest ethical standards in all of our reporting and coverage. We TheMorningPulse.fyi want to be transparent with our readers about any potential conflicts of interest that may arise in our work. It's possible that some of the investors we feature may have connections to other businesses, including competitors or companies we write about. However, we want to assure our readers that this will not have any impact on the integrity or impartiality of our reporting. We are committed to delivering accurate, unbiased news and information to our audience, and we will continue to uphold our ethics and principles in all of our work. Thank you for your trust and support.