Developer Leonardo Alegría’s open-source project Garlic LLM lets a jailbroken PS4 run the 9-billion-parameter Qwen3.5-9B AI model offline on the console’s 2013-era GPU. The app talks to the GPU directly, and the model is shrunk to about 4.5GiB to fit in the console’s memory, running at 31 to 39 tokens per second.
The project, named after the memory the GPU reads directly — its sibling memory type is “Onion” — relies on a PS4 running GoldHEN, which is a homebrew enabler for exploited consoles. Garlic LLM is a free, single 5.66GB download, available on Hugging Face and installable through the PS4’s Package Installer, with about 6GB free needed, or 12GB if the package is first copied to the console’s internal disk. The developer tested it on a base/Slim PS4 on firmware 11.52.
It’s capable of voice conversation, with spoken replies in seven languages through the Chatterbox speech model and the chat model running at about 22 tokens per second. A held controller button also lets it take dictation with Nvidia’s Parakeet TDT 0.6B v3 speech-to-text model, which supports 25 European languages. Parakeet models also power local transcription and dictation apps such as Meetily and Hex. The main model is Alibaba’s small open-weight Qwen3.5-9B, which, at the claimed 31 to 39 tokens per second in text chat — the prompt and test method are not given — is usable on the console.
cpp as a native app on the PS5 and reaches the console’s AMD GPU through PS5_Vulkan, a port of the RADV driver.
Source link







