The list of things a jailbroken PS5 can do gets longer, as Reddit user u/AdIllustrious7246 posted his fork of PS5LM, a llama.cpp port on the PS5 to run AI LLMs locally, with a massive improvement, allowing PS5LM to run natively on the PS5 and utilize the GPU to run bigger AI models such as Qwen3.8-27B at 20 tokens per second.

GitHub user cobanov posted their unofficial port of llama.cpp on Reddit 14 days ago to enable jailbroken PS5s to run AI chat models locally and offline. cobanov’s version, according to u/AdIllustrious7246, runs as a payload on the CPU, limiting it to 6 GiB of memory. Running it as a payload is basically hijacking the CPU, inserting the LLM into its instructions alongside the home screen and system services; however, RAM access is limited to about 6.25 GiB because holding more would freeze the home screen. cobanov did this just to get the llama.cpp running as soon as possible, but eventually wanted to utilize the GPU so it could run larger models; however, it seems that u/AdIllustrious7246 beat him to it with his fork.

u/AdIllustrious7246 utilized PS5_Vulkan, a port of the RADV graphics driver that allows instructions to be sent to the PS5 GPU. Normally, the PS5 GPU would be locked down and cannot be accessed like a PC GPU, despite being an AMD GPU. PS5_Vulkan is one of the projects that made plenty of homebrew projects possible by opening up what could be done on the GPU, including making it run LLMs.

Source link