CONNECT WITH US
Web3 & Blockchain

Web3 & Blockchain

AMD and Unsloth Enable World's First NPU Support for Unsloth Desktop

Blockchain.News logo

Published on

Add as a preferred source on Google
AMD and Unsloth Enable World's First NPU Support for Unsloth Desktop

AMD XDNA™ 2 NPUs now power local AI inference on Unsloth Desktop, unlocking 100+ agentic apps with efficient, low-power execution.

AMD and Unsloth have announced a groundbreaking collaboration to bring neural processing unit (NPU) support to Unsloth Desktop, marking the first time NPUs are integrated into the application. This development leverages AMD's XDNA™ 2 architecture, enabling local AI inference for over 100 agentic applications and workflows.

The integration is powered by AMD's open-source tools, Lemonade and FastFlowLM (FLM), which facilitate model serving and inference on the AMD XDNA™ 2 NPU. Through the Unsloth Desktop API, which offers an OpenAI-compliant endpoint, users can connect applications such as Hermes Agent, OpenClaw, and VS Code to local AI models. This ecosystem enables efficient, low-power execution of AI agents directly on PCs, reducing reliance on GPUs and CPUs while preserving battery life.

To utilize this feature, users must install Unsloth Desktop on an AMD device equipped with an XDNA™ 2 NPU. Supported models, such as the Qwen 3.6 35B A3B, require specific memory allocations—28GB of NPU memory for full context, translating to a system with at least 64GB of RAM under Windows' default shared allocation settings. Once configured, users can run local inference seamlessly through the NPU, as demonstrated by a 35-billion-parameter mixture-of-experts model in real-time testing.

This collaboration opens new possibilities for developers to integrate low-power, persistent AI agents into everyday workflows. For users, it provides a more efficient way to run AI applications, particularly in unplugged scenarios where battery life is critical.



Source link

Disclaimer

We strive to uphold the highest ethical standards in all of our reporting and coverage. We TheMorningPulse.fyi want to be transparent with our readers about any potential conflicts of interest that may arise in our work. It's possible that some of the investors we feature may have connections to other businesses, including competitors or companies we write about. However, we want to assure our readers that this will not have any impact on the integrity or impartiality of our reporting. We are committed to delivering accurate, unbiased news and information to our audience, and we will continue to uphold our ethics and principles in all of our work. Thank you for your trust and support.