AMD says Ryzen AI Software 1.9 supports dynamic LoRA switching at inference time for selected models, reducing duplication on the NPU.

AMD says its Ryzen AI Software now lets developers compile a base model once and switch LoRA adapters dynamically at inference time on the NPU, a change the company says can cut duplication when deploying multiple specialist models on an AI PC. In an AMD technical article published Nov. 2, 2026, the company said the feature is available in Ryzen AI Software release 1.9 and is supported for selected text models including Qwen2.5-3B, Qwen3-4B and Qwen3.5-4B.

LoRA, or Low-Rank Adaptation, fine-tunes a large language model by training small adapter weights while keeping the base model frozen. AMD said the previously supported deployment method on Ryzen AI was static merge, where LoRA weights are folded into the base model before compilation. The company said that approach works for a single adapter but becomes inefficient when multiple specialist adapters are needed, because each merged model duplicates the same base weights.

With dynamic LoRA, AMD said one quantized base model remains resident on the NPU while small adapters are compiled as separate artifacts and activated by name. The article said this lets an application switch from one specialist to another, such as a SQL-focused model to a medical one, without reloading the base model.

AMD also warned that adapters must be trained against the already-quantized base model. In the article, the company said the NPU base is quantized to INT4 in its example, and that training a LoRA adapter against a full-precision model before applying it to the quantized base can reduce the adapter's benefit on device.

Source link