CONNECT WITH US
Tech

Tech

What does an NPU do and why do so many laptops have them?

Engadget logo

Published on

Add as a preferred source on Google
What does an NPU do and why do so many laptops have them?

Bought a new laptop recently? Chances are that it's equipped with an NPU, a chip you're almost certainly not using. The NPU, or Neural Processing Unit, is a block of silicon that runs AI workloads at a fraction of the power a CPU or GPU needs. Roughly 2W compared to well over 100W that standard laptop discrete graphics need to do the same job. While they're not yet found in all laptops, they're now pretty much standard in mid-range and premium machines.

Advisory firm Gartner reckons that AI-capable PCs, like these NPU-equipped laptops, make up more than half of total global shipments. The reason we're seeing this isn't because buyers want or need them, but to align with certification requirements. Back in 2024, Microsoft pretty much dictated that laptop makers will need to hit 40 TOPS (the measure of how quickly an NPU can chew through AI math) of dedicated NPU performance with new machines, or risk losing access to new Windows AI features. NPU hardware is now flying off the shelves as a result, but software is lagging behind.

An NPU's job is to accelerate inference. That's the "run this model" phase rather than the GPU-powered "train this model" phase. Neural networks rely heavily on two kinds of computation to do this: matrix multiplication and nonlinear activation functions. NPUs are purpose-built to execute those operations as quickly and efficiently as possible, but that comes at the cost of some general-purpose CPU and GPU flexibility.

Let's consider the example of using background blur on a video call.


Source link

Disclaimer

We strive to uphold the highest ethical standards in all of our reporting and coverage. We TheMorningPulse.fyi want to be transparent with our readers about any potential conflicts of interest that may arise in our work. It's possible that some of the investors we feature may have connections to other businesses, including competitors or companies we write about. However, we want to assure our readers that this will not have any impact on the integrity or impartiality of our reporting. We are committed to delivering accurate, unbiased news and information to our audience, and we will continue to uphold our ethics and principles in all of our work. Thank you for your trust and support.