Intel’s new Arrow Lake architecture, aka the Core Ultra 200S series, brings AI capabilities onto Intel desktops. But the chip doesn’t use the Copilot+ capabilities of Intel’s mobile Lunar Lake chip — its designers used the older NPU found on Meteor Lake instead.
For now, this means that if you buy an Arrow Lake chip, you won’t be able to use it with some of the new AI enhancements found within Windows 11’s 2024 Update, like generative AI and the controversial Recall function. Arrow Lake’s optimized NPU 3 only provides 13 TOPS, while Microsoft set 40 TOPS as the bar for Copilot+ status. Intel still plans to ship more than 40 million AI PCs in 2024, using the vaguer “AI PC” definition that accompanied the launch of Meteor Lake.
Arrow Lake is the not the first desktop PC architecture to include an NPU for AI. Last January, AMD announced the Ryzen 8000 series of desktop processors with an NPU capable of 39 TOPS. However, the blink-or-you’ll-miss-it Ryzen 8000 was quickly replaced by the Ryzen 9000 processor six months later in June — without an NPU, but ushering in Zen 5 with a potent 16 percent performance improvement over the prior generation. Neither the Ryzen 8000 nor Arrow Lake meets the threshold to be called a Copilot+ PC.
Arrow Lake, like Meteor Lake, is a disaggregated architecture — a fancy name for a modular design. Theoretically, couldn’t Intel have just made more of the 45 TOPS NPU 4 found within Lunar Lake, and added it to the Arrow Lake package? Yes…and no, Intel executives said.
Update: Intel’s Arrow Lake processors have now launched. How did the efficiency and performance claims stack up? Find out in Core Ultra 9 285K tested: 10 must-know facts about Intel’s radically new CPUs. Gordon Mah Ung also dived deeper into the 285K’s performance in productivity workloads in the deep-dive video below:
Keeping it simple
First off, Arrow Lake’s NPU is the same NPU 3 as Meteor Lake, Robert Hallock, an Intel vice president and general manager of client AI and technical marketing at Intel, told reporters.
“So we’ve had a lot of time to learn it and optimize it, and it made sense that we would fit this in,” he said. (Meteor Lake’s NPU generated 11.5 TOPS, while Arrow Lake’s optimized version produces 13 TOPS.)
However, Intel’s customer base of enthusiasts also indicated that they didn’t want to give up certain features, like a potent GPU, to check the box of AI. And Intel, which faced pressure to deliver Arrow Lake on time, found it easier to just use an established design.
“We actually had a long, a really long chat internally about how to allocate the transistor budget on this part,” Hallock continued. “To be clear, yes, it was fully possible to put a 50 TOPS, 40 TOPS NPU on this product, but to do so would also require shrinking the core count, changing the GPU core count. You start making sacrifices in sort of fundamental performance dimensions that enthusiasts really care about — that didn’t feel like the right mix. And we also talked at length about sort of the enthusiast market’s disposition on AI as a whole. And I think it’s fair to say it’s somewhat reluctant.”
