AI Accelerators Face Disappointing Performance on Windows Tablets
Recent findings suggest that Qualcomm's NPUs (Neural Processing Units) are not meeting performance expectations on Microsoft Surface Pro devices running on Arm architecture. The NPU is designed to accelerate AI tasks, but in reality, it falls short of its theoretical maximum throughput by a significant margin. According to the author, the NPU only achieves 573 billion operations per second, which is less than 1.3% of the advertised 45 trillion ops per second.

Source: https://petewarden.com/2024/10/16/ai-pcs-arent-very-good-at-ai/