Event language
UI language
More and more ARM and RISC-V SoCs now come with built-in NPUs. Although these NPUs are generally not powerful enough to handle NLP models, they play a significant role in edge-side CNN workloads such as object detection. In this session, the speaker will introduce several well-known platforms (including NXP IMX and Rockchip platforms) and analyze the performance differences between proprietary and open-source NPU drivers on Linux. Beyond architectural differences, how do they actually perform in real-world scenarios? A comparison table will also be presented to clearly illustrate the results, demonstrating that the theoretical TOPS defined by the hardware can indeed be pushed to its limits when used correctly.<br><br>In addition, while many people assume that the bottleneck of NPU performance lies solely in the CNN model itself, our research shows that the camera interface is also a decisive factor that can significantly influence the overall bottleneck.
