microsoft
Results are not correct while enabling NPU mode for windowsML sample code
Dear all,
I would like to ask, is there any document describing the case of using NPU?
I've faced an issue that the result is not correct whenever assigning ep_policy as NPU for squeezenet.onnx.
For NPU case, I feed the original FP32 onnx model and it seems to do quantization but takes around 15 sec.
The sample code is under https://github.com/microsoft/WindowsAppSDK-Samples/tree/release/experimental/Samples/WindowsML/cpp/CppConsoleDesktop
Command: CppConsoleDesktop.exe --ep_policy NPU
Results: tench 0.1% goldfish 0.1% (CPU:boxer 28.5% Saint Bernard 28.5% ...)
Platform: AMD Ryzen AI 9 HX370 w/ Radeon 890M
Could you please help verify why it happens or is there any other steps I need to modify to enable NPU mode? Thanks
