ITM527

Results 7 comments of ITM527

Hey @kory Any plans for Qwen3-4B-Instruct-2507? I think its one of the best performing SLM now-a-days. Thanks.

@Qxinyu Yes, we have installed SDK compatible with the mentioned target device (same version as used in host device for conversion). The QNN SDK path was correctly set in the...

@Qxinyu Thanks for your suggestion. We have modified the line 81 in /source/backend/qnn/backend/QNNBackend.cpp and rebuild MNN with appropriate flags. The detailed diagnostic is as follows: ``` C:\Models\MNN\build_git\Release>llm_demo.exe C:\Models\Qwen3-4B-Instruct-2507-MNN\config_qnn.json The device...

Yes @Qxinyu , We have set the correct 'soc_id' and 'dsp_arch' (60 and v73 respectively) as mentioned in the shared link. Following the above highlighted error, it seems to have...

@Qxinyu Yes, it is still crashing. It will be helpful if you could please test on Qualcomm platforms with Windows at your end and fix this (in case of any...

@Qxinyu Just wanted to follow-up on the above discussed issue, in case you had a chance to look into it?

@Qxinyu Just an update, we have tried running it on android NPU (Snapdragon 8 Gen3), by following similar steps as in case of Windows and it worked perfectly. Both executables...