nexa-sdk icon indicating copy to clipboard operation
nexa-sdk copied to clipboard

Can't start deepSeek-r1-distill-qwen-7B-intel-npu

Open diffore opened this issue 4 months ago • 0 comments

Running on Lenovo Legion Pro 7 16IAX10H. Intel® AI Boost driver: 32.0.100.4404 (2025-10-29)

Downloaded from github page: https://public-storage.nexa4ai.com/nexa_sdk/downloads/nexa-cli_windows_x86_64.exe

Model from website: NexaAI/deepSeek-r1-distill-qwen-7B-intel-npu

Runnin with: nexa infer NexaAI/deepSeek-r1-distill-qwen-7B-intel-npu give me: nexa infer NexaAI/deepSeek-r1-distill-qwen-7B-intel-npu Can't open C:\Users<my_user>.cache\nexa.ai\nexa_sdk\models\NexaAI\deepSeek-r1-distill-qwen-7B-intel-npu*model_weights\config.json*

So I moved config and all other files from model folder to model_weights. Now the error is: Exception from src/inference/src/cpp/core.cpp:187: Exception from src/inference/src/dev/plugin.cpp:73: Exception from src/plugins/intel_npu/src/plugin/src/plugin.cpp:776: Can't import network: Exception from src/plugins/intel_npu/src/compiler/src/zero_compiler_in_driver.cpp:964: L0 pfnCreate result: ZE_RESULT_ERROR_INVALID_NATIVE_BINARY, code 0x7800000f

Any ideas what I am doing wrong?

diffore avatar Dec 01 '25 16:12 diffore