Suki. Liu
Suki. Liu
> Hello, could you please try to reproduce issue with the latest available driver: https://www.intel.com/content/www/us/en/download/794734/intel-npu-driver-windows.html? The new driver is indeed usable, but there is one issue. When I use the...
optimum-cli export openvino --model .\Phi-3.5-mini-instruct\ --task text-generation-with-past --weight-format int4 --group-size -1 --sym --awq --dataset wikitext2 --gptq --scale-estimation phi-3.5-mini-int4-awq-gptq-scale It has the same effect.
Thank you for your reply. I have completed the conversion of the model.
@nmetulev Yes, I have been using it like this recently
source:https://github.com/microsoft/ai-dev-gallery/issues/356
@natke Sorry, this does not load the model and cannot be found in the C # model list. ``` var list = await foundryLocalManager.ListCatalogModelsAsync(); var list1 = await foundryLocalManager.ListCachedModelsAsync(); var...
@natke The following is the decompilation code for jumping in VS. In LoadModelAsynchronous, the model needs to be in ListCachedModelsSync, but it cannot be obtained from the list ``` public...
@natke Sorry, I forgot to provide device information. Processor: Snapdragon (R) X Elite - X1E80100- Qualcomm (R) Oryon (TM) CPU (3.42 GHz) RAM：16G System type: 64 bit operating system, ARM...
The local version of the foundation is 0.4.91+269dfd9ed1
Is this it? @natke