Suki. Liu

optimum export openvino ,use gptq&scale_estimation error

1

Exception has occurred: ValueError could not broadcast input array from shape (84934656,) into shape (9216,) File "C:\Users\admin\Desktop\convert_model.py", line 15, in model = OVModelForCausalLM.from_pretrained(model_id, export=True,quantization_config=quantization_config) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ ValueError: could not broadcast input...

Running phi4 mini with NPU resulted in a driver exception

6

Running phi4 mini using NPU resulted in a driver exception, prompting "Exception from src \ conference \ src \ cpp \ infer-request.cpp: 223: Exception from src\plugins\intel_npu\src\plugin\npuw\just_sync_infer_request.cpp:659: Failed to compile. No...

How to use context correlation is not well demonstrated in the example, and I am not able to effectively utilize contextual content. Can you provide corresponding support. I have used...

[BUG] Phi Silica's input of double byte content may result in garbled characters during inference

1

### Describe the bug Describe the bug Phi Silica's input of double byte content may result in garbled characters during inference, but there will be no such issue during inference...

[SAMPLE]I want to use NPU&Hi4 mini for generating equations for inference.

1

My PC is a Qualcomm processor, and I need to use Phi4 mini for inference. There is a mandatory requirement to use QNN (NPU). I found an example using Phi4...

[BUG]There is an error in the LanguageVNet CreateSession of Sample ->Text ->Generate Text in AI Dev Gallery Dev. Error prompt 'One or more errors occurred.'. I haven't encountered this problem the previous working day yet

2

**Describe the bug** There is an error in the LanguageVNet CreateSession of Sample ->Text ->Generate Text in AI Dev Gallery Dev. Error prompt 'One or more errors occurred.'. I haven't...

[SAMPLE]How to use the model "intfloat/multilingual-e5-small" to complete the embedding operation

1

I need to use the intfloat/multilingual-e5-small model. However, I encountered a problem with missing tags such as [UNK] and [SEP] when loading VOCab.txt on the ARM64 architecture. Upon researching, it...

How to load a local QNN model using C #？

5

I successfully loaded and ran the QNN model converted from VSCode in cmd according to the tutorial. [Foundry Local 的最佳做法和故障排除指南](https://learn.microsoft.com/zh-cn/azure/ai-foundry/foundry-local/reference/reference-best-practice) I obtained the model list using C # code but...

When to release the QNN model for phi-4-mini-instruct

10

We need to use the QNN version of the Phi-4-mini-instruct model. I have tried using ONNX and Qualcomm's examples, but it seems that we cannot convert it to the QNN...