Kinfey

I will upgrade the content to talk about this in next few weeks ， thanks

請留意我的章節，裏面有詳細的內容介紹

Can you try using ONNX as service ? Maybe you can use Hugging face connector in SK

@IntranetFactory Thank you for your question. I would like to explain that the current example ONNX for Generative AI is based on the x86 framework, and will support the ARM64...

please use this https://www.nuget.org/packages/Microsoft.ML.OnnxRuntime.QNN

It is recommended that you use ONNX Runtime for GenAI to call Phi-3 to obtain the best results.

Hi， can you try Phi-3.5-ONNX version https://huggingface.co/microsoft/Phi-3.5-mini-instruct-onnx ？ and update new ORT-genai library ？ I try to use Phi-3.5-mini-instruct-onnx ，everything is okay

@sofyc I think "target_modules": [''k_proj', 'q_proj', 'v_proj', 'o_proj'], it is okay