ipex-llm icon indicating copy to clipboard operation
ipex-llm copied to clipboard

Phi3 3.8B mini 128k model not supported

Open lumurillo opened this issue 1 year ago • 1 comments

I got an error when trying to load the Phi3 3.8B mini 128k model using the ipex-llm's support for llama.cpp: image001

The model that I tried is this: https://ollama.com/library/phi3:3.8b-mini-128k-instruct-q4_0

lumurillo avatar Jun 18 '24 21:06 lumurillo

Hi @lumurillo , we have reproduced this issue and will inform you when we make progress.

sgwhat avatar Jun 19 '24 02:06 sgwhat

@lumurillo We have fixed this issue, please update your ipex-llm to latest nightly build, and try again.

qiuxin2012 avatar Jul 03 '24 07:07 qiuxin2012