ipex-llm icon indicating copy to clipboard operation
ipex-llm copied to clipboard

Published 20 hours ago • verified publisher icon intel-analytics

LLM: Add QWen gguf

Open hzjane opened this issue 1 year ago • 3 comments

Description

Add QWen gguf support, model path

1. Why the change?

Add QWen gguf

2. User API changes

No

3. Summary of the change

Add QWen gguf

4. How to test?

  • [ ] N/A
  • [ ] Unit test
  • [ ] Application test
  • [ ] Document test
  • [ ] ...

hzjane avatar Dec 18 '23 08:12 hzjane

Is there an implementation from HuggingFace for QWen instead?

jason-dai avatar Dec 18 '23 08:12 jason-dai

Is there an implementation from HuggingFace for QWen instead?

It seems that Chinese model such as baichuan and qwen are not supported by HuggingFace API.

hzjane avatar Dec 18 '23 08:12 hzjane

Then maybe not add it at this moment

jason-dai avatar Dec 18 '23 08:12 jason-dai