ipex-llm icon indicating copy to clipboard operation
ipex-llm copied to clipboard

Published 20 hours ago • verified publisher icon intel-analytics

Modify example from fp32 to fp16

Open Zhangky11 opened this issue 11 months ago • 0 comments

Models convert to FP16:

  • [x] llama2
  • [x] qwen
  • [x] qwen1.5
  • [x] mistral
  • [x] chatglm2
  • [x] chatglm3
  • [x] Baichuan2

Zhangky11 avatar Mar 25 '24 06:03 Zhangky11