ipex-llm icon indicating copy to clipboard operation
ipex-llm copied to clipboard

Published 20 hours ago • verified publisher icon intel-analytics

Add Deepseek-6.7B

Open Zhangky11 opened this issue 1 year ago • 5 comments

Description

Add Deepseek-6.7B CPU and GPU examples

Zhangky11 avatar Jan 25 '24 04:01 Zhangky11

Please also updated the readme for Windows GPU supports as we have done here: https://github.com/intel-analytics/BigDL/pull/9992

It would be better to have some verification on Windows GPU.

Oscilloscope98 avatar Jan 29 '24 04:01 Oscilloscope98

I've updated README file and finished verifications on windows GPU.

Zhangky11 avatar Jan 30 '24 05:01 Zhangky11

It can work when I set cpu_embedding=True for both HF-transformer API and Pytorch API.

Zhangky11 avatar Jan 30 '24 05:01 Zhangky11

please resolve conflicts.

shane-huang avatar Feb 23 '24 05:02 shane-huang

It can work when I set cpu_embedding=True for both HF-transformer API and Pytorch API.

Does cpu_embedding=True has negative impact for Arc? If not, maybe we can add this option in example code (so that iGPU can work well and Arc does not have negative impact)

shane-huang avatar Feb 23 '24 05:02 shane-huang