ipex-llm icon indicating copy to clipboard operation
ipex-llm copied to clipboard

Published 20 hours ago • verified publisher icon intel-analytics

Add Openchat CPU and GPU example

Open NovTi opened this issue 1 year ago • 4 comments

Description of the changes

This PR adds OpenChat-3.5-0106 model CPU and GPU example using BigDL-LLM transformer and optimize_model API. Issue page: https://github.com/analytics-zoo/nano/issues/977

NovTi avatar Jan 29 '24 02:01 NovTi

Please also updated the readme for Windows GPU supports as we have done here: https://github.com/intel-analytics/BigDL/pull/9992

It would be better to have some verification on Windows GPU.

Oscilloscope98 avatar Jan 29 '24 03:01 Oscilloscope98

Also need to update the README here https://github.com/intel-analytics/BigDL/blob/main/python/llm/README.md

shane-huang avatar Jan 31 '24 02:01 shane-huang

please resolve the conflicts.

shane-huang avatar Feb 23 '24 05:02 shane-huang

and also modify the verified model table in python/llm/README.md

shane-huang avatar Feb 23 '24 05:02 shane-huang