Yi

Yi copied to clipboard

v100显卡，加载量化模型Yi-34B-Chat-4bits，推理速度很慢

6

### Reminder - [X] I have searched the Github Discussion and issues and have not found anything similar to this. ### Environment ```markdown - OS: Centos7.9 - Python: 3.11.6 -...

zxdposter

### Reminder - [X] I have searched the Github Discussion and issues and have not found anything similar to this. ### Environment ```markdown - OS:windows11 x64 - ollama ``` ###...

ChaoII

### Reminder - [X] I have searched the Github Discussion and issues and have not found anything similar to this. ### Environment ```markdown - OS:ubuntu 22.04 - Python:3.10.12 - PyTorch:2.0.1...

ArlanCooper

zjrwtx

### Reminder - [X] I have searched the Github Discussion and issues and have not found anything similar to this. ### Motivation We tested Yi-6B-Chat on BBH and achieved the...

zerovl

Have a try to keep headings consistent with toc

windsonsea