liding1992

How can I use deepspeed for inference

4

### **here is my GPUs info:**  ### **model name:** WizardCoder-15B-V1.0 ### **here is my pkgs info:** Python 3.10.9 cuda 11.7 torch 1.13.1+cu117 transformers 4.28.1 ### **here is my ds_report:**...