zxrneu

Results 3 comments of zxrneu

How to use multiple Ascend NPUs?

同样的问题

How to use multiple Ascend NPUs?

![image](https://github.com/lm-sys/FastChat/assets/42803787/fa0f5821-c8cb-47fe-9fc9-6c27b0a3155a) ![image](https://github.com/lm-sys/FastChat/assets/42803787/5abb16de-0cf0-471f-8529-8520eb82d878) ASCEND_RT_VISIBLE_DEVICES=1

Cannot run Yi-34B-Chat => ValueError: Unsupported q_ratio: 7

+1