QinghuiWang

Results 11 issues of QinghuiWang

[Question] How to run HF model with 1m-length tokens in your exp?

Hi, @chooper1 We need to use some calibration datasets to do quantization in the exp, but this type of sequence is too long to run in even 80G GPU for...