LiChuang comments

Repositories
Issues
Comments

Results 3 comments of


                                            LiChuang

LLM模型输出只有一个 " % "

![Image](https://github.com/user-attachments/assets/de779113-7f31-414c-b50a-209b75f96ce6) 显卡是V100,测试音频用的是用例里面的 BAC009S0764W0121.wav

> 用torch.float32呢? ![Image](https://github.com/user-attachments/assets/4f8039d8-f8fa-4319-aaae-4b6a37d95420) **用32会OOM, 把device_map改成auto之后也会出错** ![Image](https://github.com/user-attachments/assets/e5c816bb-f6ea-4c60-bdbd-485679c509f9) ![Image](https://github.com/user-attachments/assets/6c346546-44ee-4254-94ee-e495517d7f34)

LLM模型输出只有一个 " % "

> 这个问题解决了吗，我也是显存不够用了 fp16 精度，然后输出只有一个 "'" 没, 搞不定