QiaoJing comments

Repositories
Issues
Comments

Results 1 comments of


                                            QiaoJing

[Bug]: Running llama2-7b on H20, Floating point exception (core dumped) appears on float16

I am using nvcr.io/nvidia/pytorch:23.10-py3，it's all right when I use the float32 and float16, but floating point exception when I use bfloat16. I tried: * build vllm from source using the...