YangZyyyy comments

Repositories
Issues
Comments

Results 4 comments of


                                            YangZyyyy

RuntimeError: probability tensor contains either `inf`, `nan` or element < 0

I'm encountering the same problem. The same error is reported when I batch inference `wmt22` testset with the model trained based on llama2.

RuntimeError: probability tensor contains either `inf`, `nan` or element < 0

`model.bfloat16()` can solve this problem

RuntimeError: probability tensor contains either `inf`, `nan` or element < 0

Here's my previous code, when it runs, the error was reported > RuntimeError: probability tensor contains either inf, nan or element < 0 ``` from transformers import LlamaForCausalLM model =...

[功能]: 支持MCP

加油加油，早日支持MCP！