Error while running vicuna13b

[ww-tt]

trafficstars

Here's the version I used： vicuna13b-delta-V1.1 python 3.9 transformers 4.28.1 fschat 0.2.3

When I running the merged vicuna13b, typing text into the console displays an error. May I ask what causes it? The questions are as follows:

[merrymercy]

Could you check the value of probs?

also, please try other GPUs and redo the weight conversation

[ww-tt]

The value of probs is all NAN，I had the same problem with other gpus.

[surak]

@ww-tt hey, any news? Have you solved it? We have been using vicuna for a bit here, works fine in general.

[infwinston]

Closing this for now. feel free to open if you still find issue.