Please handle the case your logits contain nans

[ParisNeo]

Hi, I was prompting llama-2-7B and got into this error.

Can you please handle the case there are nans in the logits?

[turboderp]

NaN or infinities in the logits implies the model has failed for one reason or another. This may be caused by a bug in the implementation, or it may be a corrupted/incorrectly finetuned model, but I'd need a lot more details to start figuring out what the cause is.