llama
llama copied to clipboard
[ Question]: Is this line a bug?
https://github.com/facebookresearch/llama/blob/ef351e9cd9496c579bf9f2bb036ef11bdc5ca3d2/llama/generation.py#L192
I'm currently looking at the code, and trying to get myself around it.
I have a question about the above line.
Shouldn't the logits go through a softmax in this line? We want to take the probabilities, is that correct?
Thank you very much!