llama icon indicating copy to clipboard operation
llama copied to clipboard

[ Question]: Is this line a bug?

Open kozer opened this issue 1 year ago • 0 comments

https://github.com/facebookresearch/llama/blob/ef351e9cd9496c579bf9f2bb036ef11bdc5ca3d2/llama/generation.py#L192 I'm currently looking at the code, and trying to get myself around it. I have a question about the above line. Shouldn't the logits go through a softmax in this line? We want to take the probabilities, is that correct? Thank you very much!

kozer avatar Feb 04 '24 09:02 kozer