pyllama icon indicating copy to clipboard operation
pyllama copied to clipboard

Randomly get shape mismatch error

Open vedantroy opened this issue 2 years ago • 0 comments

When doing inference, I randomly get the following error:

RuntimeError: The expanded size of the tensor (256) must match the existing size (287) at non-singleton dimension 0.  Target sizes: [256].  Tensor sizes: [287]

vedantroy avatar May 02 '23 20:05 vedantroy