LiuBenying
LiuBenying
Have you solved the problem, I also countered the same tensor mismatch problem 33 tokens vs 35 tokens!
Did you solve the problem?
what about LLaVA-7b-v1-1
you can use the release version. Just do the command "pip install xxx.whl" and hope it'll help you!
of course, I got the same problem
Have you solve the problem?
I used RTX 4090 24G, but always got an error when operate multi_tensor
Finally,I use single L20 (48G), and got this 