VITA
VITA copied to clipboard
cache_position is missing for input of function prepare_inputs_for_generation in class VITAQwen2ForCausalLM
as said in the title of this issue and showed in the picture below:
the envirnment is: V100, cuda 12.4, torch 2.3.1
undate your transformers version, e.g transformer=4.43.4
solved! thanks for dealing with this problem instantly!
Same issue, same solution. Thanks a lot @zzksdu :)
PS: Prehaps an update of requirement.txt should be do ^^'