xtuner icon indicating copy to clipboard operation
xtuner copied to clipboard

[Fix] limiting the maximum version of transformers avoids null pointer

Open Kit-Hung opened this issue 1 year ago • 1 comments

After transformers version 4.41.0, the method of obtaining the sample model cache_position was changed to cause a null pointer during finetune, limiting the maximum version of transformers avoids this problem.

Kit-Hung avatar Jun 05 '24 02:06 Kit-Hung

@Kit-Hung How can this issue be reproduced? Perhaps there are other ways that could be compatible with 4.41.0?

pppppM avatar Jun 11 '24 05:06 pppppM