unsloth icon indicating copy to clipboard operation
unsloth copied to clipboard

AttributeError: _unwrapped_old_generate

Open ylwlf888 opened this issue 2 weeks ago • 2 comments

Unsloth 2025.2.12 patched 28 layers with 28 QKV layers, 28 O layers and 28 MLP layers. Traceback (most recent call last): File "/root/test/r1-finetuning-unsloth.py", line 192, in trainer = SFTTrainer( File "/root/unsloth/lib/python3.10/site-packages/unsloth/trainer.py", line 203, in new_init original_init(self, *args, **kwargs) File "/root/test/unsloth_compiled_cache/UnslothSFTTrainer.py", line 952, in init model.for_training() File "/root/unsloth/lib/python3.10/site-packages/unsloth/models/llama.py", line 2737, in for_training del model._unwrapped_old_generate File "/root/unsloth/lib/python3.10/site-packages/torch/nn/modules/module.py", line 2040, in delattr super().delattr(name) AttributeError: _unwrapped_old_generate

ylwlf888 avatar Feb 16 '25 12:02 ylwlf888