Logesh kumar

Hi, Unfortunately Mutate currently doesn't support training. However, if you wish to finetune your LLM - following the steps in the repo would probably help - https://github.com/Xirider/finetune-gpt2xl

Thank you @mirix , Making `ddp_find_unused_parameters=False` in Trainer solved this issue for me.

+1 I am facing a similar issue when loading from here https://huggingface.co/maderix/llama-65b-4bit. Any help on this would be great !