Finetune this model for translate other languages

Open devops724 opened this issue 10 months ago • 4 comments

Hi i have some dataset column is like this english,- other language - how i can finetune this model to get better translate on other languages using this dataset

Feb 27 '25 12:02 devops724

Thanks for your interest.

We provide guidelines for SFT of LLaDA in GUIDELINES.md. You can fine-tune LLaDA on your dataset.

Mar 03 '25 10:03 nieshenx

Is there any chance of having scripts/notebooks for training or finetuning the model?

Mar 03 '25 11:03 prp-e

We are very sorry, but we are currently unable to provide that. We have included the core code for pre-training and SFT in the GUIDELINES.md file, which you can refer to.

Mar 03 '25 12:03 nieshenx

@devops724 @prp-e

Hi there, we’ve built dllm, a lightweight finetuning framework for diffusion language models on top of the 🤗 Transformers Trainer. Give it a try if you’d like to finetune LLaDA / LLaDA-MoE and Dream.

Sep 21 '25 23:09 ZHZisZZ