HunyuanDiT
HunyuanDiT copied to clipboard
[Feature request] Add a setting to not use t5 encoder for train
Describe the feature Currently, traing Hunyuan Dit requires a significant amount of vram. Regarding this, I noticed that the T5 encoder uses a lot of vram. So I wanted to have a setting to not train this T5 encoder.
Motivation I noticed that during LoRA and fine-tuning, we were using a lot of VRAM relative to the size of the model.
Related resources
Additional context For example, it would be appreciated if you could add an option such as --no-t5 that can be disabled at train time.