HunyuanDiT icon indicating copy to clipboard operation
HunyuanDiT copied to clipboard

[Feature request] Add a setting to not use t5 encoder for train

Open Bocchi-Chan2023 opened this issue 8 months ago • 4 comments

Describe the feature Currently, traing Hunyuan Dit requires a significant amount of vram. Regarding this, I noticed that the T5 encoder uses a lot of vram. So I wanted to have a setting to not train this T5 encoder.

Motivation I noticed that during LoRA and fine-tuning, we were using a lot of VRAM relative to the size of the model.

Related resources

Additional context For example, it would be appreciated if you could add an option such as --no-t5 that can be disabled at train time.

Bocchi-Chan2023 avatar Jun 16 '24 13:06 Bocchi-Chan2023