stable-diffusion.cpp icon indicating copy to clipboard operation
stable-diffusion.cpp copied to clipboard

[RFC] Support DistillT5

Open idostyle opened this issue 8 months ago • 1 comments

Add support for https://huggingface.co/LifuWang/DistillT5 https://github.com/LifuWang-66/DistillT5

Can be tested with https://huggingface.co/Eviation/DistillT5 e.g. https://huggingface.co/Eviation/DistillT5/blob/main/DistillT5-F32.safetensors which removes the additional wrapping.

  • [ ] Probably needs to be integrated, and at best automatically detected, alongside T5 XXL
  • [ ] Check if there is a way to use the unmodified LifuWang DistillT5 model with the additional encoder wrapping on the tensor names image

I would appreciate any ideas on how best to incorporate this in a less intrusive way.

idostyle avatar Apr 09 '25 21:04 idostyle

Nice, just as I was thinking of adding it.

stduhpf avatar Apr 10 '25 10:04 stduhpf