LinFusion
LinFusion copied to clipboard
will support pixart-sigma ?
Thanks for your question. We are actively exploring the application on Diffusion Transformer based models. We will update this repo if there is any progress!
Or may be Flux? Since it is a distillation into more robust/memory-relaxed form.
Anyway, idea to research alternative attention mechanics sounds interesting, congrats!