The Evil Man
The Evil Man
> Hi @DefinitlyEvil > > Thanks for raising this issue. > > 1. Can you try the main branch of FlashInfer? > > 2. After you installed the main branch,...
Same here OOM. ``` Quantizing Transformer 2 - quantizing 40 transformer blocks 48%|####7 | 19/40 [01:29
This also happened to Wan 2.2 TI2V 5B using UI.
Probably caused by OOM, try to revert back to commit c6edd71a5bb36f3dffcc8b56ee07cacaee14ab56. See #457.
> Yeah, it was just a simple OOM. More VRAM solved it, as expected. How much VRAM you were using? I have 96GB VRAM not working with latest commit.
> > > Yeah, it was just a simple OOM. More VRAM solved it, as expected. > > > > > > How much VRAM you were using? I have...