Ege Beysel
Ege Beysel
> > This is a case where workgroup distribution failed to fuse in a pack: > > Question here: what would be the reason to end up with such a...
Hey @hanhanW, I'd like to help on this one. AFAICS, this specific issue has 2 (actually 3 with the fallback option not existing after fusion fails on the wg-level) problems:...
Btw. thanks for the pointers! I'm currently looking at these - especially the unpack counterpart that you implemented - trying to get a better picture of how it is and...
Hey , sorry I was off for a while and missed the last comment. I'd be down to discuss the tile size generator idea. I guess this would be even...
@hanhanW I'll be glad if you could ping me if/when you're working on this. I'll also be interested to work on it and/or contribute at one point but I don't...
@hanhanW mind taking a look at this if/when you have time? I'll gladly take over the implementation part if I could get a second opinion on which direction to go...
Absolutely no problem, thanks for the reply :) > Can you name a few of them? I think I'll use llama and sdxl to think about memory footprint problem. Having...
Speaking of memory footprint btw. I believe there was an issue and/or difference of the dt-fusion pipeline with the current default (CPU) pipeline in means of the weight encodings being...
Oh I see okay, thanks! Let me know if I can do anything on that regard as well, but I think for this specific case I'll go the controlFn direction!
Yes! That answers my question, I was talking about scenario 2 :) Thanks!