Thomas Viehmann
Thomas Viehmann
Uh, OK, what does that mean for the CI load?
a 1-hour job after each commit sounds like it would put quite a strain on the CI.
I think the main thing is to get the environment set up "vcvarsall.bat", unfortunately, it seems a bit of a hassle.
So I think it would be really good if we could use recipes #1188 here to enable transforms by default. Last I knew, we had an eta of 1-2 weeks....
@riccardofelluga Yes, seems true. I think the thing that goes wrong is when we decide that the proxy for the result of rand should be unpacked in the prologue while...
The Python versions Thunder supports are 3.10, 3.11, 3.12. Not sure what this means for NVFuser.
> it's skipped for two months This is tracked as #1920 I will comment there.
Hey, great work @mseeger . Can we decouple things a lot, though? Some initial thoughts: - I would prefer if we kept the KVCache initialization as in the current version...
Hi, so I think we should try to break things down. We could either start with the core caching itself and try to see how to integrate it with minimal...
Hey, sorry, I am totally swamped, still want to have a video call to chat. > Out of curiosity: Why do you object to batch prompts being a list of...