Netanel Haber
Netanel Haber
/bot run --disable-fail-fast
I'm one of the devs working on improving (Variable) Sliding Window Attention [(V)SWA] (with and without reuse) support in TRTLLM. Addressing some your points: 1. > [because it compares to...
> Do you think it would be possible to open a separate PR for the changes made to the following files? Sure, I'll do so promptly.
https://github.com/sgl-project/sglang/pull/13506 @yhyang201
> Could you rebase and resolve the conflicts? Then we can run the CI tests — I believe we’ll be able to merge it soon. Done
> Can you check the cause of the CI error? ... > ImportError: This modeling file requires the following packages that were not found in your environment: open_clip. Run `pip...