Reza Barazesh

Results 4 comments of Reza Barazesh

I've been pitching this tool at my workplace and this is the main feature stopping us from using it right now.

+1 This iron looks very promising. I love the construction.

@bbartels I'm going to split the aot vs jit out of this ticket. For now simply switching the base image to runtime and installing the tools and headers we need...

https://github.com/vllm-project/vllm/pull/28727 is ready for review and saves 3 GB of space.