Yu, Kaifeng
Results
1
comments of
Yu, Kaifeng
> Hi team, > > I’m working on adapting Vidur, the LLM inference system simulator, to vLLM. Currently, Vidur’s profiling is based on Sarathi-Serve, but I’d like to explore how...