Liguang Xie

icon indicating an email [email protected]

icon location Interested in building AI/ML core systems for scaling LLM and generative AI applications

Results 72 comments of Liguang Xie

[RFC] Support different inference engines like vLLM, SGLang, TensorRT-LLM

This is a pretty cool feature. Let us discuss!

[core] Pass all driver env vars to ray workers unless excluded

> Currently many driver env vars are not passed to ray workers while they should have been. This has caused bugs and confusions. > > To fix this, we are...