Simon Mo

icon indicating an email [email protected]

icon location Berkeley, CA icon location maintains @vllm-project, working on serving systems since 2017

Results 313 comments of Simon Mo

[serve] Regression of serve DAG API

I can reproduce the separate issue locally. looking into it now

[serve] Regression of serve DAG API

@iycheng can update from using #27718 here?

[Serve][Doc] Add Batching User Guide

Comments addressed! I think we can keep the tutorial example which uses PyTorch and show case how to compile batches into tensors and others.

[wip] Add serve ha chaos test into nightly test.

can you run an example run through: https://buildkite.com/ray-project/release-tests-pr/builds/14266

[Serve][Doc] Update the doc code to use new api

there's a merge conflict with rllib.md from @zcin's PR

[Serve] New Dashboard can't render serve log

@alanwguo

Revert "Revert "[serve] Integrate and Document Bring-Your-Own Gradio Applications""

@dmatrix would you mind stamping/reviewing this?

Revert "Revert "[serve] Integrate and Document Bring-Your-Own Gradio Applications""

can you try merge master again now https://github.com/ray-project/ray/pull/27826 is fined

Revert "Revert "[serve] Integrate and Document Bring-Your-Own Gradio Applications""

maybe revert the `python/setup.py` changes? It's a noop and we don't need it. (with the change I can't merge this PR).

Revert "Revert "[serve] Integrate and Document Bring-Your-Own Gradio Applications""

previous suite all passed. merging