Jinni Gu

icon indicating an email [email protected]

icon company University of Washington, Seattle icon location Seattle, WA icon location [email protected]

Results 2 issues of Jinni Gu

[New Model] Add an example for Mixtral 8 * 7B Instruct model

It would be great if Ray-LLM could support the [Mixtral 8*7B Instruct](https://huggingface.co/mistralai/Mixtral-8x7B-Instruct-v0.1) model.

feature: support restarting bidi streaming

3 comment

This PR fixes the issue where users couldn't restart audio/video streaming after stopping it in the same session. Previously, clicking the microphone icon after stopping would show an error "Restarting...