im-not-tom issues

Repositories
Issues
Comments

Results 2 issues of


                                            im-not-tom

Added support for 'Text generation web UI' as backend for text generation

Hello, this PR allows using [oobabooga/text-generation-webui](https://github.com/oobabooga/text-generation-webui) as backend for text generation, allowing Tavern to be used as alternative to oobabooga's web UI. It adds option to API Combobox, [UI for...

Feature Request: Response streaming with HTTP API

This PR extends API extension with `/api/v1/generate_stream` endpoint. This endpoint takes same input as `/api/v1/generate`, but responds with plain text while outputting tokens as soon as they are ready. This...