Andrew Reed
Andrew Reed
# Issue NeuralQA's requirements do not have pinned package versions, instead they use `>=` to pull the latest version of each library. With the latest release of `transformers`, there is...
### Prerequisites - [X] I am using [the latest version of Locust](https://github.com/locustio/locust/releases/) - [X] I am suggesting a new feature, not asking a question ### Description Would be great to...
### System Info v1.4.5 ### Information - [X] Docker - [X] The CLI directly ### Tasks - [X] An officially supported command - [ ] My own modifications ### Reproduction...
### Feature request OpenAI's `/chat/completions` endpoint has the option of returning a `CompletionUsage` object when streaming responses by passing an additional arg `stream_options={"include_usage": True}`. It looks like TGI's implementation doesn't...