Jan Strich

icon company University of Hamburg icon location Hamburg icon location Research Scientist at the University of Hamburg

Results 1 issues of Jan Strich

[Feature]: Online Inference on local model with OpenAI Python SDK

9 comment

### 🚀 The feature, motivation and pitch OpenAI recently provided a new endpoint batch inference (https://platform.openai.com/docs/guides/batch/overview?lang=curl). It would be nice if it works using the batch format from OpenAI but...

feature request
unstale