Curtis Maddalozzo

@Tinche ahh, thanks so much for the quick reply! I thought I must have been missing something simple 🤦 . Should it maybe be added to the example in the...

I wonder if we should standardize on a consistent HTTP library across the Python codebase. Recently it seems `httpx` has been introduced but we also use `aiohttp` in a lot...

Should we just use chunked encoding for this rather than server sent events? The SSE specification [doesn't support `POST`](https://stackoverflow.com/a/34285526) so clients will not be able to leverage the [`EventSource` API](https://developer.mozilla.org/en-US/docs/Web/API/Server-sent_events/Using_server-sent_events)....

Another example of an API from HuggingFace's Text Generation Inference server: https://huggingface.github.io/text-generation-inference/