openai-streaming icon indicating copy to clipboard operation
openai-streaming copied to clipboard

create an example of a usage when processing data

Open AlmogBaku opened this issue 1 year ago • 0 comments

Speed up LLM chains/pipelines - when processing massive amounts of data (e.g., classification, NLP, data extraction, etc.), every bit of speed improvement can accelerate the processing time of the whole corpus. Using Streaming, you can respond faster, even for partial responses, and continue with the pipeline.

We need to create an example for this scenario

AlmogBaku avatar Feb 10 '24 07:02 AlmogBaku