KittoZheng

icon company Breadtrip icon location ShenZhen, China icon location Web developer, like everything cool and efficent

Results 2 comments of KittoZheng

RetrievalQA costs long time to get the answer

> I had a similar issue The biggest delay was in response from OpenAI API coz it waits the whole answer (whole generation) You could try to use stream=True to...

RetrievalQA costs long time to get the answer

> I've tried to use OpenAI API from scratch - it was also slow for big texts in response use `stream=True` to call openai and response stream data out is...