chatgpt-clone icon indicating copy to clipboard operation
chatgpt-clone copied to clipboard

increase backend conversation speed

Open dail45 opened this issue 2 years ago • 0 comments

  1. using orjson instead of standart python json, another small changes for better performance
  2. accumulating chunks from openai when js in decoding chunks (config->backend_config->join_chunks turn on by default)

dail45 avatar Oct 28 '23 12:10 dail45