FastChat icon indicating copy to clipboard operation
FastChat copied to clipboard

api_server runs too slowly

Open ShuxunoO opened this issue 2 years ago • 2 comments

when I use the api_server, I found that it runs too slowly. With the same hardware and environment, web_server is 3-5 times faster. What is the reason for this and how can it be optimized?

ShuxunoO avatar May 26 '23 08:05 ShuxunoO

the same problem and the api answer is very bad.

yuege613 avatar May 30 '23 08:05 yuege613

mark

gebilaoman avatar Jun 09 '23 08:06 gebilaoman

How do you handle this problem?

yqli2420 avatar Jun 29 '23 13:06 yqli2420

Hey, I don't see that problem, really. Maybe because I came later to the game :-)

Are you still noticing this?

I close this, because I can't reproduce, but if you feel that it's still so much slower than the web interface, please let me know!

surak avatar Oct 23 '23 08:10 surak