When start local server, use API to access server, and multiple users need to queue up to request API

[lrfbeyond]

After start local server, access the API for chat conversations. If multiple users call the same API at the same time, only the first user can call the API to return data, and the other user needs to wait for the first conversation to complete before the API returns data. Has anyone encountered this situation? How did you solve it? My environment: Ubuntu22.04, LM version 0.2.31

当启用本地服务后，访问接口进行聊天对话，如果多个用户同时调用同一个API进行对话时，只有第一个用户可以调用接口返回数据，另一个需要等待第一个对话完成后接口才会返回数据。请问大家有没有遇到这种情况，是如何解决的？ 我的环境：Ubuntu22.04， LM版本0.2.31