PinganYANG

Hello, I found the bug which comes from the part of FastChat. The problem comes from the function`get_gen_params` in `fastchat.serve.openai_api_server.py`. In this function, it will try to append your message...

A lazy way to solve this is to add a line in fastchat.serve.openai_api_server.py line 233 with `conv["messages"] = []` after `conv = await get_conv(model_name)`

那我也不太清楚了。我没直接用这个repo，只是用了他request到fastchat那部分的代码。 你可以看一下他最后一步输入的prompt到底是什么样子的，加没加奇怪的conversation。否则可能是你的embedding chunksize太大了。2048的token还是挺小的