Hansen06
Hansen06
Did you solve this problem? I have the same problem also.
I have solved the problem. you can solve it follow this step. First, go to the "https://www.dropbox.com/s/a84otqrg6u1c5je" download the document "stats.zip". Second, put it in the folder "/usr/local/lib/python3.5/dist-packages/ekphrasis"
造成遗忘我理解是不是就prefix_encoder这一部分参数放进来之后造成的？所以我在尝试如何把这部分参数失效，将past_key_value值为None，但是发现就无法生成了，没有生成任何内容，如果能成功把prefix_encoder这部分参数卸载下来，是不是就可以使用原模型的参数了
> 请问，您的运行起来了吗？我的一直报错：tensorflow.python.framework.errors_impl.InvalidArgumentError: Inputs to operation transformer/transformer-1/multi_head_atten/Select of type Select must have the same size and shape. Input 0: [8,100,100] != input 1: [1024,100,100] 在预测是你可以将batch_size改为1,，因为预测时输入是一个句子
ERROR 03-13 11:48:37 serving_chat.py:158] Error in applying chat template from request ERROR 03-13 11:48:37 serving_chat.py:158] Traceback (most recent call last): ERROR 03-13 11:48:37 serving_chat.py:158] File "/mnt/afs2/my_conda_env/tooluse/lib/python3.10/site-packages/vllm/entrypoints/openai/serving_chat.py", line 126, in create_chat_completion...