vicuna-13b weird answer

[Y0rkieQvQ]

trafficstars

When I start vicuna-13B today, after it prints the answer, it starts answering itself each time. Is that normal？Or is this a new feature? The output with three '#' in front is the sign that it starts to question and answer itself. It's weird. There's no way to upload a video or you could see this amazing thing. I asked it in both languages and it came up with this question:

[phnessu4]

I have the same problem.

[DearChuck]

I have the same problem，too

[bash99]

Same here

[alan-ai-learner]

@Y0rkieQvQ , see this i was having similar problem, because i was using latest fastchat with vicuna 1.0 model. You can solve this issue by again generating the vicuna weight using the latest vicuna-delta-v1.1. See this issue. https://github.com/lm-sys/FastChat/issues/409

• To be safe side in future , try installing from source with older commit.

[merrymercy]

Please check out this warning. There are several options to solve this problem

https://github.com/lm-sys/FastChat/blob/d807fd0d70af514801b8bb6942608ded6d6c914a/fastchat/serve/inference.py#L26-L31

[chuckhope]

same problem

[zhisbug]

This is because we did an upgrade on the model weights. Please follow what @merrymercy suggested to upgrade the model weights and fastchat versions.