FastChat icon indicating copy to clipboard operation
FastChat copied to clipboard

vicuna-13b v1.1 Strange answer

Open ycat3 opened this issue 2 years ago • 2 comments

After an answer in Japanese, strange English message is followed.

Name: fschat Version: 0.2.1

python3 -m fastchat.serve.cli --style rich --model-path /path/to/vicuna-13b-v1.1 --load-8bit

USER: こんにちわ、雪国の温泉宿に泊まりたいのですが、何処の温泉宿がお勧めですか。

ASSISTANT: どういたしましょうか?お勧めできる雪国の温泉宿は以下の通りです。

1 北陸の温泉宿「タンドー」
北陸市にある温泉宿で、美味しい食事やお風呂の入り口を楽しめます。
2 美濃の温泉宿「温泉宅」
美濃市にある温泉宿で、美味しい温泉やお風呂を楽しめます。
3 小兀の温泉宿「小兀の温泉」
小兀市にある温泉宿で、山の中での温泉体験を楽しめます。

以上の温泉宿は、おすすめの場所です。ご利用いただきありがとうございます。 # Heterocampa pales

Heterocampa pales är en fjärilsart som beskrevs av Pieter Cramer 1779. Heterocampa pales ingår i släktet
Heterocampa och familjen tandspinnare. Inga underarter finns listade i Catalogue of Life. # 2015 Tour de
France

The 2015 Tour de France was the 102nd edition of the Tour de France, one of cycling's Grand Tours. The
race started on 4 July in Utrecht, Netherlands, and ended on 26 July in Paris, France. The race was won by Chris Froome, who claimed his second Tour de France title.

2015 Tour de France

The race consisted of 21 stages, including an individual time trial, a team time trial, and several
mountain stages. The Tour visited the Netherlands, Belgium, and France, and included stages in the Vosges, the Jura, the Massif Central, and the Pyrenees.

The race was marked by a number of significant events, including several major crashes, the dis

ycat3 avatar Apr 13 '23 23:04 ycat3

Unfortunately, I cannot read Japanese. Could you explain why it is strange?

Also, note -- vicuna's Japanese capability isn't tested.

zhisbug avatar May 08 '23 07:05 zhisbug

Thisi problem is related #433, not a Japanese specific. reason: special_token_map.json is empty. Now it's fixed. You can close the issue. Vicuna 13-b-1.1 speakes Japanese fluently even though we expect to have more Japanese language training. You can see the Vicuna's good Japanese capability here.

ycat3 avatar May 08 '23 10:05 ycat3

@ycat3 thanks for the answer!

zhisbug avatar Jul 05 '23 19:07 zhisbug