is openchat 3.5 a multilingual model?

[LCorleone]

Sometimes it is strange that it answers in Chinese while query is English. I check that there is no chinese characters in query.

[imoneoi]

Yes. Are you using a quantized version?

[LCorleone]

Yes. Are you using a quantized version?

no, but i cannot figure out why this happen.

[imoneoi]

Can you paste your prompt here?

[LCorleone]

Can you paste your prompt here?

this is my template, is there any mistakes? tokenizer.chat_template = "{% for message in messages %}{% if message['role'] == 'user' %}{{ 'GPT4 Correct User: ' + message['content'] + eos_token }}{% elif message['role'] == 'system' %}{{ message['content'] + eos_token }}{% elif message['role'] == 'assistant' %}{{ 'GPT4 Correct Assistant: ' + message['content'] + eos_token }}{% endif %}{% if loop.last and add_generation_prompt %}{{ 'GPT4 Correct Assistant:' }}{% endif %}{% endfor %}"

[imoneoi]

Is the eos_token <|end_of_turn|> ? Btw the temperature should be lower (like 0.5) for Mistral models.

[baptistejamin]

Managed to use French, Japanse, Chinese with this model so it should be possible