continue icon indicating copy to clipboard operation
continue copied to clipboard

Chat Interface Autocomplete Issues with Chinese Characters

Open ShaySheng opened this issue 1 year ago • 4 comments

I've noticed an issue with the rendering of Chinese characters in the chat interface. When Chinese text is generated, it doesn't appear visible on the frontend, despite being present in the backend response.

For example, when I input Chinese text, the response is generated but not displayed:

==========================================================================
==========================================================================
Settings:
contextLength: 1024
maxTokens: 512
temperature: 1
topP: 1
presencePenalty: 0
frequencyPenalty: 0
model: deepseek-chat
raw: true
stop: 
,
,/src/,#- coding: utf-8,```
log: undefined
############################################
验的误解和误用,正像我们时常误解和误用世界上许多其它东西一样。
因此()。
A. 我们应该取消测验
B. 使用测验能使我们解决生活中的一切难题
C. 还应不断地完善测验并引导人们正确地认识和使用测验
D. 测验是可有可无的东西
让我们来一步步==========================================================================
==========================================================================
Completion:
推理这个问题。

The frontend display looks like this:

截屏2024-09-07 12 17 23

However, when I input text in English, it appears immediately and correctly:

Criticism and even attacks against the use of tests are abundant. Sometimes, their use can even lead to unintended adverse consequences. The reasons for this situation lie not only in the imperfection of tests themselves, much like many other things in the world are imperfect, but more so in people's misunderstandings and misuse of tests, similar to how we often misunderstand and misuse many other things in the world.
Therefore, ().
A. we should abolish tests
B. using tests can solve all problems in our lives
C. tests should be continually improved and people should be guided to understand and use them correctly
D. tests are dispensable items
Let us ==========================================================================
==========================================================================
Completion:
analyze the options one by one:

The English text displays correctly:

截屏2024-09-07 12 19 09

Is it possible to fix this issue? Are there any other problems I might have overlooked that could be causing this?

Any assistance in resolving this would be greatly appreciated. Thank you!

ShaySheng avatar Sep 06 '24 22:09 ShaySheng