markprompt-js
markprompt-js copied to clipboard
AI response may contain broken char - ��
Describe the bug
When streaming response from AI that includes unicode symbols (e.g. cyrillic), sometimes I observe ��
instead of some random character.
To Reproduce
Steps to reproduce the behavior:
- Go to https://markprompt.com/<your_login>/starter/playground
- Enter prompt like 'Output some text. Translate your response to Russian'
- Run this (or another) prompt several times (usually 2-3 is enough)
- Most probably some of responses contain at least one broken character (random).
Additional context
I think that may occur when some chunk during streaming breaks inside codepoint, thus instead of 1 valid codepoint we get 2 invalid. Though, I never experience that in other ChatGPT-related services.