ai icon indicating copy to clipboard operation
ai copied to clipboard

Published 20 hours ago • verified publisher icon vercel

Strange question marks �� in cyrillic symbols

Open TimPchelintsev opened this issue 1 year ago • 1 comments

Hi! Thanks for great lib. Screenshot from https://chat.vercel.ai: Screenshot 2023-06-19 at 07 38 59

It seems like an encoding issue, and it seems to appear only on Vercel deployment.

TimPchelintsev avatar Jun 19 '23 02:06 TimPchelintsev

This is almost certainly because we're not using the stream option on our TextDecoders, so it's processing a split UTF octet and treating it as invalid text.

jridgewell avatar Jun 20 '23 23:06 jridgewell

Hi guys @jridgewell @shuding thanks for quick response but is seems issue is still present. Question marks still appear on https://chat.vercel.ai and in my product even after upgrade to new version with stream: true fix. Recent screenshot from https://chat.verce.ai: Screenshot 2023-06-23 at 10 43 30

TimPchelintsev avatar Jun 23 '23 05:06 TimPchelintsev