Fix tokens returning unicode partial chars

[VansonLeung]

Fix to prevent seeing � characters when chatting in Chinese.

[AlexCheema]

Is this how other APIs fix this? Or is this typically handled by the consumer of the API?

[VansonLeung]

I figured out the fix myself, I neither have no clue how other APIs fix this nor I am aware that other APIs have this issue as well.

Some unicode / Chinese characters consist of 2 integers/chars in order to render properly.

My fix hopes to avoid changing any API logic.