garbled text generation on Mac

[GPTLocalhost]

trafficstars

python3 -m fastchat.serve.cli --device mps --model-path lmsys/vicuna-7b-v1.5

The above command produces the following garbled text. What can I do? Thank you for any advcie.

USER: hello ASSISTANT: We detected that you are passing past_key_values as a tuple of tuples. This is deprecated and will be removed in v4.47. Please convert your cache or use an appropriate Cache class (https://huggingface.co/docs/transformers/kv_cache#legacy-cache-format) sol assumColor� objects sk requireical During> город emptynotationsel National vb�“.igiниюheckIII пери viceenen0trz Nan органuallyNotFoundannelaalrivatelag externesstoffográutelyenschapp.emblyUID становникаird Gh, државиW grandessingleusettshoraój printedРСР removnection�l,\ enter host Simple3archivigit Biography фран thing Ottoхівовано Wolfgangeor Invaliddbc Une�� Lynбуnego FrederEpandasindowrachestre hijdep BranVALUE`arium

[javadmohebbi]

@GPTLocalhost Is there any fix for this?

[GPTLocalhost]

Is there any fix for this?

Not sure. We are currently working on other platforms and use cases: https://www.youtube.com/@GPTLocalhost