ChatMLX icon indicating copy to clipboard operation
ChatMLX copied to clipboard
Published 9 months ago • verified publisher icon johnmai-dev

Runtime error: The operation couldn’t be completed. (Tokenizers.TokenizerError error 1.)

Open yczhangsjtu opened this issue 1 year ago • 2 comments

On Mac Sonoma. Just installed the software from the latest release (1.1.2 (4)), and downloaded the LLama-3.2-3B-8bit from the MLX community panel. Then see this error. image

yczhangsjtu avatar Oct 10 '24 05:10 yczhangsjtu

LLama-3.2-3B-8bit is not a chat model; it is recommended to use Instruct or Chat models. Ex: https://huggingface.co/mlx-community/Llama-3.2-3B-Instruct-8bit

I will compatibility such models.

johnmai-dev avatar Oct 10 '24 06:10 johnmai-dev

Thank you.

yczhangsjtu avatar Oct 10 '24 06:10 yczhangsjtu