transformerlab-app icon indicating copy to clipboard operation
transformerlab-app copied to clipboard

Certain models respond with ABBBBB on MLX

Open dadmobile opened this issue 4 months ago • 0 comments

More details needed but I noticed that most models I train with MLX and some other trained models I download have an issue when running MLX server. The response from the LLM comes in the format of ABBBBB... where it repeats B forever until you stop the reponse or it hits the limit.

dadmobile avatar Oct 04 '24 17:10 dadmobile