transformerlab-app
transformerlab-app copied to clipboard
Certain models respond with ABBBBB on MLX
More details needed but I noticed that most models I train with MLX and some other trained models I download have an issue when running MLX server. The response from the LLM comes in the format of ABBBBB... where it repeats B forever until you stop the reponse or it hits the limit.