chat-with-mlx icon indicating copy to clipboard operation
chat-with-mlx copied to clipboard

Published 20 hours ago • verified publisher icon qnguyen3

chat templates?

Open CrispStrobe opened this issue 11 months ago • 3 comments

thanks for building this. looks nice on quick first try. but for some models, you might want to check the prompt template / stop parameters / parse yaml template files like eg ooba etc do, because cf. eg: Screenshot 2024-02-29 at 08 14 10 (sorry for quick lazy issue note, am short of time atm)

CrispStrobe avatar Feb 29 '24 07:02 CrispStrobe

Thank you @CrispStrobe , can you specific which model is this?

qnguyen3 avatar Feb 29 '24 08:02 qnguyen3

sorry should have been in the screenshot, think this was NousHermes-2-Mistral-7B-DPO (4bit)

CrispStrobe avatar Feb 29 '24 08:02 CrispStrobe

I will look into it. Thank you for reporting

qnguyen3 avatar Mar 02 '24 09:03 qnguyen3