corenet
corenet copied to clipboard
apple
Instruct Template
Hi there, looking at OpenELM instruct template what I understood is that the template is something like this:
<|system|> You are a helpful AI assistant. <|user|> How to explain Internet for a medieval knight? <|assistant|>
Is that right? With MLX the model is not properly working on instruct mode.
Yes, this would be really useful. I am trying to use the OpenELM instruct models but I can't find out what the instruct template is.
Is there any update regarding the chat template and tokenizer used for instruction tuning?
Especially when using OpenELM 1.1B Instruct models from Huggingface, I only get "<<<<<<" as the output.
I used tokenizer of "meta-llama/Llama-2-7b-hf" and original template from Llama2, but the output is garbage.... It would be great if you can clarify
I'm also confused here. If indeed we need to use meta-llama/Llama-2-7b-hf chat template, so why does the source code also include another different chat template?
