Finetuning with lora output never ends.

[gyupro]

Hi, Thanks for your wonderful work.

I am struggling using my lora tuned model.

I conducted following steps

1. finetuning with lora

• Undi95/Meta-Llama-3-8B-Instruct-hf model base
• llama3 template

2. inference with gradio

• run server with model-base Undi95/Meta-Llama-3-8B-Instruct-hf model-path checkpoints/LLaVA-Meta-Llama-3-8B-Instruct-lora

3. Model output never ends. (I think something's wrong with EOS token?)