[Question] Reproduce LLaVA with Mistral backened

[Carboxy]

Question

Thank you for your excellent work. I am reproducing LLaVA with Mistral backened，but there is always a performance gap. Could you provide the training scripts (Pretrain and Finetune) for LLaVA-Mistral ？Thanks a lot!

[lvaleriu]

• did you use mistralai/Mistral-7B-v0.1 or mistralai/Mistral-7B-Instruct-v0.1/v0.2 ?
• What conv_template are you using? (plain, mistral_direct, mistral_instruct or any of the conv_llava_XXX)

--version plain

[chanangad]

try using llava_llama_2 conv_template and mistralai/Mistral-7B-Instruct-v0.2. It works