jimchen comments

Repositories
Issues
Comments

Results 4 comments of


                                            jimchen

When will the training code open sourced?

Can you please tell me if there is any obvious difference between the training code and the one in https://github.com/haotian-liu/LLaVA? I'm trying to finetune it on my data set.

When will the training code open sourced?

Indeed, I found that the special tokens of llama3-8B are different from those of vicuna-7B. Could you please tell me what the conversation template is like you use to finetune...

When will the training code open sourced?

OK thanks, I'll try it.

When will the training code open sourced?

Hi, From your provided checkpoint (https://huggingface.co/lmms-lab/llama3-llava-next-8b), I found that the pre-trained config is ``` PROMPT_VERSION=plain PRETRAIN_DATA_VERSION="blip558k" ``` So I referred to https://github.com/haotian-liu/LLaVA/blob/main/scripts/v1_5/pretrain.sh to pre-train with LLaMA3-8B backend as the following...