LLaVA icon indicating copy to clipboard operation
LLaVA copied to clipboard

Where I can find the model with pretrain name?

Open HelloWorldLTY opened this issue 1 year ago • 1 comments

Describe the issue

Hi, in the finetuning code, I notie that the model has name: --pretrain_mm_mlp_adapter ./checkpoints/llava-v1.5-13b-pretrain/mm_projector.bin \

However, I can only find foder without pretrain notifaction, like llava-v1.5-13b

Are they same? Thanks.

HelloWorldLTY avatar Feb 27 '24 04:02 HelloWorldLTY

Furthermore, if I remove the word "pretrain", I meet a new bug:

_pickle.UnpicklingError: invalid load key, 'v'.

The finetune_LLava seems outdated since it is still based on transformers=4.31.0

HelloWorldLTY avatar Feb 27 '24 04:02 HelloWorldLTY