Can't loading delta

[feymanwang]

When did you clone our code?

I cloned the code base after 5/1/23

Describe the issue

Issue: Can't load delta model, it stuck and showed a warning message

Command:

python3 -m llava.model.apply_delta \
    --base /data/home/llama-7b-hf\
    --target /data/home/LLaVA-7B-v0 \
    --delta /data/home/LLaVA-7b-delta-v0

Log:

Loading base model
Loading checkpoint shards: 100%|█████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 33/33 [00:07<00:00,  4.70it/s]
Loading delta
You are using a model of type llama to instantiate a model of type llava. This is not supported for all configurations of models and can yield errors.

Screenshots: You may attach screenshots if it better explains the issue.

[haotian-liu]

Hi, this is expected (as the checkpoint was created in an earlier version) and it is not an error; our latest code base can deal with correctly and generate the corresponding model weights. Can you take a look at /data/home/LLaVA-7B-v0 folder and see if there is anything written inside it?

[RongkunYang]

Hi, I meet the same problem, and the target folder does not have any output, have you resolved it. And I think this may be caused by the llama weight version should be 1, not 2, right?