SmartEdit icon indicating copy to clipboard operation
SmartEdit copied to clipboard

there are lots of bugs in TrainStage1

Open Bilibilee opened this issue 5 months ago • 2 comments

Thank you for your excellent work, but the open-source code indeed has many minor issues, which makes others hesitant to follow your work. During the TrainStage1 phase, the issues are as follows:

  1. code torchrun --nproc_per_node=8 --master_port=20001 fastchat/train/TrainStage1.py fastchat directory seemingly doesn't exist,it should be train/TrainStage1.py.
  2. code load_LLaVA_ckpt_v1_1 should be load_LLaVA_ckpt_v1_1_7b.
  3. code SD_QFormer_conversation_33tokens ckpt doesn't have mm_projector module, which didn't used in train stage 1.

Could you provide Trainstage1 result checkpoint.

Bilibilee avatar Sep 27 '24 09:09 Bilibilee