alpaca_farm icon indicating copy to clipboard operation
alpaca_farm copied to clipboard

integrity_check error with sft10k

Open bpucla opened this issue 1 year ago • 0 comments

Dear authors,

I get the integrity_check error with sft10k. The base ckpt was a raw Meta ckpt (llama1-7b) converted with transformer=4.34.0 Any insights would be appreciated!

The command I used is:

  python -m pretrained_models.recover_model_weights \
  --llama-7b-hf-dir <path1> \
  --alpaca-farm-model-name sft10k \
  --models-save-dir <path2>

bpucla avatar Oct 04 '23 22:10 bpucla