清尘

icon indicating a website link https://www.liqingchen.com icon indicating an email [email protected]

icon location 南京 icon location Chasing the lost fragments of time.

Results 1 issues of 清尘

Baichuan2-7B-Base微调报错 AttributeError: 'BaichuanConfig' object has no attribute 'z_loss_weight'AttributeError: 'BaichuanConfig' object has no attribute 'z_loss_weight'

1 comment

命令： deepspeed --hostfile=$hostfile fine-tune.py \ --report_to "none" \ --data_path "data/test.json" \ --model_name_or_path "/data/models/Baichuan2-7B-Base" \ --output_dir "output" \ --model_max_length 512 \ --num_train_epochs 4 \ --per_device_train_batch_size 16 \ --gradient_accumulation_steps 1 \ --save_strategy...