language icon indicating copy to clipboard operation
language copied to clipboard

Fine Tune Script ReadMe Description Error

Open zzj0402 opened this issue 4 years ago • 4 comments

There is an error in the script for fine tuning the bert baseline: --train_precomputed=nq-train.tfrecords-00000-of-00001 \ should be --train_precomputed_file=bert-joint-baseline/nq-train.tfrecords-00000-of-00001 \

python -m language.question_answering.bert_joint.run_nq \
  --logtostderr \
  --bert_config_file=bert-joint-baseline/bert_config.json \
  --vocab_file=bert-joint-baseline/vocab-nq.txt \
  --train_precomputed_file=bert-joint-baseline/nq-train.tfrecords-00000-of-00001 \
  --train_num_precomputed=494670 \
  --learning_rate=3e-5 \
  --num_train_epochs=1 \
  --max_seq_length=512 \
  --save_checkpoints_steps=5000 \
  --init_checkpoint=uncased_L-24_H-1024_A-16/bert_model.ckpt \
  --do_train \
  --output_dir=bert_model_output

zzj0402 avatar Jan 05 '20 07:01 zzj0402

Same error occurred with me. I struggled with code only to realize this silly mistake.

rrajp avatar Jan 13 '20 10:01 rrajp

Where can I find uncased_L-24_H-1024_A-16/bert_model.ckpt?

Syauri avatar Apr 03 '20 19:04 Syauri

Where can I find uncased_L-24_H-1024_A-16/bert_model.ckpt?

https://storage.googleapis.com/bert_models/2019_05_30/wwm_uncased_L-24_H-1024_A-16.zip

zzj0402 avatar Apr 13 '20 12:04 zzj0402

Thanks!

Syauri avatar Apr 14 '20 06:04 Syauri