bert icon indicating copy to clipboard operation
bert copied to clipboard

Where is pre-trained model tf_examples.tfrecord ?

Open nicejava opened this issue 3 years ago • 1 comments

i try run this command

python run_pretraining.py
--input_file=/tmp/tf_examples.tfrecord
--output_dir=/tmp/pretraining_output
--do_train=True
--do_eval=True
--bert_config_file=$BERT_BASE_DIR/bert_config.json
--init_checkpoint=$BERT_BASE_DIR/bert_model.ckpt
--train_batch_size=32
--max_seq_length=128
--max_predictions_per_seq=20
--num_train_steps=20
--num_warmup_steps=10
--learning_rate=2e-5

i have already downloaded uncased_L-12_H-768_A-12_2.zip have .json and .ckpt files, but not have tf_examples.tfrecord

Thank you ..

nicejava avatar Aug 04 '21 10:08 nicejava

tf_examples.tfrecord file need to be made by using this script, create_pretraining_data.py. To use this , you need to prepare the text files according to betold format.

suchunxie avatar Jun 05 '22 09:06 suchunxie