FlagEmbedding
FlagEmbedding copied to clipboard
如何关闭wandb
如何在启动时直接关闭这个wandb呢,就不用每次都选了,启动训练命令如下:
torchrun --nproc_per_node 8
-m FlagEmbedding.baai_general_embedding.finetune.run
--output_dir ./output_1115_cleaned_data_8gpu
--model_name_or_path /work/share/embed/model/bge-large-zh
--train_data /work/share/embed/data/results/qa_after_cluster.jsonl
--learning_rate 1e-5
--fp16
--num_train_epochs 3
--per_device_train_batch_size 1
--dataloader_drop_last True \3
--normlized True
--temperature 0.01
--query_max_len 128
--passage_max_len 512
--train_group_size 24
--negatives_cross_device
--logging_steps 10
参考https://discuss.huggingface.co/t/how-to-turn-wandb-off-in-trainer/6237
training_args.report_to = []