FlagEmbedding icon indicating copy to clipboard operation
FlagEmbedding copied to clipboard

Finetuning

Open thanhtruongtran opened this issue 1 year ago • 1 comments

How can i finetune in kaggle or colab

thanhtruongtran avatar May 09 '24 08:05 thanhtruongtran

The usage of kaggle and colab is same as jupyter. You can pip install FlagEmbedding and run the command by adding ! at the beginning, e.g.,

! pip install -U FlagEmbedding
! torchrun --nproc_per_node {number of gpus} -m FlagEmbedding.baai_general_embedding.finetune.run --output_dir {path to save model} --model_name_or_path BAAI/bge-large-zh-v1.5 --train_data {your_data}

staoxiao avatar May 09 '24 14:05 staoxiao