FlagEmbedding icon indicating copy to clipboard operation
FlagEmbedding copied to clipboard
verified publisher icon FlagOpen

BGE-M3预训练问题

Open LLLiHaotian opened this issue 1 year ago • 1 comments

如果要基于自己的中英文文本数据，对BGE-M3模型进行RetroMAE的二次训练，是直接对xlm-roberta进行二次训练吗

LLLiHaotian avatar May 14 '24 06:05 LLLiHaotian

We release the retromae version of bge-m3: https://huggingface.co/BAAI/bge-m3-retromae, and you can use it to do pretrain.

staoxiao avatar May 15 '24 03:05 staoxiao