instructor-embedding icon indicating copy to clipboard operation
instructor-embedding copied to clipboard

How to combine instructor-embedding x bge-m3

Open geekodour opened this issue 11 months ago • 2 comments

I would want to use goodness of https://huggingface.co/BAAI/bge-m3 (bge-m3) and instructor-embedding , I think it'll require complete retraining? can someone help me with how would one go about this?

geekodour avatar Dec 19 '24 05:12 geekodour

I'm not sure what you mean? They are two different models...

BBC-Esq avatar Jan 15 '25 03:01 BBC-Esq

apologies, I didn't have clearer understanding in the start.

dropping the explanation from another thread for anyone having the same query:

instructor-embedding is a way to embed models (independently of if they have multiple representations like M3) to specific domains.

retrain

m3+instructor embedding: you then need to re-train and include the instruction prefixes of instructor into M3

geekodour avatar Jan 16 '25 02:01 geekodour