compute colbert score in batch

[davidbetancur8]

Is it possible to compute the colbert score for the m3 model for more than one pair at the time? currently seems very inneficient

[davidbetancur8]

Also looks there is a difference between the colbert_score in https://github.com/FlagOpen/FlagEmbedding/blob/master/FlagEmbedding/BGE_M3/modeling.py and in https://github.com/FlagOpen/FlagEmbedding/blob/master/FlagEmbedding/bge_m3.py

[oguzserbetci]

As far as I can tell, you should use this method or it can help as a guidance how to do it yourself.

[polieste]

@davidbetancur8 Are there any updates on calculating colbert_score in batch?