FlagEmbedding icon indicating copy to clipboard operation
FlagEmbedding copied to clipboard

Could you share the evaluation scripts for the bge-code-v1 model on the CoIR and CodeRAG benchmarks?

Open kartikzheng opened this issue 6 months ago • 2 comments

I noticed that the official evaluation results of the bge-code-v1 model on the CoIR and CodeRAG benchmarks are relatively high. I'm curious about some of the test configurations and steps. Could you share the evaluation scripts for the bge-code-v1 model on the CoIR and CodeRAG benchmarks? Thank you very much.

https://modelscope.cn/models/BAAI/bge-code-v1/summary

kartikzheng avatar May 27 '25 08:05 kartikzheng

You can evaluate the model using the following command: https://github.com/FlagOpen/FlagEmbedding/tree/master/research/BGE_Coder#evaluation-script

545999961 avatar May 28 '25 06:05 545999961

Thank you very much. I tried it and was able to reproduce the results.

kartikzheng avatar May 28 '25 09:05 kartikzheng