mteb icon indicating copy to clipboard operation
mteb copied to clipboard
verified publisher icon embeddings-benchmark

WIP: Leaderboard

Open x-tabdeveloping opened this issue 1 year ago • 0 comments

I'm using this branch and PR to add the necessary changes to the library for a leaderboard. So far, I have renamed MTEBResults to TaskResult and added a BenchmarkResults object with a number of utility methods. I'm also working on the model metadata objects, which are currently in an unsatisfactory state, and I added utilities for easily fetching a model registry.

x-tabdeveloping avatar Sep 24 '24 09:09 x-tabdeveloping