using TorchMetrics

Open Borda opened this issue 3 years ago • 1 comments

Hello, I am curious if you would be interested in using TorchMetrics which has recently implemented various Text-related metrics? One of your students, @stancld have helped us with adding these metrics, so he may also advise of any potential integration... :)

Thank you for your consideration :rabbit:

Feb 24 '22 10:02 Borda

Hi @Borda , thanks for the pointer and apologies for a rather negative reply. I haven't been developing this repo any further for the past ~2 years, so I'm not planning to include any new metrics here.

You might try asking at (or get involved in) https://github.com/GEM-benchmark/GEM-metrics, which is basically an evolution of this. (Note that there probably would need to be a metric in TorchMetrics, not yet included in GEM, for the project to consider using it.)

Mar 09 '22 20:03 tuetschek