meeteval icon indicating copy to clipboard operation
meeteval copied to clipboard

Does mdeval computes DER taking overlapped speech into account?

Open AntoineBlanot opened this issue 1 year ago • 9 comments

Thank you very much for sharing this repository. It is very useful to have a single repo with many audio metrics :)

Tools like pyannote allows us to choose the collar and if we want to compute DER on overlapped speech regions or not.

With mdeval, we can specify the collar but it seems like there is no option for including overlapped speech in the metric or not. Does that mean that by default it computes over overlapped regions? Or are they excluded for the calculations?

Thank you for your answer !

AntoineBlanot avatar Feb 06 '24 06:02 AntoineBlanot