py-motmetrics icon indicating copy to clipboard operation
py-motmetrics copied to clipboard

Problems with understanding all the symbols

Open siadajpan opened this issue 3 years ago • 3 comments

I'm having some problems with matching the symbols to the description. So far I got this:

IDF1 - ID measures: global min-cost F1 score. IDP - ID measures: global min-cost precision. IDR - ID measures: global min-cost recall. Rcl (recall) - Number of detections over number of objects. Prcs (precision) - Number of detected objects over sum of detected and false positives. GT - number of objects MT (mostly tracked) - Number of objects tracked for at least 80 percent of lifespan PT (partially tracked) - Number of objects tracked between 20 and 80 percent of lifespan ML (mostly lost) - Number of objects tracked less than 20 percent of lifespan. FP - Total number of false positives (false-alarms). FN - Total number of misses. IDs - Total number of unique object ids encountered. FM (number of fragmentations) - Total number of switches from tracked to not tracked. MOTA - Multiple object tracker accuracy. MOTP - Multiple object tracker precision. IDt - IDa IDm

Can you tell me if that is correct and what are IDt, IDa and IDm? Or describe it please in the README file

siadajpan avatar Apr 15 '21 14:04 siadajpan

Hey,

they seem to be MOTChallenge aliases for other metrics:

https://github.com/cheind/py-motmetrics/blob/6597e8a4ed398b9f14880fa76de26bc43d230836/motmetrics/io.py#L379

'num_transfer': 'IDt',
'num_ascend': 'IDa',
'num_migrate': 'IDm',

Looking up the docstrings of keys in https://github.com/cheind/py-motmetrics/blob/6597e8a4ed398b9f14880fa76de26bc43d230836/motmetrics/metrics.py reveals

"""Total number of track transfer."""
"""Total number of track ascend."""
"""Total number of track migrate."""

PRs that fix the docs would be welcome. I believe running the script above the descriptions should yield an updated list of functions.

cheind avatar Apr 15 '21 14:04 cheind

I noticed that you have IDs as IDs - Total number of unique object ids encountered.

but the IDs is actually ID switches. https://github.com/cheind/py-motmetrics/blob/6597e8a4ed398b9f14880fa76de26bc43d230836/motmetrics/io.py#L375

Just for someone who also comes across this issue.

sieumap43 avatar Dec 06 '22 13:12 sieumap43

@sieumap43 that's a naming convention in Identification Metrics (ID) and was first used in the matlab-devkit. We sticked to it.

cheind avatar Dec 07 '22 04:12 cheind