open-reid icon indicating copy to clipboard operation
open-reid copied to clipboard

Published 20 hours ago • verified publisher icon Cysu

About Evaluation

Open wang5566 opened this issue 6 years ago • 4 comments

I find there are three benchmarks including 'cmc all shots', 'cmc cuhk03', 'cmc market1501'. I want to know what meaning do they represent seperately ? Does cmc cuhk03 mean single-shot and cmc market1501 mean multi-shot? Lastly, I know the new split method for cuhk03 training set in https://github.com/zhunzhong07/person-re-ranking#the-new-trainingtesting-protocol-for-cuhk03 and your open-reid does not use it. And the performance seems quite different in baseline method? Any reply will be appreciated. Thank you.

wang5566 avatar Mar 02 '18 08:03 wang5566

Does this section on our website help?

Cysu avatar Mar 11 '18 17:03 Cysu

Yes, but what is "all shot "meaning？

wang5566 avatar Mar 16 '18 02:03 wang5566

Hi @Cysu and @wang5566,

I also have the same question: what exactly is the meaning of "allshots"?

I checked the documentation website but could not find an explanation. I also looked a bit into the code without going deeper, but still I have no answer. Any answer will be appreciated, and also thanks for the repo.

ercanburak avatar May 01 '18 08:05 ercanburak

Hi @ercanburak @wang5566 Did you ever get this question answered?

RaviShivam avatar Oct 08 '19 11:10 RaviShivam