tensornets icon indicating copy to clipboard operation
tensornets copied to clipboard

Notes for the updates of the performance table

Open taehoonlee opened this issue 4 years ago • 0 comments

Recently, I have updated the performance table to follow the recent report format. I reviewed 10 recent papers as follows, and found that error rates and 10-crop testing are no longer used for evaluation after about 2017.

measure 10-crop
ResNeXt (CVPR 2017) err O
DenseNet (CVPR 2017) err O
PolyNet (CVPR 2017) err O
DPN (NIPS 2017) err -
SENet (CVPR 2018) err -
MobileNetV2 (CVPR 2018) acc -
NASNet (CVPR 2018) acc -
PNASNet (ECCV 2018) acc -
AmoebaNet (AAAI 2019) acc -
EfficientNet (ICML 2019) acc -

For the above reason, the recent commit replaces the top-k error rates with accuracies and removes the 10-5 column (the top-5 score with 10 crops).

taehoonlee avatar Nov 12 '19 09:11 taehoonlee