models icon indicating copy to clipboard operation
models copied to clipboard

Want to get preprocess details & accuracy of some models

Open mengniwang95 opened this issue 3 years ago • 3 comments

I found there are some models lack data preprocess details and even accuracy info, such as https://github.com/onnx/models/tree/master/vision/classification/inception_and_googlenet/inception_v2 Where can I get these details to reproduce results?

mengniwang95 avatar Sep 26 '21 07:09 mengniwang95

I found there are about 11 models without accuracy or preprocess details in cv category. For those models without preprocess details, if I use some typical preprocess but get different accuracy, is it acceptable? For those models without accuracy, I can't confirm whether my results are correct, is it acceptable? @wenbingl

mengniwang95 avatar Oct 14 '21 11:10 mengniwang95

When the preprocessing of the inception model is the same as resnet, the inference result is wrong inception v1: image resnresnet18-v1: image

how to solve?

wangxudong-cq avatar Apr 19 '22 10:04 wangxudong-cq

update model list which misses preprocess/postprocess details: https://github.com/onnx/models/tree/main/vision/classification/rcnn_ilsvrc13 https://github.com/onnx/models/tree/main/vision/classification/inception_and_googlenet/inception_v2 https://github.com/onnx/models/tree/main/vision/object_detection_segmentation/tiny-yolov2 https://github.com/onnx/models/tree/main/vision/object_detection_segmentation/yolov2-coco https://github.com/onnx/models/tree/main/vision/body_analysis/ultraface https://github.com/onnx/models/tree/main/text/machine_comprehension/gpt-2

mengniwang95 avatar Sep 28 '22 05:09 mengniwang95