inference
inference copied to clipboard
Offline scenario inferred from SingleStream gives incorrect power efficiency
For <sut1>, resnet50 Offline was inferred from SingleStream scenario, the results generated by submission_checker.py are shown below. The power efficiency calculated is power_efficiency (inf/J) = 3448436.324053, which is indeed a nonsensical figure.
INFO Results closed/<submitter>/results/<sut1>/resnet50/multistream 378.649068 with power_metric = 5218.764205 and power_efficiency (inf/J) = 1.532930
INFO Results closed/<submitter>/results/<sut1>/resnet50/offline 21.008400 with power_metric = 13.767718 and power_efficiency (inf/J) = 3448436.324053
INFO Results closed/<submitter>/results/<sut1>/resnet50/singlestream 47.686353 with power_metric = 655.611514 and power_efficiency (inf/J) = 1.525294
INFO Results open/<submitter>/results/<sut2>/resnet50/multistream 2.292281 with power_metric = 47.788945 and power_efficiency (inf/J) = 167.402734
INFO Results open/<submitter>/results/<sut2>/resnet50/offline 6580.530000 with power_metric = 25.936246 and power_efficiency (inf/J) = 253.030061
INFO Results open/<submitter>/results/<sut2>/resnet50/singlestream 0.647587 with power_metric = 13.885169 and power_efficiency (inf/J) = 72.019287
Thank you @sahelib25 for reporting this issue. This PR should fix it.