inference icon indicating copy to clipboard operation
inference copied to clipboard

Offline scenario inferred from SingleStream gives incorrect power efficiency

Open sahelib25 opened this issue 2 years ago • 1 comments

For <sut1>, resnet50 Offline was inferred from SingleStream scenario, the results generated by submission_checker.py are shown below. The power efficiency calculated is power_efficiency (inf/J) = 3448436.324053, which is indeed a nonsensical figure.

INFO    Results closed/<submitter>/results/<sut1>/resnet50/multistream 378.649068 with power_metric = 5218.764205 and power_efficiency (inf/J) = 1.532930
INFO    Results closed/<submitter>/results/<sut1>/resnet50/offline 21.008400 with power_metric = 13.767718 and power_efficiency (inf/J) = 3448436.324053
INFO    Results closed/<submitter>/results/<sut1>/resnet50/singlestream 47.686353 with power_metric = 655.611514 and power_efficiency (inf/J) = 1.525294

INFO    Results open/<submitter>/results/<sut2>/resnet50/multistream 2.292281 with power_metric = 47.788945 and power_efficiency (inf/J) = 167.402734
INFO    Results open/<submitter>/results/<sut2>/resnet50/offline 6580.530000 with power_metric = 25.936246 and power_efficiency (inf/J) = 253.030061
INFO    Results open/<submitter>/results/<sut2>/resnet50/singlestream 0.647587 with power_metric = 13.885169 and power_efficiency (inf/J) = 72.019287

sahelib25 avatar Sep 18 '23 12:09 sahelib25

Thank you @sahelib25 for reporting this issue. This PR should fix it.

arjunsuresh avatar Sep 19 '23 13:09 arjunsuresh