ck icon indicating copy to clipboard operation
ck copied to clipboard

[CK legacy] MLperf-automation on the Pi 4, Object Detection example

Open ghost opened this issue 3 years ago • 2 comments

I followed the instructions https://github.com/mlcommons/ck/blob/master/docs/mlperf-automation/reproduce/ck-object-detection-rpi4-tflite.md for Raspian OS Pi 4 and I came across these errors.

One was when installing ck install package --tags=lib,mlperf,loadgen,static it produced an error on the logging.h file. What I did was the delete the lines 713-732 (for loop).

Next, when running the performance benchmark it fails to create the Accuracy.json and doesn't catch the error. It works fine though outputting the latencies until that point.

Moreover, the GCC 8.x version worked fine for me.

ghost avatar Dec 06 '21 14:12 ghost

Thank you for your report @ghost!

I am afraid your issue is still related to using GCC 8.x. I remember that I struggled a lot trying to make MLPerf work with GCC 8 on RPi4 and failed. Eventually, it worked with GCC 9+ after some magic.

Can you please try to run above commands with GCC 9+, please? If it will fail with GCC 9+, then maybe there is a new issue that we need to investigate ...

Thanks!

gfursin avatar Dec 20 '21 14:12 gfursin

By the way, please, don't forget to provide all related logs with your issues. Thanks!!!

gfursin avatar Dec 20 '21 14:12 gfursin

We will continue reproducing MLPerf results in the reproducibility project.

gfursin avatar Sep 30 '22 12:09 gfursin