iree icon indicating copy to clipboard operation
iree copied to clipboard

Published 20 hours ago • verified publisher icon iree-org

Add RISC-V models to e2e integration testing

Open dcaballe opened this issue 2 years ago • 2 comments

Request description

The benchmarking infrastructure will track the following models:

  • MobileNetV1-float
  • MobileBert-float
  • DeepLabV3-float
  • EfficientNet-Lite0-quant
  • MobileBert-quant
  • PersonDetect-quant

We should add all these models to our e2e integration testing for RISC-V to check the correctness of these models. MobileNet, MobileBert, DeepLab and EfficientNet should be compiled and run for rv64.

I recommend that we add and disable MobileBert models for now since they may take quite some time to run on the simulator. Their performance should improve in the following weeks/months.

What component(s) does this issue relate to?

Compiler

Additional context

No response

dcaballe avatar Jul 18 '22 20:07 dcaballe

We can add the run test to see they don't crash. However, the numerical value check may not be feasible until https://github.com/iree-org/iree/issues/9796 is addressed.

hcindyl avatar Jul 18 '22 21:07 hcindyl

Hey Cindy, just checking on this task. Would you have time to look at it in the upcoming weeks?

dcaballe avatar Sep 02 '22 06:09 dcaballe