neural-compressor icon indicating copy to clipboard operation
neural-compressor copied to clipboard

Published 20 hours ago • verified publisher icon intel

Resnet Onnx example breaks with Windows11 WSL2

Open R4ZZ3 opened this issue 3 years ago • 3 comments

Hi,

Is it possible to run this with WSL2? The ONNX Resnet example breaks with Windows11 WSL2

image

R4ZZ3 avatar Oct 27 '22 20:10 R4ZZ3

Hi, thanks for raising the issue. We test with Win10 + WSL1 + onnx rn50 and it works. Which INC version did you test for?

chensuyue avatar Oct 28 '22 04:10 chensuyue

1.14.1 I also tried the non-custom examples and it also ran into error.

image wsl version image

Using Ubuntu 20.04LTS as my WSL2 distro image

R4ZZ3 avatar Oct 30 '22 11:10 R4ZZ3

Hi, we reproduced your issue on windows, debug in progress.

chensuyue avatar Dec 08 '22 01:12 chensuyue

Hi, sorry for the late reply.
While running quantization with inc_bench, the diagnosis option will be default set as true. image So the tool will do diagnosis after tuning, it's going to dump a lot of information of data distribution which is quite memory consuming.
During our debugging on PC, it usually failed after dump 1/3 node info of ssd resnet50, we think it's due to out of memory. image

Solutions:

  1. If you want to use inc_bench, please use a server with large memory.
    And we will also try to optimize this large data handling issue. Or may be give an option to close the diagnosis function.
  2. If you would like to run examples with cmd, it will work. Because you can customized the yaml, you can run the example without diagnosis function.

chensuyue avatar Dec 27 '22 08:12 chensuyue

Thanks @chensuyue for your continued efforts on this. I will try this again once I have time.

R4ZZ3 avatar Dec 27 '22 09:12 R4ZZ3