aimet icon indicating copy to clipboard operation
aimet copied to clipboard

Published 20 hours ago • verified publisher icon quic

QNN Error with GroupNorm

Open escorciav opened this issue 1 year ago • 2 comments

Hi, I was wondering how are you guys dealing with GroupNorm. I discovered the following weird situation in S8G2 DSP (HTP, chipset: SM8550).

GroupNorm(groups=32) 1, 64, 512, 512 1, 64, 256, 256 1, 64, 128, 128 1, 64, 64, 64
msec 1528.3 371.1 error 0.794

The test used QNN 2.16.

Do you know how can I report that bug to the QNN team?

Thanks!

escorciav avatar Jan 25 '24 16:01 escorciav

Tagging @quic-akinlawo @quic-mangal here.

quic-hitameht avatar Jan 29 '24 04:01 quic-hitameht

It may sound odd, but what can I do it's what it's, i.e., hardware & on-device stuff aka too many moving wheels

I can't replicate the error for input 1,64,128,128. The model using such op compile & latency performance is shown in the screenshot below. First column is msec & second the version of QNN image

Details (for record)

  • I cannot rplicate the QNN compilation error anymore
  • I tried different versions of QNN & onnx opset version.
  • It's possible that the version of onnx & PyTorch itself plays a role. I wasted some time testing things out. But, decided to move on & enjoy the good news.

escorciav avatar Feb 22 '24 14:02 escorciav