tflite-support icon indicating copy to clipboard operation
tflite-support copied to clipboard

Eliminate array copy in NormalizeOp

Open am15h opened this issue 4 years ago • 3 comments

am15h avatar Jul 01 '20 10:07 am15h

@googlebot rescan

xunkai55 avatar Jul 03 '20 06:07 xunkai55

Though it's not really "ready to pull", I'd assign this label to trigger an internal code sync, thus I can benchmark the change. Please stay tuned. Thanks!

xunkai55 avatar Jul 03 '20 07:07 xunkai55

Per benchmarking, the change has negative impact on performance of a followed Quantization Op in a typical image preprocessing pipeline:

Resize - Crop - Rotate - Normalize - Quantize

And performance of "Normalization" Op is not improved.

At the first glance, I suspect there's something with ByteBuffer.

Let's hold this for a while and I'll try spare some time investigating it.

xunkai55 avatar Jul 04 '20 07:07 xunkai55