ONE icon indicating copy to clipboard operation
ONE copied to clipboard

Batch Execution by passing implicit shapeinference of Bulk op

Open chunseoklee opened this issue 2 years ago • 3 comments

chunseoklee avatar Sep 01 '22 04:09 chunseoklee

cc @ragmani

chunseoklee avatar Sep 01 '22 04:09 chunseoklee

On 12c46f85e12b4f8b91a42c10b5a8d50893a69c89,

tv@tv ~/chunseoklee> sdb2 shell BACKENDS=trix /usr/bin/nnfw-test/Product/out/bin/nnpackage_run /opt/trix_batch/iv3 -r 1  --shape_prepare="[0,[1,299,299,3]]"
Package Filename /opt/trix_batch/iv3
===================================
MODEL_LOAD   takes 7.007 ms
PREPARE      takes 854.449 ms
EXECUTE      takes 31.251 ms
- MEAN     :  31.251 ms
- MAX      :  31.251 ms
- MIN      :  31.251 ms
- GEOMEAN  :  31.251 ms
===================================
]0;fish  /home/tv/chunseoklee⏎                                                                                                                                                                                     tv@tv ~/chunseoklee> sdb2 shell BACKENDS=trix /usr/bin/nnfw-test/Product/out/bin/nnpackage_run /opt/trix_batch/iv3 -r 1  --shape_prepare="[0,[3,299,299,3]]"
Package Filename /opt/trix_batch/iv3
===================================
MODEL_LOAD   takes 1.019 ms
PREPARE      takes 328.258 ms
EXECUTE      takes 50.923 ms
- MEAN     :  50.923 ms
- MAX      :  50.923 ms
- MIN      :  50.923 ms
- GEOMEAN  :  50.923 ms
===================================
]0;fish  /home/tv/chunseoklee⏎                                                                                                                                                                                     tv@tv ~/chunseoklee> sdb2 shell BACKENDS=trix /usr/bin/nnfw-test/Product/out/bin/nnpackage_run /opt/trix_batch/iv3 -r 1  --shape_prepare="[0,[4,299,299,3]]"
Package Filename /opt/trix_batch/iv3
===================================
MODEL_LOAD   takes 0.982 ms
PREPARE      takes 320.884 ms
EXECUTE      takes 52.466 ms
- MEAN     :  52.466 ms
- MAX      :  52.466 ms
- MIN      :  52.466 ms
- GEOMEAN  :  52.466 ms
==================================

chunseoklee avatar Sep 02 '22 11:09 chunseoklee

Coverity and Svace PASSED on https://github.com/Samsung/ONE/commit/12c46f85e12b4f8b91a42c10b5a8d50893a69c89

chunseoklee avatar Sep 03 '22 06:09 chunseoklee

Now Bulk op's batch is supporting.

hseok-oh avatar Dec 09 '22 03:12 hseok-oh