ONE
ONE copied to clipboard
Batch Execution by passing implicit shapeinference of Bulk op
cc @ragmani
On 12c46f85e12b4f8b91a42c10b5a8d50893a69c89,
tv@tv ~/chunseoklee> sdb2 shell BACKENDS=trix /usr/bin/nnfw-test/Product/out/bin/nnpackage_run /opt/trix_batch/iv3 -r 1 --shape_prepare="[0,[1,299,299,3]]"
Package Filename /opt/trix_batch/iv3
===================================
MODEL_LOAD takes 7.007 ms
PREPARE takes 854.449 ms
EXECUTE takes 31.251 ms
- MEAN : 31.251 ms
- MAX : 31.251 ms
- MIN : 31.251 ms
- GEOMEAN : 31.251 ms
===================================
]0;fish /home/tv/chunseoklee⏎ tv@tv ~/chunseoklee> sdb2 shell BACKENDS=trix /usr/bin/nnfw-test/Product/out/bin/nnpackage_run /opt/trix_batch/iv3 -r 1 --shape_prepare="[0,[3,299,299,3]]"
Package Filename /opt/trix_batch/iv3
===================================
MODEL_LOAD takes 1.019 ms
PREPARE takes 328.258 ms
EXECUTE takes 50.923 ms
- MEAN : 50.923 ms
- MAX : 50.923 ms
- MIN : 50.923 ms
- GEOMEAN : 50.923 ms
===================================
]0;fish /home/tv/chunseoklee⏎ tv@tv ~/chunseoklee> sdb2 shell BACKENDS=trix /usr/bin/nnfw-test/Product/out/bin/nnpackage_run /opt/trix_batch/iv3 -r 1 --shape_prepare="[0,[4,299,299,3]]"
Package Filename /opt/trix_batch/iv3
===================================
MODEL_LOAD takes 0.982 ms
PREPARE takes 320.884 ms
EXECUTE takes 52.466 ms
- MEAN : 52.466 ms
- MAX : 52.466 ms
- MIN : 52.466 ms
- GEOMEAN : 52.466 ms
==================================
Coverity and Svace PASSED on https://github.com/Samsung/ONE/commit/12c46f85e12b4f8b91a42c10b5a8d50893a69c89
Now Bulk
op's batch is supporting.