Results 19 issues of Donghak PARK

When Export ```NNTrainer``` to ```Tensorflow Lite``` we need to reordering --> Implement based on #1892 - [x] Implement Flatten Reordering - [x] Test various FC Case - [x] Make Unit...

Can this application be built along with gbs and/or pdebuild so that "nntrainer-example-alexnet.rpm/deb" can be published ? If that's possible, you can generate an automated memory & latency test easily:...

This PR for TFlite export Transpose FullyConnected Layer's weights (NCHW --> NHWC) in shape 1:3:2:4 & FC with unit 1 Before reordering 0 1 2 3 4 5 6 7...

PR/READY2GO

Fix the typo errors in bellow dir - Applications/ - nntrainer/optimizers/ Signed-off-by: DonghakPark

- Add try, catch statement to catch exception - Add NNTR_THROW_IF to check return Signed-off-by: DonghakPark

when ```supportInPlace``` is ```true``` Flatten Layer make nullptr Error and some other layers also make similar error

This layer is necessary to support various applications such as SV. - Depthwise convolution is a type of convolution in which each input channel is convolved with a different kernel...

This PR is to update the mixed precision layer. - integrate #2568 & #2455 - will update more test **Self evaluation:** 1. Build test: [X]Passed [ ]Failed [ ]Skipped 2....

Need Review

Add Mixed Precision example on Application - this example can guide developer to handle fp16 example - we can test & eval our model end-to-end - we can optimize base...

DO NOT MERGE
PR/READY2MERGE

One of the ways to accelerate running the NNTrainer in inference mode is to fuse operations. We are currently using this fusion when exporting to TensorFlow Lite. By applying it...

enhancement