nntrainer
nntrainer copied to clipboard
nnstreamer
Support mixed precision training @open sesame 03/08 07:57
It adds loss scale factor for removing invalid data while training. The factor is dynamically calculated while gradient clipping step, And it initially disabled until loss scale proeprty is set. fc/pooling/conv2d/softmax layers are modified for loss scale and mixed tensor type.
Signed-off-by: Jiho Chu [email protected]
:memo: TAOS-CI Version: 1.5.20200925. Thank you for submitting PR #2455. Please a submit 1commit/1PR (one commit per one PR) policy to get comments quickly from reviewers. Your PR must pass all verificiation processes of cibot before starting a review process from reviewers. If you are new member to join this project, please read manuals in documentation folder and wiki page. In order to monitor a progress status of your PR in more detail, visit http://ci.nnstreamer.ai/.
:octocat: cibot: @jihochu, nntrainer/layers/pooling2d_layer.cpp does not include Doxygen tags such as @file @brief @author @bug. You must include the Doxygen tags in the source code. Please refer to a Doxygen manual at http://github.com/nnstreamer/TAOS-CI/blob/main/ci/doc/doxygen-documentation.md
:octocat: cibot: @jihochu, A builder checker could not be completed because one of the checkers is not completed. In order to find out a reason, please go to http://ci.nnstreamer.ai/nntrainer/ci/repo-workers/pr-checker/2455-202402021547410.65952706336975-af2e8829e8e0ac70333370e438e9b7b37bc604f2/.
:octocat: cibot: @jihochu, nntrainer/layers/pooling2d_layer.cpp does not include Doxygen tags such as @file @brief @author @bug. You must include the Doxygen tags in the source code. Please refer to a Doxygen manual at http://github.com/nnstreamer/TAOS-CI/blob/main/ci/doc/doxygen-documentation.md
:octocat: cibot: @jihochu, A builder checker could not be completed because one of the checkers is not completed. In order to find out a reason, please go to http://ci.nnstreamer.ai/nntrainer/ci/repo-workers/pr-checker/2455-202402021637130.47981810569763-5ce56ff64b70e29561125de65169bff8ee06a41d/.
:octocat: cibot: @jihochu, nntrainer/layers/pooling2d_layer.cpp does not include Doxygen tags such as @file @brief @author @bug. You must include the Doxygen tags in the source code. Please refer to a Doxygen manual at http://github.com/nnstreamer/TAOS-CI/blob/main/ci/doc/doxygen-documentation.md
:octocat: cibot: @jihochu, nntrainer/layers/pooling2d_layer.cpp does not include Doxygen tags such as @file @brief @author @bug. You must include the Doxygen tags in the source code. Please refer to a Doxygen manual at http://github.com/nnstreamer/TAOS-CI/blob/main/ci/doc/doxygen-documentation.md
:octocat: cibot: @jihochu, nntrainer/layers/pooling2d_layer.cpp does not include Doxygen tags such as @file @brief @author @bug. You must include the Doxygen tags in the source code. Please refer to a Doxygen manual at http://github.com/nnstreamer/TAOS-CI/blob/main/ci/doc/doxygen-documentation.md
:octocat: cibot: @jihochu, A builder checker could not be completed because one of the checkers is not completed. In order to find out a reason, please go to http://ci.nnstreamer.ai/nntrainer/ci/repo-workers/pr-checker/2455-202402021651530.78149199485779-49a1f68583e1320967a59ee591050fead566528b/.
:octocat: cibot: @jihochu, A builder checker could not be completed because one of the checkers is not completed. In order to find out a reason, please go to http://ci.nnstreamer.ai/nntrainer/ci/repo-workers/pr-checker/2455-202402051749140.35963010787964-9a6a8b8869043cf1202f0271050f078eaffd0bb1/.
nntrainer/graph/network_graph.cpp:16:10 [clang-diagnostic-error]: nntrainer/graph/network_graph.cpp#L16 'node_exporter.h' file not found
@DonghakPark , please check cpp-linter 's behavior. It's not differ from clang which we are using with TAOS.
:octocat: cibot: @jihochu, A builder checker could not be completed because one of the checkers is not completed. In order to find out a reason, please go to http://ci.nnstreamer.ai/nntrainer/ci/repo-workers/pr-checker/2455-202402051915550.65697598457336-1808a25f14ff73a075672e238c68fba47628b0d5/.
:octocat: cibot: @jihochu, A builder checker could not be completed because one of the checkers is not completed. In order to find out a reason, please go to http://ci.nnstreamer.ai/nntrainer/ci/repo-workers/pr-checker/2455-202402211942000.81381893157959-8bef9767f9c6e4f8f9b527dead45e726d79dc0ff/.
:octocat: cibot: @jihochu, A builder checker could not be completed because one of the checkers is not completed. In order to find out a reason, please go to http://ci.nnstreamer.ai/nntrainer/ci/repo-workers/pr-checker/2455-202403061129400.95467805862427-20dce009fbaeb77274c3554dbad9eb6eb1978760/.
:octocat: cibot: @jihochu, A builder checker could not be completed because one of the checkers is not completed. In order to find out a reason, please go to http://ci.nnstreamer.ai/nntrainer/ci/repo-workers/pr-checker/2455-202403071044020.67149591445923-20dce009fbaeb77274c3554dbad9eb6eb1978760/.
:octocat: cibot: @jihochu, A builder checker could not be completed because one of the checkers is not completed. In order to find out a reason, please go to http://ci.nnstreamer.ai/nntrainer/ci/repo-workers/pr-checker/2455-202403071447080.89027905464172-4ecb30625452a8255d2e33c6b3a05bcd08a06a91/.
:octocat: cibot: @jihochu, A builder checker could not be completed because one of the checkers is not completed. In order to find out a reason, please go to http://ci.nnstreamer.ai/nntrainer/ci/repo-workers/pr-checker/2455-202403071623090.89234495162964-1deeb9006fbefc4f06eae760db05748c77ec950d/.
:octocat: cibot: @jihochu, A builder checker could not be completed because one of the checkers is not completed. In order to find out a reason, please go to http://ci.nnstreamer.ai/nntrainer/ci/repo-workers/pr-checker/2455-202403072022220.71787905693054-77938debc6ec6172fc9c6aec9732296383713139/.
:octocat: cibot: @jihochu, nntrainer/layers/loss/mse_loss_layer.cpp does not include Doxygen tags such as @file @brief @author @bug. You must include the Doxygen tags in the source code. Please refer to a Doxygen manual at http://github.com/nnstreamer/TAOS-CI/blob/main/ci/doc/doxygen-documentation.md
:octocat: cibot: @jihochu, A builder checker could not be completed because one of the checkers is not completed. In order to find out a reason, please go to http://ci.nnstreamer.ai/nntrainer/ci/repo-workers/pr-checker/2455-202403142037380.54928088188171-71442748e229fdcec4893d6822845545c7f0cccb/.
:octocat: cibot: @jihochu, nntrainer/layers/loss/mse_loss_layer.cpp does not include Doxygen tags such as @file @brief @author @bug. You must include the Doxygen tags in the source code. Please refer to a Doxygen manual at http://github.com/nnstreamer/TAOS-CI/blob/main/ci/doc/doxygen-documentation.md
:octocat: cibot: @jihochu, nntrainer/layers/loss/mse_loss_layer.cpp does not include Doxygen tags such as @file @brief @author @bug. You must include the Doxygen tags in the source code. Please refer to a Doxygen manual at http://github.com/nnstreamer/TAOS-CI/blob/main/ci/doc/doxygen-documentation.md
:octocat: cibot: @jihochu, nntrainer/layers/loss/mse_loss_layer.cpp does not include Doxygen tags such as @file @brief @author @bug. You must include the Doxygen tags in the source code. Please refer to a Doxygen manual at http://github.com/nnstreamer/TAOS-CI/blob/main/ci/doc/doxygen-documentation.md
Recommentation:
Keep a PR with every related commits as a test basis and mark it "Do Not Merge" or "Draft PR" Make a number of independent smaller PRs ("sub-PR of this PR") so that reviewers can actually read and understand, removing them from the "full PR", whenever they are merged. It is recommended to start with PRs with common data structures and interfaces without implementation.
