nntrainer icon indicating copy to clipboard operation
nntrainer copied to clipboard

Add memory swap @open sesame 7/26 15:55

Open jihochu opened this issue 1 year ago • 17 comments

Initial implementaion of cache pool. It inherites from memory pool to utilize optimized memory information. And, swap device class is introduce. It operates with cache memory and keeps data permantly in the device. The storage size is fixed when the device opens, sparse file is created with garbage data. And, it's removed when the device close,

Signed-off-by: Jiho Chu [email protected]

Issue: #1966

Self evaluation:

  1. Build test: [X]Passed [ ]Failed [ ]Skipped
  2. Run test: [X]Passed [ ]Failed [ ]Skipped

jihochu avatar Jul 19 '22 12:07 jihochu

:memo: TAOS-CI Version: 1.5.20200925. Thank you for submitting PR #1965. Please a submit 1commit/1PR (one commit per one PR) policy to get comments quickly from reviewers. Your PR must pass all verificiation processes of cibot before starting a review process from reviewers. If you are new member to join this project, please read manuals in documentation folder and wiki page. In order to monitor a progress status of your PR in more detail, visit http://ci.nnstreamer.ai/.

taos-ci avatar Jul 19 '22 12:07 taos-ci

:octocat: cibot: @jihochu, A builder checker could not be completed because one of the checkers is not completed. In order to find out a reason, please go to http://ci.nnstreamer.ai/nntrainer/ci/repo-workers/pr-checker/1965-202207192125160.92761492729187-b386e4b2f97ac4a112589d6245968d0cf35700f8/.

taos-ci avatar Jul 19 '22 13:07 taos-ci

:octocat: cibot: @jihochu, A builder checker could not be completed because one of the checkers is not completed. In order to find out a reason, please go to http://ci.nnstreamer.ai/nntrainer/ci/repo-workers/pr-checker/1965-202207201120020.43601894378662-b4ea4e84217e4bbf431711e0d1a2b273980f92ad/.

taos-ci avatar Jul 20 '22 02:07 taos-ci

:octocat: cibot: @jihochu, A builder checker could not be completed because one of the checkers is not completed. In order to find out a reason, please go to http://ci.nnstreamer.ai/nntrainer/ci/repo-workers/pr-checker/1965-202207201719290.063426971435547-cf94acb476bf155644303a1af57d7b8c228e813d/.

taos-ci avatar Jul 20 '22 08:07 taos-ci

:octocat: cibot: @jihochu, A builder checker could not be completed because one of the checkers is not completed. In order to find out a reason, please go to http://ci.nnstreamer.ai/nntrainer/ci/repo-workers/pr-checker/1965-202207201803230.48751997947693-cf94acb476bf155644303a1af57d7b8c228e813d/.

taos-ci avatar Jul 20 '22 09:07 taos-ci

:octocat: cibot: @jihochu, A builder checker could not be completed because one of the checkers is not completed. In order to find out a reason, please go to http://ci.nnstreamer.ai/nntrainer/ci/repo-workers/pr-checker/1965-202207261555000.47095704078674-cf94acb476bf155644303a1af57d7b8c228e813d/.

taos-ci avatar Jul 26 '22 07:07 taos-ci

Please add cache_pool.cpp and swap_device.cpp at jni/Android.mk to resolve android ci issue

lhs8928 avatar Jul 26 '22 07:07 lhs8928

:octocat: cibot: @jihochu, A builder checker could not be completed because one of the checkers is not completed. In order to find out a reason, please go to http://ci.nnstreamer.ai/nntrainer/ci/repo-workers/pr-checker/1965-202208101152440.26695609092712-38f89adb6157e1030057989d36329091331ec8de/.

taos-ci avatar Aug 10 '22 03:08 taos-ci

:octocat: cibot: @jihochu, A builder checker could not be completed because one of the checkers is not completed. In order to find out a reason, please go to http://ci.nnstreamer.ai/nntrainer/ci/repo-workers/pr-checker/1965-202208171601300.87476491928101-c538bd60f22bce369b0ffce39de31f80b5e72189/.

taos-ci avatar Aug 17 '22 07:08 taos-ci

:octocat: cibot: @jihochu, test/unittest/unittest_nntrainer_profiler.cpp does not include Doxygen tags such as @file @brief @author @bug. You must include the Doxygen tags in the source code. Please refer to a Doxygen manual at http://github.com/nnstreamer/TAOS-CI/blob/main/ci/doc/doxygen-documentation.md

taos-ci avatar Aug 25 '22 05:08 taos-ci

It depends on #1987 . Please ignore build error before merging it.

jihochu avatar Aug 25 '22 06:08 jihochu

:octocat: cibot: @jihochu, A builder checker could not be completed because one of the checkers is not completed. In order to find out a reason, please go to http://ci.nnstreamer.ai/nntrainer/ci/repo-workers/pr-checker/1965-202208251456040.096474885940552-7e2aad1867e37a8704492116ca38d424e73ba0ae/.

taos-ci avatar Aug 25 '22 06:08 taos-ci

:octocat: cibot: @jihochu, test/unittest/unittest_nntrainer_profiler.cpp does not include Doxygen tags such as @file @brief @author @bug. You must include the Doxygen tags in the source code. Please refer to a Doxygen manual at http://github.com/nnstreamer/TAOS-CI/blob/main/ci/doc/doxygen-documentation.md

taos-ci avatar Aug 25 '22 07:08 taos-ci

:octocat: cibot: @jihochu, A builder checker could not be completed because one of the checkers is not completed. In order to find out a reason, please go to http://ci.nnstreamer.ai/nntrainer/ci/repo-workers/pr-checker/1965-202208251625240.39439702033997-39a29d3b03bfde8f5f606b223bd8aeb742feb691/.

taos-ci avatar Aug 25 '22 07:08 taos-ci

:octocat: cibot: @jihochu, test/unittest/unittest_nntrainer_profiler.cpp does not include Doxygen tags such as @file @brief @author @bug. You must include the Doxygen tags in the source code. Please refer to a Doxygen manual at http://github.com/nnstreamer/TAOS-CI/blob/main/ci/doc/doxygen-documentation.md

taos-ci avatar Aug 25 '22 07:08 taos-ci

:octocat: cibot: @jihochu, test/unittest/unittest_nntrainer_profiler.cpp does not include Doxygen tags such as @file @brief @author @bug. You must include the Doxygen tags in the source code. Please refer to a Doxygen manual at http://github.com/nnstreamer/TAOS-CI/blob/main/ci/doc/doxygen-documentation.md

taos-ci avatar Aug 25 '22 07:08 taos-ci

:octocat: cibot: @jihochu, A builder checker could not be completed because one of the checkers is not completed. In order to find out a reason, please go to http://ci.nnstreamer.ai/nntrainer/ci/repo-workers/pr-checker/1965-202208251714590.60714101791382-2c739b9c351f9c5b77776771783f246a9da683e7/.

taos-ci avatar Aug 25 '22 08:08 taos-ci

Added "RELEASE CRITICAL": As long as this is an experimental feature that is turned off by default and can be turned on with users' explicit configuration, this is not going to affect the behaviors.

For further testing and verification, let's merge this as long as it does not affect the behaviors with the default configuration.

myungjoo avatar Sep 23 '22 06:09 myungjoo

@jijoongmoon Memory leak problem is resolved. (verified with vgg16 4 batch)

jihochu avatar Sep 26 '22 09:09 jihochu

:octocat: cibot: @jihochu, A builder checker could not be completed because one of the checkers is not completed. In order to find out a reason, please go to http://ci.nnstreamer.ai/nntrainer/ci/repo-workers/pr-checker/1965-202210061349420.022874116897583-597e51058bfe582d4e4529b66d974cc244584cb1/.

taos-ci avatar Oct 06 '22 05:10 taos-ci