nntrainer icon indicating copy to clipboard operation
nntrainer copied to clipboard

(Wait for #2199) [TENSOR] Initial implement for temp pool

Open jihochu opened this issue 1 year ago • 10 comments

temp pool is for temporal tensor which is used for checkpoint mechanism. It reduces peak memory consumption while training, it only store checkpointed activation for the backward phase. unchecked activations will be recalculated using checkpointed values.

Signed-off-by: Jiho Chu [email protected]

jihochu avatar Apr 27 '23 02:04 jihochu