nntrainer icon indicating copy to clipboard operation
nntrainer copied to clipboard

Published 20 hours ago • verified publisher icon nnstreamer

[Wait for #2286] [SWAP] Implement inference mode

Open jihochu opened this issue 11 months ago • 11 comments

This patch is for inference mode for a swap device. It adds "memory_swap_mode" property, which can handle inference mode when using swap device. The weights are not modified while inferencing, therefore it doesn't need to swap out data to the device.

Signed-off-by: Jiho Chu [email protected]

jihochu avatar Aug 31 '23 10:08 jihochu