How much memory is required for inference?

Open rkdckddnjs9 opened this issue 1 year ago • 3 comments

Thanks for yout excellent works !!

i just have one question. How much memory is required for inference?

Nov 21 '24 06:11 rkdckddnjs9

We use 32G V100. I did not try others.

Nov 21 '24 09:11 flymin

@jspark5638 Sorry I cannot remember the exact number but inference does not take much.

Nov 21 '24 10:11 flymin

This issue is stale because it has been open for 7 days with no activity. If you do not have any follow-ups, the issue will be closed soon.

Nov 28 '24 16:11 github-actions[bot]