请问部署推理，最小的GPU显存需要多大呢？以及内存需要多大？[Question]

[ArlanCooper]

Required prerequisites

• [X] I have read the documentation https://github.com/baichuan-inc/baichuan-7B/blob/HEAD/README.md.
• [X] I have searched the Issue Tracker and Discussions that this hasn't already been reported. (+1 or comment there if it has.)
• [X] Consider asking first in a Discussion.

Questions

请问部署推理，最小的GPU显存需要多大呢？以及内存需要多大？ int8量化后最小显存需要多少呢？int4量化之后需要的最小显存是多少呢？

Checklist

• [X] I have provided all relevant and necessary information above.
• [X] I have chosen a suitable title for this issue.

[lovegit2021]

it is about 10G GPU Memory, and I had traind it in V100 for one epoch using five days.