PandaGPT icon indicating copy to clipboard operation
PandaGPT copied to clipboard

Published 20 hours ago • verified publisher icon yxuansu

About model size

Open David-Zeng-Zijian opened this issue 1 year ago • 1 comments

Excellent work! I just wonder if there is any way to load the model in more than one GPU because even the 7B model consumes more than 20G memory, which is larger than memory of one GPU.

David-Zeng-Zijian avatar Jun 09 '23 07:06 David-Zeng-Zijian