starcoder icon indicating copy to clipboard operation
starcoder copied to clipboard

Published 20 hours ago • verified publisher icon bigcode-project

Hardware requirement for deployment of starchat-beta

Open avadhut123pisal opened this issue 2 years ago • 0 comments
trafficstars

We tried running starchat-beta on EC2 (p3.8xlarge) [vCPU: 32, Memory: 244GB). But, the response time is high. (~3-5 minutes). Is there any documentation available regarding the resource requirement ?

avadhut123pisal avatar Jun 25 '23 07:06 avadhut123pisal