cog icon indicating copy to clipboard operation
cog copied to clipboard
verified publisher icon replicate

Make cog local runner match /tmp/shm size on Replicate

Open nelsonjchen opened this issue 1 year ago • 3 comments

Followup on https://github.com/replicate/cog/issues/1293#issuecomment-1952954820

nelsonjchen avatar Feb 19 '24 18:02 nelsonjchen

The limit on replicate should be min(50% system memory, 8GB). Which instance size did you check this with?

yorickvP avatar Feb 21 '24 16:02 yorickvP

Tesla T4

nelsonjchen avatar Feb 21 '24 16:02 nelsonjchen

https://gist.github.com/nelsonjchen/0beb9585c3928a1355207d25519fe662

nelsonjchen avatar Feb 21 '24 16:02 nelsonjchen

@yorickvP @technillogue Is 6GB the correct value to use here? Or is 8GB correct?

mattt avatar Jun 20 '24 12:06 mattt

@nelsonjchen Thanks for taking the time to open this PR. Sorry for not acting on it sooner. I'm merging this now and will cut a release with this change later this week.

mattt avatar Jun 25 '24 21:06 mattt