gemma-2B-10M icon indicating copy to clipboard operation
gemma-2B-10M copied to clipboard

Published 20 hours ago • verified publisher icon mustafaaljadery

Can I limit the context window to say like 100k?

Open happy15 opened this issue 9 months ago • 0 comments

Hi, really exciting to see 10M context window. But I don't have 32G memory. Can I limit the context window to 100k to reduce the required memory to be fit in 16G? I don't want to crash and restart my laptop since so many work going on. Thanks.

happy15 avatar May 20 '24 09:05 happy15