gemma icon indicating copy to clipboard operation
gemma copied to clipboard
verified publisher icon google-deepmind

Added resize_cache for resizing cache

Open bhakarboy01 opened this issue 9 months ago • 2 comments

created function resize_cache for resizing cache_length When reaching the full cache length, it would allow to still run more prompts without having to restart from scratch

bhakarboy01 avatar Mar 13 '25 23:03 bhakarboy01

Fixed Issue #156: Dynamic cache Writing

bhakarboy01 avatar Mar 13 '25 23:03 bhakarboy01

@Conchylicultor please review my PR.

bhakarboy01 avatar Mar 13 '25 23:03 bhakarboy01