Old models with small context windows get into a compaction doom loop

Open DOsinga opened this issue 2 months ago • 2 comments

try claude-3-opus-20240229

Oct 18 '25 16:10 DOsinga

yeah, so the problem is that we immediately run out of context and then just keep compacting. this model has a context limit of 4K and our minimum message size is 8k

supporting a 4k model is crazy, but 8k, we should be able to do I would think

Nov 05 '25 02:11 DOsinga

so really what we need to do here is block models that have a context window that is too small

Nov 05 '25 03:11 DOsinga