garnet icon indicating copy to clipboard operation
garnet copied to clipboard

Too many list object values will cause checkpoint to fail

Open slqd3781 opened this issue 3 months ago • 1 comments

Describe the bug

{ "Port": 6379, "EnableAOF":true, "Recover": true, "PubSubPageSize":"16m", "AofSizeLimit": "1g", "CommitFrequencyMs": 10000 }

This is my configuration item. I have been inserting data into the LIST object, and when it reaches AofSizeLimit, the checkpoint gets stuck. Could you please confirm if there is a size limit for the LIST object?

Steps to reproduce the bug

1.0.89

Expected behavior

No response

Screenshots

No response

Release version

1.0.89

IDE

No response

OS version

No response

Additional context

No response

slqd3781 avatar Nov 19 '25 07:11 slqd3781

Yes, as mentioned in https://github.com/microsoft/garnet/issues/1432, there is a size limit of a single object. If AOF is enabled, an object cannot be larger than the configured AOF page size. When checkpointing or working with larger-than-memory, an object cannot be larger than 2GB. For objects larger than say 512MB or 1GB, you can split them up into multiple smaller key-value pairs of objects.

badrishc avatar Nov 20 '25 20:11 badrishc