Allow limiting shard cache size

[javitonino]

Description

Describe the proposed changes made in this PR.

How was this PR tested?

Describe how you tested this PR.

[codecov[bot]]

Codecov Report

All modified and coverable lines are covered by tests :white_check_mark:

Project coverage is 83.91%. Comparing base (71f8abc) to head (f6164bb).

Additional details and impacted files

@@           Coverage Diff           @@
##             main    #2040   +/-   ##
=======================================
  Coverage   83.91%   83.91%           
=======================================
  Files         326      326           
  Lines       17677    17677           
=======================================
  Hits        14834    14834           
  Misses       2843     2843           

Flag	Coverage Δ
ingest	68.57% <ø> (ø)
node-sidecar	95.84% <ø> (ø)
sdk	87.85% <ø> (ø)
utils	81.68% <ø> (ø)

Flags with carried forward coverage won't be shown. Click here to find out more.

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.