ozone icon indicating copy to clipboard operation
ozone copied to clipboard

HDDS-11403. PartialTableCache optimize for cleanup

Open sumitagrawl opened this issue 5 months ago • 0 comments

What changes were proposed in this pull request?

PartialTableCache optimize for cleanup involves,

  • cleanup all previous epoch with latest epoch (no need validation for epoch in sequence)
  • Timer based cleanup instead of triggering cleanup for every task (which may lead to add task in worker queue)

This optimization is done with similar approach HDDS-11201, where FullTableCache is handled (where faced memory issue).

Also fix,

  • When delay in cache cleanup, fileStatus returns cache entry, and OMKeyInfo is missing fileName. This is re-created when reading from DB while build, but missing when build via user input. This difference in behavior is fixed.
  • Also test case failing when delay in cache cleanup, as db updated directly but cache have old entry.

What is the link to the Apache JIRA

https://issues.apache.org/jira/browse/HDDS-11403

How was this patch tested?

  • UT case updated for impact
  • Running existing testcases for impact

sumitagrawl avatar Sep 02 '24 11:09 sumitagrawl