ozone
ozone copied to clipboard
HDDS-11403. PartialTableCache optimize for cleanup
What changes were proposed in this pull request?
PartialTableCache optimize for cleanup involves,
- cleanup all previous epoch with latest epoch (no need validation for epoch in sequence)
- Timer based cleanup instead of triggering cleanup for every task (which may lead to add task in worker queue)
This optimization is done with similar approach HDDS-11201, where FullTableCache is handled (where faced memory issue).
Also fix,
- When delay in cache cleanup, fileStatus returns cache entry, and OMKeyInfo is missing fileName. This is re-created when reading from DB while build, but missing when build via user input. This difference in behavior is fixed.
- Also test case failing when delay in cache cleanup, as db updated directly but cache have old entry.
What is the link to the Apache JIRA
https://issues.apache.org/jira/browse/HDDS-11403
How was this patch tested?
- UT case updated for impact
- Running existing testcases for impact