hive
hive copied to clipboard
HIVE-26495 : MSCK repair perf issue HMSChecker ThreadPool threads are blocked at fs.listStatus
What changes were proposed in this pull request? change fs.listStatus to fs.listStatusIterator for non-blocking execution
Why are the changes needed? MSCK repair is taking long time to validate multi-level partitionFolders in s3
Does this PR introduce any user-facing change? No
How was this patch tested? TestHiveMetaStoreChecker testCode covers the code changes