Steve Loughran

When `mapreduce.manifest.committer.validate.output` I am going to add pre-rename validation phase we scan the task attempt to directory tree to make sure everything is there and with the expected etag. This...

testing on an overloaded azure store; hit sime timeouts and an assertion failure in `org.apache.hadoop.fs.azurebfs.ITestAbfsClient.testListPathWithValueGreaterThanServerMaximum(ITestAbfsClient.java`; created a new JIRA there as it looks like an assertion tuning only.

Latest PR adds op-specific capacity multiplication to abfs store; numbers are pretty arbitrary as this is only used in the committer. could be tuned in future.

I am having fun testing at scale with a throttled store. ``` [ERROR] testSeekZeroByteFile(org.apache.hadoop.fs.azurebfs.contract.ITestAbfsFileSystemContractSeek) Time elapsed: 0.339 s

checkstyle failures, we all get those. and sometimes we have to say "better if broken" ``` ./hadoop-tools/hadoop-aws/src/main/java/org/apache/hadoop/fs/s3a/api/RequestFactory.java:256: /**: First sentence should end with a period. [JavadocStyle] ./hadoop-tools/hadoop-aws/src/main/java/org/apache/hadoop/fs/s3a/impl/RequestFactoryImpl.java:617: .optionalObjectAttributes(OptionalObjectAttributes.RESTORE_STATUS) // Optional...

@bpahuja can you not do rebase and force push unless some other change has broken the merge? breaks the "changes since your last review" feature. If someone has stepped on...

@bpahuja have you tested this with any of: s3 express, third party stores, gcs? Just want to make sure things work and the tests are skipped? I'll inevitably do the...

I'm doing nothing but helping it get Hadoop 3.4.0 out the door this week. No code of my except related to packaging; no reviews of other people except related to...

I am catching up now, as warned giving priority to people who helped validate the RC. the core project is a community project, and everyone gets to participate

@bpahuja can you address the review comments? Otherwise I'm going to forget about it. Get it done now and we can target 3.4.1