Steve Loughran
Steve Loughran
Make sure you have checked _all_ steps below. ### Jira - [X] My PR addresses the following [Parquet Jira](https://issues.apache.org/jira/browse/PARQUET/) issues and references them in the PR title. For example, "PARQUET-1234:...
### Describe the bug The full details and analysis are in [HADOOP-19181. IAMCredentialsProvider throttle failures](https://issues.apache.org/jira/browse/HADOOP-19181) * the credentials retrieved by IAMCredentialsProvider are set to expire() only 1s before the expiry...
This is PoC for using the HADOOP-18679. Add API for bulk/paged object deletion api through iceberg. Relies on all FileSystem implementations supporting it, at least for a page size of...
HADOOP-19161 Initial design * no tests or docs * served up via StoreContext. Not sure about the merits of that I think it is needed so it gets down to...
HADOOP-19205 Adds new ClientManager interface/impl which provides on-demand creation of sync and async s3 clients, s3 transfer manager, and in close() terminates these. S3A FS is modified to * Create...
[HADOOP-19131](https://issues.apache.org/jira/browse/HADOOP-19131) Assist reflection IO with WrappedOperations class ### How was this patch tested? Needs new tests going through reflection, maybe some in openfile contract to guarantee full use. ### For...
### Description of PR HADOOP-18257. Analyze S3A Audit Logs This is #6000 rebased and squashed with a couple of changes on top. * tool is invoked through hadoop s3guard command...
HADOOP-19158. ### How was this patch tested? no tests; would need to move the hdfs one up to a contract test. ### For code changes: - [X] Does the title...
If `parquet.path.outputcommitter.enabled` is true then it uses the `PathOutputCommitterFactory` mechanism to dynamically choose a committer for the output path. Such committers do not generate summary files; a warning about this...
### Describe the bug This is covered in [HADOOP-19221](https://issues.apache.org/jira/browse/HADOOP-19221). S3 multipart upload fails to recover from server-side failures. It repeats the attempted POST, but does not supply enough data, so...