Steve Loughran
Steve Loughran
* Clarify behaviour * Add checks to all implementations * Add abfs contract test. ABFS doesn't (yet) implement the API; this initially verifies that the fallback implementation works through it....
### Description of PR HADOOP-19093. Adds new test which can be explicitly launched to try and trigger rename throttling. ### How was this patch tested? It doesn't generate enough load...
New profile awssdk must be set for hadoop-tools-dist to include the AWS SDK (so cuts binary size in half) * This is not yet documented * no attempt to be...
* adds job id to fork id * adds option to disable root tests * documents this * gets more tests working under the job/fork subdir rather than absolute paths....
A more minimal design that is easier to use and implement than #5993 Caller creates a BulkOperation; they get the page size of it and then submit batches to delete...
This is actually trickier than it seems as we will need to go deep into the implementation of caching. Specifically: the prefetcher knows the file length and if you open...
### Description of PR Alternate implement to #6378 Contributed by Rajesh Balamohan. ### How was this patch tested? Not tested this cherrypick from cdh to hadoop trunk; no intent to...
Initial pass at writing an API for bulk deletes, targeting S3 and any store with paged delete support. Minimal design of a RemoteIterator to provide the list of paths to...
MultiObject delete fails with x-amz-checksum* not found. This fix adds the correct execution attribute to use the correct interceptor. Contributed by Harshit Gupta ### How was this patch tested? New...
Making this a pre-requisite for vectored IO as * helps me learn my way around the code * I propose that the caching block stream stops its prefetching once a...