Steve Loughran

Results 340 comments of Steve Loughran

@diljotgrewal I've created a feature branch for this work: HADOOP-19256-s3-conditional-writes Can you upgrade to the latest SDK, do the usual qualification work and then submit a request against this branch....

You can do it you should be aware of that my process is going to be so rigourous it is going to cost you a couple of days. I intend...

Afraid I have to agree with @debora-ito : this is generally a sign of the network connection being broken. The hadoop S3A client does a lot of recovery here; afraid...

bad news: java sdk says any number less than the requested number may be returned ``` An attempt is made to read as many as len bytes, but a smaller...

just compared this to the s3a error code. this stack trace implies that our recursive scan for socket errors will pick this up, which is probably why we've never seen...

@drewschleit I'd recommend going all the way down. one problem with XML parser exceptions is that sometimes the network returns HTML and that really isn't recoverable. Key examples * some...

well, we don't distribute it, but unless anybody is set up to test it, we have to choose between "used to work but has cve" and "more secure but may...

> I can add the backslash to the ListPrefix request. Do we want to do it for all s3 buckets(general + directory) this will be a breaking change, or would...

sometime i should update the bit of the iceberg docs which deprecates the S3A connector, to highlight what it offers, adding large file upload to S3 Express stores to the...

I didn't know about this -yes, it could be potentially useful * the docs need updating too * our delegation token support, where credentials get passed with a job, will...