Steve Loughran

@clesaec this can't go in until hadoop2 is cut as a profile. I am actually doing a shim library to do reflection invocation on the newer operations, with fallbacks if...

actually, FileOutputCommitter.getOutputPath should work if all you want is to know the dest path of a job. you shouldn't use it for a real mr/spark job on s3a (performance, correctness)...

you got a stack of the FNFE?

@snvijaya merged to trunk; cherrypick in to branch-3.3, test it and push up a new pr and i will merge that. thanks

we are nearing code freeze for 3.3.5 btw; if there is some final blocker to upgrade, now is the time to identify it

3.3.4 is the one where we fixed the tez incompatibilities for you 🙂 i plan to cut the 3.3.5 rc0 this week but it's a test of the rc process...

3.3.4 should be good; if not try with a 3.3.5 snapshot (build yourself) and see if that fixes things. i'd suggest going with 3.3.4 if it works, so the 3.3.5...

now, what exactly are you doing with the output committer? just looking for a temporary directory or actually executing task attempts generating different blocks of data and then committing the...

done, though as I pressed sent I realised the title had pulled line #2 up; sorry. will cherrypick to 3.4

merged to 3.4; branch-3.3 had conflicts. @pan3793 if you want it there, create another PR so yetus can validate it. thanks!