Steve Loughran
Steve Loughran
rebased; running as an experiment. the jobid stuff is all set up in the pom.xml. i actually want to be able to set it in the auth-keys.xml file, as that...
Can I chase @mukund-thakur @HarshitGupta11 @ahmarsuhail for reviews here. This is so we can run multiple CI tests against the same bucket in parallel.
ooh, good point. I did a while back, but let me kick that off again
...and I've found out that terasort paths aren't isolated ``` [ERROR] Failures: [ERROR] org.apache.hadoop.fs.s3a.commit.terasort.ITestTerasortOnS3A.test_120_terasort[magic](org.apache.hadoop.fs.s3a.commit.terasort.ITestTerasortOnS3A) [ERROR] Run 1: ITestTerasortOnS3A.test_120_terasort:289->executeStage:239->Assert.assertEquals:647->Assert.failNotEquals:835->Assert.fail:89 terasort(s3a://stevel-london/terasort-magic-false/sortin, s3a://stevel-london/terasort-magic-false/sortout) failed expected: but was: [ERROR] Run 2: ITestTerasortOnS3A.test_120_terasort:289->executeStage:239->Assert.assertEquals:647->Assert.failNotEquals:835->Assert.fail:89 terasort(s3a://stevel-london/terasort-magic-true/sortin, s3a://stevel-london/terasort-magic-true/sortout)...
checkstyles where I changed the base contract tests ``` ./hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/fs/TestFSMainOperationsLocalFileSystem.java:25:import org.junit.Assert;:8: Unused import - org.junit.Assert. [UnusedImports] ./hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/fs/TestFSMainOperationsLocalFileSystem.java:27:import org.junit.Test;:8: Unused import - org.junit.Test. [UnusedImports] ./hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/fs/viewfs/TestFSMainOperationsLocalFileSystem.java:22:import java.io.IOException;:8: Unused import - java.io.IOException. [UnusedImports]...
@mukund-thakur retested, identified a race condition in terasorts and fixed. all should be good now
ooh, you must have a different encryption setup from me; I'm on KMS
1. everything good on a single terminal test run? 2. you were using different copies of the hadoop source tree?
+what were the mvn commands used?
I need to sit down and fix that committer factory one. nothing hard but it is irritating me