tez icon indicating copy to clipboard operation
tez copied to clipboard

TEZ-4527: Add generic and pluggable hooks for DAGs and task attempts

Open okumin opened this issue 2 years ago • 3 comments

https://issues.apache.org/jira/browse/TEZ-4527

okumin avatar Dec 18 '23 12:12 okumin

:broken_heart: -1 overall

Vote Subsystem Runtime Comment
+0 :ok: reexec 26m 20s Docker mode activated.
_ Prechecks _
+1 :green_heart: dupname 0m 0s No case conflicting files found.
+1 :green_heart: @author 0m 0s The patch does not contain any @author tags.
-1 :x: test4tests 0m 0s The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
_ master Compile Tests _
+0 :ok: mvndep 6m 24s Maven dependency ordering for branch
+1 :green_heart: mvninstall 12m 38s master passed
+1 :green_heart: compile 2m 13s master passed with JDK Ubuntu-11.0.21+9-post-Ubuntu-0ubuntu122.04
+1 :green_heart: compile 2m 2s master passed with JDK Private Build-1.8.0_392-8u392-ga-1~22.04-b08
+1 :green_heart: checkstyle 2m 3s master passed
+1 :green_heart: javadoc 1m 52s master passed with JDK Ubuntu-11.0.21+9-post-Ubuntu-0ubuntu122.04
+1 :green_heart: javadoc 1m 39s master passed with JDK Private Build-1.8.0_392-8u392-ga-1~22.04-b08
+0 :ok: spotbugs 1m 18s Used deprecated FindBugs config; considering switching to SpotBugs.
+1 :green_heart: findbugs 4m 14s master passed
_ Patch Compile Tests _
+0 :ok: mvndep 0m 9s Maven dependency ordering for patch
+1 :green_heart: mvninstall 1m 19s the patch passed
+1 :green_heart: compile 1m 27s the patch passed with JDK Ubuntu-11.0.21+9-post-Ubuntu-0ubuntu122.04
+1 :green_heart: javac 1m 27s the patch passed
+1 :green_heart: compile 1m 16s the patch passed with JDK Private Build-1.8.0_392-8u392-ga-1~22.04-b08
+1 :green_heart: javac 1m 16s the patch passed
-0 :warning: checkstyle 0m 8s tez-common: The patch generated 1 new + 0 unchanged - 0 fixed = 1 total (was 0)
-0 :warning: checkstyle 0m 20s tez-dag: The patch generated 1 new + 51 unchanged - 0 fixed = 52 total (was 51)
+1 :green_heart: whitespace 0m 0s The patch has no whitespace issues.
+1 :green_heart: javadoc 0m 51s the patch passed with JDK Ubuntu-11.0.21+9-post-Ubuntu-0ubuntu122.04
+1 :green_heart: javadoc 0m 52s the patch passed with JDK Private Build-1.8.0_392-8u392-ga-1~22.04-b08
+1 :green_heart: findbugs 3m 31s the patch passed
_ Other Tests _
+1 :green_heart: unit 2m 14s tez-api in the patch passed.
+1 :green_heart: unit 0m 26s tez-common in the patch passed.
+1 :green_heart: unit 0m 38s tez-runtime-internals in the patch passed.
+1 :green_heart: unit 4m 56s tez-dag in the patch passed.
-1 :x: asflicense 0m 38s The patch generated 4 ASF License warnings.
80m 23s
Subsystem Report/Notes
Docker ClientAPI=1.43 ServerAPI=1.43 base: https://ci-hadoop.apache.org/job/tez-multibranch/job/PR-324/1/artifact/out/Dockerfile
GITHUB PR https://github.com/apache/tez/pull/324
JIRA Issue TEZ-4527
Optional Tests dupname asflicense javac javadoc unit spotbugs findbugs checkstyle compile
uname Linux 3c822e51fa12 5.15.0-88-generic #98-Ubuntu SMP Mon Oct 2 15:18:56 UTC 2023 x86_64 x86_64 x86_64 GNU/Linux
Build tool maven
Personality personality/tez.sh
git revision master / 0c5cf6886
Default Java Private Build-1.8.0_392-8u392-ga-1~22.04-b08
Multi-JDK versions /usr/lib/jvm/java-11-openjdk-amd64:Ubuntu-11.0.21+9-post-Ubuntu-0ubuntu122.04 /usr/lib/jvm/java-8-openjdk-amd64:Private Build-1.8.0_392-8u392-ga-1~22.04-b08
checkstyle https://ci-hadoop.apache.org/job/tez-multibranch/job/PR-324/1/artifact/out/diff-checkstyle-tez-common.txt
checkstyle https://ci-hadoop.apache.org/job/tez-multibranch/job/PR-324/1/artifact/out/diff-checkstyle-tez-dag.txt
Test Results https://ci-hadoop.apache.org/job/tez-multibranch/job/PR-324/1/testReport/
asflicense https://ci-hadoop.apache.org/job/tez-multibranch/job/PR-324/1/artifact/out/patch-asflicense-problems.txt
Max. process+thread count 416 (vs. ulimit of 5500)
modules C: tez-api tez-common tez-runtime-internals tez-dag U: .
Console output https://ci-hadoop.apache.org/job/tez-multibranch/job/PR-324/1/console
versions git=2.34.1 maven=3.6.3 findbugs=3.0.1
Powered by Apache Yetus 0.12.0 https://yetus.apache.org

This message was automatically generated.

tez-yetus avatar Dec 18 '23 13:12 tez-yetus

:broken_heart: -1 overall

Vote Subsystem Runtime Comment
+0 :ok: reexec 0m 30s Docker mode activated.
_ Prechecks _
+1 :green_heart: dupname 0m 0s No case conflicting files found.
+1 :green_heart: @author 0m 0s The patch does not contain any @author tags.
-1 :x: test4tests 0m 0s The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
_ master Compile Tests _
+0 :ok: mvndep 6m 15s Maven dependency ordering for branch
+1 :green_heart: mvninstall 10m 24s master passed
+1 :green_heart: compile 2m 14s master passed with JDK Ubuntu-11.0.21+9-post-Ubuntu-0ubuntu122.04
+1 :green_heart: compile 2m 2s master passed with JDK Private Build-1.8.0_392-8u392-ga-1~22.04-b08
+1 :green_heart: checkstyle 1m 56s master passed
+1 :green_heart: javadoc 1m 49s master passed with JDK Ubuntu-11.0.21+9-post-Ubuntu-0ubuntu122.04
+1 :green_heart: javadoc 1m 39s master passed with JDK Private Build-1.8.0_392-8u392-ga-1~22.04-b08
+0 :ok: spotbugs 1m 22s Used deprecated FindBugs config; considering switching to SpotBugs.
+1 :green_heart: findbugs 4m 19s master passed
_ Patch Compile Tests _
+0 :ok: mvndep 0m 10s Maven dependency ordering for patch
+1 :green_heart: mvninstall 1m 19s the patch passed
+1 :green_heart: compile 1m 25s the patch passed with JDK Ubuntu-11.0.21+9-post-Ubuntu-0ubuntu122.04
+1 :green_heart: javac 1m 25s the patch passed
+1 :green_heart: compile 1m 15s the patch passed with JDK Private Build-1.8.0_392-8u392-ga-1~22.04-b08
+1 :green_heart: javac 1m 15s the patch passed
-0 :warning: checkstyle 0m 9s tez-common: The patch generated 1 new + 0 unchanged - 0 fixed = 1 total (was 0)
-0 :warning: checkstyle 0m 20s tez-dag: The patch generated 1 new + 51 unchanged - 0 fixed = 52 total (was 51)
+1 :green_heart: whitespace 0m 0s The patch has no whitespace issues.
+1 :green_heart: javadoc 0m 52s the patch passed with JDK Ubuntu-11.0.21+9-post-Ubuntu-0ubuntu122.04
+1 :green_heart: javadoc 0m 52s the patch passed with JDK Private Build-1.8.0_392-8u392-ga-1~22.04-b08
+1 :green_heart: findbugs 3m 32s the patch passed
_ Other Tests _
+1 :green_heart: unit 2m 14s tez-api in the patch passed.
+1 :green_heart: unit 0m 26s tez-common in the patch passed.
+1 :green_heart: unit 0m 37s tez-runtime-internals in the patch passed.
+1 :green_heart: unit 4m 56s tez-dag in the patch passed.
+1 :green_heart: asflicense 0m 39s The patch does not generate ASF License warnings.
52m 5s
Subsystem Report/Notes
Docker ClientAPI=1.43 ServerAPI=1.43 base: https://ci-hadoop.apache.org/job/tez-multibranch/job/PR-324/2/artifact/out/Dockerfile
GITHUB PR https://github.com/apache/tez/pull/324
JIRA Issue TEZ-4527
Optional Tests dupname asflicense javac javadoc unit spotbugs findbugs checkstyle compile
uname Linux ad0fa2a80cb4 5.15.0-88-generic #98-Ubuntu SMP Mon Oct 2 15:18:56 UTC 2023 x86_64 x86_64 x86_64 GNU/Linux
Build tool maven
Personality personality/tez.sh
git revision master / 0c5cf6886
Default Java Private Build-1.8.0_392-8u392-ga-1~22.04-b08
Multi-JDK versions /usr/lib/jvm/java-11-openjdk-amd64:Ubuntu-11.0.21+9-post-Ubuntu-0ubuntu122.04 /usr/lib/jvm/java-8-openjdk-amd64:Private Build-1.8.0_392-8u392-ga-1~22.04-b08
checkstyle https://ci-hadoop.apache.org/job/tez-multibranch/job/PR-324/2/artifact/out/diff-checkstyle-tez-common.txt
checkstyle https://ci-hadoop.apache.org/job/tez-multibranch/job/PR-324/2/artifact/out/diff-checkstyle-tez-dag.txt
Test Results https://ci-hadoop.apache.org/job/tez-multibranch/job/PR-324/2/testReport/
Max. process+thread count 412 (vs. ulimit of 5500)
modules C: tez-api tez-common tez-runtime-internals tez-dag U: .
Console output https://ci-hadoop.apache.org/job/tez-multibranch/job/PR-324/2/console
versions git=2.34.1 maven=3.6.3 findbugs=3.0.1
Powered by Apache Yetus 0.12.0 https://yetus.apache.org

This message was automatically generated.

tez-yetus avatar Dec 18 '23 15:12 tez-yetus

:broken_heart: -1 overall

Vote Subsystem Runtime Comment
+0 :ok: reexec 0m 30s Docker mode activated.
_ Prechecks _
+1 :green_heart: dupname 0m 1s No case conflicting files found.
+1 :green_heart: @author 0m 0s The patch does not contain any @author tags.
-1 :x: test4tests 0m 0s The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
_ master Compile Tests _
+0 :ok: mvndep 6m 12s Maven dependency ordering for branch
+1 :green_heart: mvninstall 12m 13s master passed
+1 :green_heart: compile 2m 11s master passed with JDK Ubuntu-11.0.21+9-post-Ubuntu-0ubuntu122.04
+1 :green_heart: compile 2m 2s master passed with JDK Private Build-1.8.0_392-8u392-ga-1~22.04-b08
+1 :green_heart: checkstyle 2m 3s master passed
+1 :green_heart: javadoc 1m 51s master passed with JDK Ubuntu-11.0.21+9-post-Ubuntu-0ubuntu122.04
+1 :green_heart: javadoc 1m 38s master passed with JDK Private Build-1.8.0_392-8u392-ga-1~22.04-b08
+0 :ok: spotbugs 1m 19s Used deprecated FindBugs config; considering switching to SpotBugs.
+1 :green_heart: findbugs 4m 16s master passed
_ Patch Compile Tests _
+0 :ok: mvndep 0m 10s Maven dependency ordering for patch
+1 :green_heart: mvninstall 1m 20s the patch passed
+1 :green_heart: compile 1m 26s the patch passed with JDK Ubuntu-11.0.21+9-post-Ubuntu-0ubuntu122.04
+1 :green_heart: javac 1m 26s the patch passed
+1 :green_heart: compile 1m 15s the patch passed with JDK Private Build-1.8.0_392-8u392-ga-1~22.04-b08
+1 :green_heart: javac 1m 15s the patch passed
+1 :green_heart: checkstyle 0m 51s the patch passed
+1 :green_heart: whitespace 0m 0s The patch has no whitespace issues.
+1 :green_heart: javadoc 0m 52s the patch passed with JDK Ubuntu-11.0.21+9-post-Ubuntu-0ubuntu122.04
+1 :green_heart: javadoc 0m 52s the patch passed with JDK Private Build-1.8.0_392-8u392-ga-1~22.04-b08
+1 :green_heart: findbugs 3m 36s the patch passed
_ Other Tests _
+1 :green_heart: unit 2m 16s tez-api in the patch passed.
+1 :green_heart: unit 0m 25s tez-common in the patch passed.
+1 :green_heart: unit 0m 38s tez-runtime-internals in the patch passed.
+1 :green_heart: unit 4m 55s tez-dag in the patch passed.
+1 :green_heart: asflicense 0m 39s The patch does not generate ASF License warnings.
53m 56s
Subsystem Report/Notes
Docker ClientAPI=1.43 ServerAPI=1.43 base: https://ci-hadoop.apache.org/job/tez-multibranch/job/PR-324/3/artifact/out/Dockerfile
GITHUB PR https://github.com/apache/tez/pull/324
JIRA Issue TEZ-4527
Optional Tests dupname asflicense javac javadoc unit spotbugs findbugs checkstyle compile
uname Linux c3ccbb36f8b9 5.15.0-88-generic #98-Ubuntu SMP Mon Oct 2 15:18:56 UTC 2023 x86_64 x86_64 x86_64 GNU/Linux
Build tool maven
Personality personality/tez.sh
git revision master / 0c5cf6886
Default Java Private Build-1.8.0_392-8u392-ga-1~22.04-b08
Multi-JDK versions /usr/lib/jvm/java-11-openjdk-amd64:Ubuntu-11.0.21+9-post-Ubuntu-0ubuntu122.04 /usr/lib/jvm/java-8-openjdk-amd64:Private Build-1.8.0_392-8u392-ga-1~22.04-b08
Test Results https://ci-hadoop.apache.org/job/tez-multibranch/job/PR-324/3/testReport/
Max. process+thread count 457 (vs. ulimit of 5500)
modules C: tez-api tez-common tez-runtime-internals tez-dag U: .
Console output https://ci-hadoop.apache.org/job/tez-multibranch/job/PR-324/3/console
versions git=2.34.1 maven=3.6.3 findbugs=3.0.1
Powered by Apache Yetus 0.12.0 https://yetus.apache.org

This message was automatically generated.

tez-yetus avatar Dec 18 '23 16:12 tez-yetus