tez
tez copied to clipboard
Published
20 hours ago •
apache
apache
TEZ-4352: Add a web ui interface for TezChild
:confetti_ball: +1 overall
| Vote | Subsystem | Runtime | Comment |
|---|---|---|---|
| +0 :ok: | reexec | 40m 23s | Docker mode activated. |
| _ Prechecks _ | |||
| +1 :green_heart: | dupname | 0m 0s | No case conflicting files found. |
| +1 :green_heart: | @author | 0m 0s | The patch does not contain any @author tags. |
| +1 :green_heart: | test4tests | 0m 0s | The patch appears to include 1 new or modified test files. |
| _ master Compile Tests _ | |||
| +0 :ok: | mvndep | 5m 52s | Maven dependency ordering for branch |
| +1 :green_heart: | mvninstall | 10m 50s | master passed |
| +1 :green_heart: | compile | 2m 8s | master passed with JDK Ubuntu-11.0.17+8-post-Ubuntu-1ubuntu220.04 |
| +1 :green_heart: | compile | 1m 58s | master passed with JDK Private Build-1.8.0_352-8u352-ga-1~20.04-b08 |
| +1 :green_heart: | checkstyle | 1m 57s | master passed |
| +1 :green_heart: | javadoc | 2m 8s | master passed with JDK Ubuntu-11.0.17+8-post-Ubuntu-1ubuntu220.04 |
| +1 :green_heart: | javadoc | 1m 58s | master passed with JDK Private Build-1.8.0_352-8u352-ga-1~20.04-b08 |
| +0 :ok: | spotbugs | 0m 57s | Used deprecated FindBugs config; considering switching to SpotBugs. |
| +1 :green_heart: | findbugs | 3m 27s | master passed |
| _ Patch Compile Tests _ | |||
| +0 :ok: | mvndep | 0m 10s | Maven dependency ordering for patch |
| +1 :green_heart: | mvninstall | 1m 6s | the patch passed |
| +1 :green_heart: | compile | 1m 6s | the patch passed with JDK Ubuntu-11.0.17+8-post-Ubuntu-1ubuntu220.04 |
| +1 :green_heart: | javac | 1m 6s | the patch passed |
| +1 :green_heart: | compile | 0m 58s | the patch passed with JDK Private Build-1.8.0_352-8u352-ga-1~20.04-b08 |
| +1 :green_heart: | javac | 0m 58s | the patch passed |
| +1 :green_heart: | checkstyle | 0m 13s | tez-api: The patch generated 0 new + 35 unchanged - 1 fixed = 35 total (was 36) |
| -0 :warning: | checkstyle | 0m 11s | tez-runtime-internals: The patch generated 5 new + 8 unchanged - 0 fixed = 13 total (was 8) |
| +1 :green_heart: | checkstyle | 0m 13s | The patch passed checkstyle in tez-tests |
| +1 :green_heart: | whitespace | 0m 0s | The patch has no whitespace issues. |
| +1 :green_heart: | javadoc | 0m 57s | the patch passed with JDK Ubuntu-11.0.17+8-post-Ubuntu-1ubuntu220.04 |
| +1 :green_heart: | javadoc | 0m 54s | the patch passed with JDK Private Build-1.8.0_352-8u352-ga-1~20.04-b08 |
| +1 :green_heart: | findbugs | 2m 32s | the patch passed |
| _ Other Tests _ | |||
| +1 :green_heart: | unit | 2m 15s | tez-api in the patch passed. |
| +1 :green_heart: | unit | 0m 39s | tez-runtime-internals in the patch passed. |
| +1 :green_heart: | unit | 42m 34s | tez-tests in the patch passed. |
| +1 :green_heart: | asflicense | 0m 41s | The patch does not generate ASF License warnings. |
| 126m 41s |
| Subsystem | Report/Notes |
|---|---|
| Docker | ClientAPI=1.41 ServerAPI=1.41 base: https://ci-hadoop.apache.org/job/tez-multibranch/job/PR-248/1/artifact/out/Dockerfile |
| GITHUB PR | https://github.com/apache/tez/pull/248 |
| JIRA Issue | TEZ-4352 |
| Optional Tests | dupname asflicense javac javadoc unit spotbugs findbugs checkstyle compile |
| uname | Linux 474b685bc019 4.15.0-191-generic #202-Ubuntu SMP Thu Aug 4 01:49:29 UTC 2022 x86_64 x86_64 x86_64 GNU/Linux |
| Build tool | maven |
| Personality | personality/tez.sh |
| git revision | master / 8bb27b845 |
| Default Java | Private Build-1.8.0_352-8u352-ga-1~20.04-b08 |
| Multi-JDK versions | /usr/lib/jvm/java-11-openjdk-amd64:Ubuntu-11.0.17+8-post-Ubuntu-1ubuntu220.04 /usr/lib/jvm/java-8-openjdk-amd64:Private Build-1.8.0_352-8u352-ga-1~20.04-b08 |
| checkstyle | https://ci-hadoop.apache.org/job/tez-multibranch/job/PR-248/1/artifact/out/diff-checkstyle-tez-runtime-internals.txt |
| Test Results | https://ci-hadoop.apache.org/job/tez-multibranch/job/PR-248/1/testReport/ |
| Max. process+thread count | 1237 (vs. ulimit of 5500) |
| modules | C: tez-api tez-runtime-internals tez-tests U: . |
| Console output | https://ci-hadoop.apache.org/job/tez-multibranch/job/PR-248/1/console |
| versions | git=2.25.1 maven=3.6.3 findbugs=3.0.1 |
| Powered by | Apache Yetus 0.12.0 https://yetus.apache.org |
This message was automatically generated.
:confetti_ball: +1 overall
| Vote | Subsystem | Runtime | Comment |
|---|---|---|---|
| +0 :ok: | reexec | 1m 26s | Docker mode activated. |
| _ Prechecks _ | |||
| +1 :green_heart: | dupname | 0m 1s | No case conflicting files found. |
| +1 :green_heart: | @author | 0m 0s | The patch does not contain any @author tags. |
| +1 :green_heart: | test4tests | 0m 0s | The patch appears to include 1 new or modified test files. |
| _ master Compile Tests _ | |||
| +0 :ok: | mvndep | 5m 54s | Maven dependency ordering for branch |
| +1 :green_heart: | mvninstall | 10m 43s | master passed |
| +1 :green_heart: | compile | 2m 5s | master passed with JDK Ubuntu-11.0.17+8-post-Ubuntu-1ubuntu220.04 |
| +1 :green_heart: | compile | 1m 54s | master passed with JDK Private Build-1.8.0_352-8u352-ga-1~20.04-b08 |
| +1 :green_heart: | checkstyle | 1m 48s | master passed |
| +1 :green_heart: | javadoc | 2m 2s | master passed with JDK Ubuntu-11.0.17+8-post-Ubuntu-1ubuntu220.04 |
| +1 :green_heart: | javadoc | 1m 52s | master passed with JDK Private Build-1.8.0_352-8u352-ga-1~20.04-b08 |
| +0 :ok: | spotbugs | 0m 56s | Used deprecated FindBugs config; considering switching to SpotBugs. |
| +1 :green_heart: | findbugs | 3m 19s | master passed |
| _ Patch Compile Tests _ | |||
| +0 :ok: | mvndep | 0m 9s | Maven dependency ordering for patch |
| +1 :green_heart: | mvninstall | 1m 3s | the patch passed |
| +1 :green_heart: | compile | 1m 8s | the patch passed with JDK Ubuntu-11.0.17+8-post-Ubuntu-1ubuntu220.04 |
| +1 :green_heart: | javac | 1m 8s | the patch passed |
| +1 :green_heart: | compile | 1m 0s | the patch passed with JDK Private Build-1.8.0_352-8u352-ga-1~20.04-b08 |
| +1 :green_heart: | javac | 1m 0s | the patch passed |
| +1 :green_heart: | checkstyle | 0m 14s | tez-api: The patch generated 0 new + 35 unchanged - 1 fixed = 35 total (was 36) |
| -0 :warning: | checkstyle | 0m 11s | tez-runtime-internals: The patch generated 5 new + 8 unchanged - 0 fixed = 13 total (was 8) |
| +1 :green_heart: | checkstyle | 0m 14s | The patch passed checkstyle in tez-tests |
| +1 :green_heart: | whitespace | 0m 0s | The patch has no whitespace issues. |
| +1 :green_heart: | javadoc | 0m 59s | the patch passed with JDK Ubuntu-11.0.17+8-post-Ubuntu-1ubuntu220.04 |
| +1 :green_heart: | javadoc | 0m 57s | the patch passed with JDK Private Build-1.8.0_352-8u352-ga-1~20.04-b08 |
| +1 :green_heart: | findbugs | 2m 31s | the patch passed |
| _ Other Tests _ | |||
| +1 :green_heart: | unit | 2m 15s | tez-api in the patch passed. |
| +1 :green_heart: | unit | 0m 39s | tez-runtime-internals in the patch passed. |
| +1 :green_heart: | unit | 40m 22s | tez-tests in the patch passed. |
| +1 :green_heart: | asflicense | 0m 42s | The patch does not generate ASF License warnings. |
| 84m 53s |
| Subsystem | Report/Notes |
|---|---|
| Docker | ClientAPI=1.41 ServerAPI=1.41 base: https://ci-hadoop.apache.org/job/tez-multibranch/job/PR-248/2/artifact/out/Dockerfile |
| GITHUB PR | https://github.com/apache/tez/pull/248 |
| JIRA Issue | TEZ-4352 |
| Optional Tests | dupname asflicense javac javadoc unit spotbugs findbugs checkstyle compile |
| uname | Linux fcdaf5fcb49c 4.15.0-191-generic #202-Ubuntu SMP Thu Aug 4 01:49:29 UTC 2022 x86_64 x86_64 x86_64 GNU/Linux |
| Build tool | maven |
| Personality | personality/tez.sh |
| git revision | master / 8bb27b845 |
| Default Java | Private Build-1.8.0_352-8u352-ga-1~20.04-b08 |
| Multi-JDK versions | /usr/lib/jvm/java-11-openjdk-amd64:Ubuntu-11.0.17+8-post-Ubuntu-1ubuntu220.04 /usr/lib/jvm/java-8-openjdk-amd64:Private Build-1.8.0_352-8u352-ga-1~20.04-b08 |
| checkstyle | https://ci-hadoop.apache.org/job/tez-multibranch/job/PR-248/2/artifact/out/diff-checkstyle-tez-runtime-internals.txt |
| Test Results | https://ci-hadoop.apache.org/job/tez-multibranch/job/PR-248/2/testReport/ |
| Max. process+thread count | 1233 (vs. ulimit of 5500) |
| modules | C: tez-api tez-runtime-internals tez-tests U: . |
| Console output | https://ci-hadoop.apache.org/job/tez-multibranch/job/PR-248/2/console |
| versions | git=2.25.1 maven=3.6.3 findbugs=3.0.1 |
| Powered by | Apache Yetus 0.12.0 https://yetus.apache.org |
This message was automatically generated.
can I have a review on this @rbalamohan? the (optional) web ui interface of TezChild is supposed to be the starting point for further improvements like TEZ-4344, TEZ-4345
Hi @abstractdog , I just have few basic questions. I donot have full context on it so if you can point to some doc that would be great.
- Who will be the consumer of the API? How it'll be consumed?
- Since ports are dynamic, how will the consumer know service is running on which port? Do you have plan to send this info to Tez AM?
hey, good questions @guptashailesh92 , here are my thoughts so far:
-
Consumer can be immediately a human being troubleshooting on a cluster, and also TezAM if we implement TEZ-4344 and TEZ-4345
-
Yes, exactly, I was about to send this to AM, but the patch suddenly became much more complicated, so I decided to use this as a minimal patch for introducing the web ui only
:confetti_ball: +1 overall
| Vote | Subsystem | Runtime | Comment |
|---|---|---|---|
| +0 :ok: | reexec | 0m 38s | Docker mode activated. |
| _ Prechecks _ | |||
| +1 :green_heart: | dupname | 0m 1s | No case conflicting files found. |
| +1 :green_heart: | @author | 0m 0s | The patch does not contain any @author tags. |
| +1 :green_heart: | test4tests | 0m 0s | The patch appears to include 1 new or modified test files. |
| _ master Compile Tests _ | |||
| +0 :ok: | mvndep | 5m 42s | Maven dependency ordering for branch |
| +1 :green_heart: | mvninstall | 7m 40s | master passed |
| +1 :green_heart: | compile | 1m 48s | master passed with JDK Ubuntu-11.0.19+7-post-Ubuntu-0ubuntu122.04.1 |
| +1 :green_heart: | compile | 1m 46s | master passed with JDK Private Build-1.8.0_362-8u372-ga~us1-0ubuntu1~22.04-b09 |
| +1 :green_heart: | checkstyle | 1m 51s | master passed |
| +1 :green_heart: | javadoc | 1m 48s | master passed with JDK Ubuntu-11.0.19+7-post-Ubuntu-0ubuntu122.04.1 |
| +1 :green_heart: | javadoc | 1m 37s | master passed with JDK Private Build-1.8.0_362-8u372-ga~us1-0ubuntu1~22.04-b09 |
| +0 :ok: | spotbugs | 0m 52s | Used deprecated FindBugs config; considering switching to SpotBugs. |
| +1 :green_heart: | findbugs | 3m 13s | master passed |
| _ Patch Compile Tests _ | |||
| +0 :ok: | mvndep | 0m 10s | Maven dependency ordering for patch |
| +1 :green_heart: | mvninstall | 0m 58s | the patch passed |
| +1 :green_heart: | compile | 1m 2s | the patch passed with JDK Ubuntu-11.0.19+7-post-Ubuntu-0ubuntu122.04.1 |
| +1 :green_heart: | javac | 1m 2s | the patch passed |
| +1 :green_heart: | compile | 0m 55s | the patch passed with JDK Private Build-1.8.0_362-8u372-ga~us1-0ubuntu1~22.04-b09 |
| +1 :green_heart: | javac | 0m 55s | the patch passed |
| +1 :green_heart: | checkstyle | 0m 14s | tez-api: The patch generated 0 new + 35 unchanged - 1 fixed = 35 total (was 36) |
| -0 :warning: | checkstyle | 0m 10s | tez-runtime-internals: The patch generated 2 new + 8 unchanged - 0 fixed = 10 total (was 8) |
| +1 :green_heart: | checkstyle | 0m 11s | The patch passed checkstyle in tez-tests |
| +1 :green_heart: | whitespace | 0m 0s | The patch has no whitespace issues. |
| +1 :green_heart: | javadoc | 0m 45s | the patch passed with JDK Ubuntu-11.0.19+7-post-Ubuntu-0ubuntu122.04.1 |
| +1 :green_heart: | javadoc | 0m 45s | the patch passed with JDK Private Build-1.8.0_362-8u372-ga~us1-0ubuntu1~22.04-b09 |
| +1 :green_heart: | findbugs | 2m 21s | the patch passed |
| _ Other Tests _ | |||
| +1 :green_heart: | unit | 2m 19s | tez-api in the patch passed. |
| +1 :green_heart: | unit | 0m 39s | tez-runtime-internals in the patch passed. |
| +1 :green_heart: | unit | 45m 24s | tez-tests in the patch passed. |
| +1 :green_heart: | asflicense | 0m 40s | The patch does not generate ASF License warnings. |
| 84m 28s |
| Subsystem | Report/Notes |
|---|---|
| Docker | ClientAPI=1.43 ServerAPI=1.43 base: https://ci-hadoop.apache.org/job/tez-multibranch/job/PR-248/3/artifact/out/Dockerfile |
| GITHUB PR | https://github.com/apache/tez/pull/248 |
| JIRA Issue | TEZ-4352 |
| Optional Tests | dupname asflicense javac javadoc unit spotbugs findbugs checkstyle compile |
| uname | Linux b97b8a83b36b 4.15.0-212-generic #223-Ubuntu SMP Tue May 23 13:09:22 UTC 2023 x86_64 x86_64 x86_64 GNU/Linux |
| Build tool | maven |
| Personality | personality/tez.sh |
| git revision | master / 7a56e9bd9 |
| Default Java | Private Build-1.8.0_362-8u372-ga~us1-0ubuntu1~22.04-b09 |
| Multi-JDK versions | /usr/lib/jvm/java-11-openjdk-amd64:Ubuntu-11.0.19+7-post-Ubuntu-0ubuntu122.04.1 /usr/lib/jvm/java-8-openjdk-amd64:Private Build-1.8.0_362-8u372-ga~us1-0ubuntu1~22.04-b09 |
| checkstyle | https://ci-hadoop.apache.org/job/tez-multibranch/job/PR-248/3/artifact/out/diff-checkstyle-tez-runtime-internals.txt |
| Test Results | https://ci-hadoop.apache.org/job/tez-multibranch/job/PR-248/3/testReport/ |
| Max. process+thread count | 1345 (vs. ulimit of 5500) |
| modules | C: tez-api tez-runtime-internals tez-tests U: . |
| Console output | https://ci-hadoop.apache.org/job/tez-multibranch/job/PR-248/3/console |
| versions | git=2.34.1 maven=3.6.3 findbugs=3.0.1 |
| Powered by | Apache Yetus 0.12.0 https://yetus.apache.org |
This message was automatically generated.
:confetti_ball: +1 overall
| Vote | Subsystem | Runtime | Comment |
|---|---|---|---|
| +0 :ok: | reexec | 0m 37s | Docker mode activated. |
| _ Prechecks _ | |||
| +1 :green_heart: | dupname | 0m 0s | No case conflicting files found. |
| +1 :green_heart: | @author | 0m 0s | The patch does not contain any @author tags. |
| +1 :green_heart: | test4tests | 0m 1s | The patch appears to include 1 new or modified test files. |
| _ master Compile Tests _ | |||
| +0 :ok: | mvndep | 5m 36s | Maven dependency ordering for branch |
| +1 :green_heart: | mvninstall | 7m 48s | master passed |
| +1 :green_heart: | compile | 1m 52s | master passed with JDK Ubuntu-11.0.19+7-post-Ubuntu-0ubuntu122.04.1 |
| +1 :green_heart: | compile | 1m 49s | master passed with JDK Private Build-1.8.0_362-8u372-ga~us1-0ubuntu1~22.04-b09 |
| +1 :green_heart: | checkstyle | 1m 53s | master passed |
| +1 :green_heart: | javadoc | 1m 50s | master passed with JDK Ubuntu-11.0.19+7-post-Ubuntu-0ubuntu122.04.1 |
| +1 :green_heart: | javadoc | 1m 36s | master passed with JDK Private Build-1.8.0_362-8u372-ga~us1-0ubuntu1~22.04-b09 |
| +0 :ok: | spotbugs | 0m 51s | Used deprecated FindBugs config; considering switching to SpotBugs. |
| +1 :green_heart: | findbugs | 3m 17s | master passed |
| _ Patch Compile Tests _ | |||
| +0 :ok: | mvndep | 0m 10s | Maven dependency ordering for patch |
| +1 :green_heart: | mvninstall | 0m 57s | the patch passed |
| +1 :green_heart: | compile | 1m 1s | the patch passed with JDK Ubuntu-11.0.19+7-post-Ubuntu-0ubuntu122.04.1 |
| +1 :green_heart: | javac | 1m 1s | the patch passed |
| +1 :green_heart: | compile | 0m 55s | the patch passed with JDK Private Build-1.8.0_362-8u372-ga~us1-0ubuntu1~22.04-b09 |
| +1 :green_heart: | javac | 0m 55s | the patch passed |
| +1 :green_heart: | checkstyle | 0m 13s | tez-api: The patch generated 0 new + 35 unchanged - 1 fixed = 35 total (was 36) |
| -0 :warning: | checkstyle | 0m 10s | tez-runtime-internals: The patch generated 1 new + 8 unchanged - 0 fixed = 9 total (was 8) |
| +1 :green_heart: | checkstyle | 0m 11s | The patch passed checkstyle in tez-tests |
| +1 :green_heart: | whitespace | 0m 0s | The patch has no whitespace issues. |
| +1 :green_heart: | javadoc | 0m 43s | the patch passed with JDK Ubuntu-11.0.19+7-post-Ubuntu-0ubuntu122.04.1 |
| +1 :green_heart: | javadoc | 0m 44s | the patch passed with JDK Private Build-1.8.0_362-8u372-ga~us1-0ubuntu1~22.04-b09 |
| +1 :green_heart: | findbugs | 2m 22s | the patch passed |
| _ Other Tests _ | |||
| +1 :green_heart: | unit | 2m 17s | tez-api in the patch passed. |
| +1 :green_heart: | unit | 0m 39s | tez-runtime-internals in the patch passed. |
| +1 :green_heart: | unit | 42m 24s | tez-tests in the patch passed. |
| +1 :green_heart: | asflicense | 0m 39s | The patch does not generate ASF License warnings. |
| 81m 37s |
| Subsystem | Report/Notes |
|---|---|
| Docker | ClientAPI=1.43 ServerAPI=1.43 base: https://ci-hadoop.apache.org/job/tez-multibranch/job/PR-248/4/artifact/out/Dockerfile |
| GITHUB PR | https://github.com/apache/tez/pull/248 |
| JIRA Issue | TEZ-4352 |
| Optional Tests | dupname asflicense javac javadoc unit spotbugs findbugs checkstyle compile |
| uname | Linux 5dab7ddec397 4.15.0-212-generic #223-Ubuntu SMP Tue May 23 13:09:22 UTC 2023 x86_64 x86_64 x86_64 GNU/Linux |
| Build tool | maven |
| Personality | personality/tez.sh |
| git revision | master / 7a56e9bd9 |
| Default Java | Private Build-1.8.0_362-8u372-ga~us1-0ubuntu1~22.04-b09 |
| Multi-JDK versions | /usr/lib/jvm/java-11-openjdk-amd64:Ubuntu-11.0.19+7-post-Ubuntu-0ubuntu122.04.1 /usr/lib/jvm/java-8-openjdk-amd64:Private Build-1.8.0_362-8u372-ga~us1-0ubuntu1~22.04-b09 |
| checkstyle | https://ci-hadoop.apache.org/job/tez-multibranch/job/PR-248/4/artifact/out/diff-checkstyle-tez-runtime-internals.txt |
| Test Results | https://ci-hadoop.apache.org/job/tez-multibranch/job/PR-248/4/testReport/ |
| Max. process+thread count | 1433 (vs. ulimit of 5500) |
| modules | C: tez-api tez-runtime-internals tez-tests U: . |
| Console output | https://ci-hadoop.apache.org/job/tez-multibranch/job/PR-248/4/console |
| versions | git=2.34.1 maven=3.6.3 findbugs=3.0.1 |
| Powered by | Apache Yetus 0.12.0 https://yetus.apache.org |
This message was automatically generated.