seatunnel icon indicating copy to clipboard operation
seatunnel copied to clipboard

Job metrics cannot be found.

Open pengwf1804 opened this issue 1 month ago • 3 comments

Search before asking

  • [x] I had searched in the issues and found no similar issues.

What happened

I want to check the statistical metrics of the stream jobs submitted to the cluster, but I cannot find them in the log files. Such information includes the number of read data records, the number of written data records, and so on.

Separated Cluster Mode.

Configure to output separate log files for jobs.

SeaTunnel Version

2.3.12

SeaTunnel Config

seatunnel:
  engine:
    classloader-cache-mode: true
    history-job-expire-minutes: 4320
    backup-count: 1
    queue-type: blockingqueue
    print-execution-info-interval: 60
    print-job-metrics-info-interval: 60
    slot-service:
      dynamic-slot: true
    checkpoint:
      interval: 300000
      timeout: 60000
      storage:
        type: hdfs
        max-retained: 5
        plugin-config:
          storage.type: s3
          fs.s3a.access.key: admin
          fs.s3a.secret.key: ******
          fs.s3a.endpoint: http://10.*.*.*:9000
          s3.bucket: s3a://jxglas
          fs.s3a.aws.credentials.provider: org.apache.hadoop.fs.s3a.SimpleAWSCredentialsProvider
    telemetry:
      metric:
        enabled: true
      logs:
        scheduled-deletion-enable: true
    http:
      enable-http: true
      port: 8080
      enable-dynamic-port: false
      # Uncomment the following lines to enable basic authentication for web UI
      # enable-basic-auth: true
      # basic-auth-username: admin
      # basic-auth-password: admin

Running Command

seatunnel.sh --config job.config --async

Error Exception

No errors reported.

Zeta or Flink or Spark Version

zeta

Java or Scala Version

1.8

Screenshots

No response

Are you willing to submit PR?

  • [ ] Yes I am willing to submit a PR!

Code of Conduct

pengwf1804 avatar Nov 20 '25 03:11 pengwf1804

When using the Web UI, the specific statistical information of stream jobs still cannot be viewed, but the statistical information of batch jobs can be viewed normally.

pengwf1804 avatar Nov 24 '25 03:11 pengwf1804

Image

pengwf1804 avatar Nov 24 '25 03:11 pengwf1804