Job metrics cannot be found.
Search before asking
- [x] I had searched in the issues and found no similar issues.
What happened
I want to check the statistical metrics of the stream jobs submitted to the cluster, but I cannot find them in the log files. Such information includes the number of read data records, the number of written data records, and so on.
Separated Cluster Mode.
Configure to output separate log files for jobs.
SeaTunnel Version
2.3.12
SeaTunnel Config
seatunnel:
engine:
classloader-cache-mode: true
history-job-expire-minutes: 4320
backup-count: 1
queue-type: blockingqueue
print-execution-info-interval: 60
print-job-metrics-info-interval: 60
slot-service:
dynamic-slot: true
checkpoint:
interval: 300000
timeout: 60000
storage:
type: hdfs
max-retained: 5
plugin-config:
storage.type: s3
fs.s3a.access.key: admin
fs.s3a.secret.key: ******
fs.s3a.endpoint: http://10.*.*.*:9000
s3.bucket: s3a://jxglas
fs.s3a.aws.credentials.provider: org.apache.hadoop.fs.s3a.SimpleAWSCredentialsProvider
telemetry:
metric:
enabled: true
logs:
scheduled-deletion-enable: true
http:
enable-http: true
port: 8080
enable-dynamic-port: false
# Uncomment the following lines to enable basic authentication for web UI
# enable-basic-auth: true
# basic-auth-username: admin
# basic-auth-password: admin
Running Command
seatunnel.sh --config job.config --async
Error Exception
No errors reported.
Zeta or Flink or Spark Version
zeta
Java or Scala Version
1.8
Screenshots
No response
Are you willing to submit PR?
- [ ] Yes I am willing to submit a PR!
Code of Conduct
- [x] I agree to follow this project's Code of Conduct
What about using this web UI https://seatunnel.apache.org/docs/2.3.12/seatunnel-engine/web-ui ?
When using the Web UI, the specific statistical information of stream jobs still cannot be viewed, but the statistical information of batch jobs can be viewed normally.