seatunnel
seatunnel copied to clipboard
apache
[ST-Engine][Client] Make the client can output the job's log
Search before asking
- [X] I had searched in the feature and found no similar feature requirement.
Description
In org.apache.seatunnel.engine.client.job.JobProxy#waitForJobComplete() we use jobFuture to monitor the Job run state and called jobFuture.get() to wait the job complete. I think we need output the job's log when we are waiting for the job to complete.
The job run logs is created in JobMaster, The JobMaster is run is the master node of the cluster. In JobMaster we use the ILogger to create logs, ILogger is the Hazelcast component. And from the Hazelcast document I found that , we may could use https://docs.hazelcast.com/hazelcast/5.1/maintain-cluster/logging#listening-to-logging-events to output the JobMaster logs in Client.
Usage Scenario
No response
Related issues
No response
Are you willing to submit a PR?
- [ ] Yes I am willing to submit a PR!
Code of Conduct
- [X] I agree to follow this project's Code of Conduct
Is it possible to output logs at the granularity of jobs or pipelines? This is difficult to debug if multiple jobs output the same log.
Is it possible to output logs at the granularity of jobs or pipelines? This is difficult to debug if multiple jobs output the same log.
Yes, I think we can filter the job logs use the jobid. And we must add some format when the logs create in JobMaster
@hailin0 Are you interested in completing this feature?
@EricJoy2048 please assign to me
This issue has been automatically marked as stale because it has not had recent activity for 30 days. It will be closed in next 7 days if no further activity occurs.
![github-actions[bot] avatar](https://avatars.githubusercontent.com/in/15368?v=4 "Published by a pub.dev verified publisher"){kind=small}
This issue has been closed because it has not received response for too long time. You could reopen it if you encountered similar problems in the future.
