seatunnel
seatunnel copied to clipboard
[Bug] [resource-isolation] separated-cluster-deployment, When starting the worker, specify group=platform, and when submitting the job, specify tag_filter, which is also group=platform, but cannot be matched.
Search before asking
- [X] I had searched in the issues and found no similar issues.
What happened
separated-cluster-deployment, When starting the worker, specify group=platform, and when submitting the job, specify tag_filter, which is also group=platform, but cannot be matched. So I solved it and will submit a PR later.
SeaTunnel Version
2.3.6
SeaTunnel Config
hazelcast-worker.yaml config:
hazelcast:
cluster-name: seatunnel
network:
join:
tcp-ip:
enabled: true
member-list:
- localhost:5801
- localhost:5802
port:
auto-increment: true
port: 5802
properties:
hazelcast.invocation.max.retry.count: 20
hazelcast.tcp.join.port.try.count: 30
hazelcast.logging.type: log4j2
hazelcast.operation.generic.thread.count: 50
hazelcast.heartbeat.failuredetector.type: phi-accrual
hazelcast.heartbeat.interval.seconds: 2
hazelcast.max.no.heartbeat.seconds: 180
hazelcast.heartbeat.phiaccrual.failuredetector.threshold: 10
hazelcast.heartbeat.phiaccrual.failuredetector.sample.size: 200
hazelcast.heartbeat.phiaccrual.failuredetector.min.std.dev.millis: 100
member-attributes:
group:
type: string
value: platform
Running Command
localhost:5801/hazelcast/rest/maps/submit-job
{
"env": {
"execution.parallelism": 2,
"checkpoint.interval": 100000,
"job.mode": "STREAMING",
"tag_filter": {
"group": "platform"
}
},
"source": [
{
"plugin_name": "FakeSource",
"result_table_name ": "fake",
"row.num": 100,
"schema": {
"fields": {
"name": "string",
"age": "int"
}
}
}
],
"sink": [
{
"source_table_name": "fake",
"plugin_name": "Console"
}
]
}
Error Exception
ERROR [.e.s.r.AbstractResourceManager] [seatunnel-coordinator-service-6266] - No matched worker with tag filter {group=platform}.
Zeta or Flink or Spark Version
zeta
Java or Scala Version
1.8.0_311
Screenshots
No response
Are you willing to submit PR?
- [X] Yes I am willing to submit a PR!
Code of Conduct
- [X] I agree to follow this project's Code of Conduct