seatunnel icon indicating copy to clipboard operation
seatunnel copied to clipboard

[Bug] [resource-isolation] separated-cluster-deployment, When starting the worker, specify group=platform, and when submitting the job, specify tag_filter, which is also group=platform, but cannot be matched.

Open chenqianwen opened this issue 6 months ago • 0 comments

Search before asking

  • [X] I had searched in the issues and found no similar issues.

What happened

separated-cluster-deployment, When starting the worker, specify group=platform, and when submitting the job, specify tag_filter, which is also group=platform, but cannot be matched. So I solved it and will submit a PR later.

SeaTunnel Version

2.3.6

SeaTunnel Config

hazelcast-worker.yaml config:
hazelcast:
  cluster-name: seatunnel
  network:
    join:
      tcp-ip:
        enabled: true
        member-list:
          - localhost:5801
          - localhost:5802
    port:
      auto-increment: true
      port: 5802
  properties:
    hazelcast.invocation.max.retry.count: 20
    hazelcast.tcp.join.port.try.count: 30
    hazelcast.logging.type: log4j2
    hazelcast.operation.generic.thread.count: 50
    hazelcast.heartbeat.failuredetector.type: phi-accrual
    hazelcast.heartbeat.interval.seconds: 2
    hazelcast.max.no.heartbeat.seconds: 180
    hazelcast.heartbeat.phiaccrual.failuredetector.threshold: 10
    hazelcast.heartbeat.phiaccrual.failuredetector.sample.size: 200
    hazelcast.heartbeat.phiaccrual.failuredetector.min.std.dev.millis: 100
  member-attributes:
    group:
      type: string
      value: platform

Running Command

localhost:5801/hazelcast/rest/maps/submit-job
{
    "env": {
        "execution.parallelism": 2,
        "checkpoint.interval": 100000,
        "job.mode": "STREAMING",
        "tag_filter": {
            "group": "platform"
        }
    },
    "source": [
        {
            "plugin_name": "FakeSource",
            "result_table_name ": "fake",
            "row.num": 100,
            "schema": {
                "fields": {
                    "name": "string",
                    "age": "int"
                }
            }
        }
    ],
    "sink": [
        {
            "source_table_name": "fake",
            "plugin_name": "Console"
        }
    ]
}

Error Exception

ERROR [.e.s.r.AbstractResourceManager] [seatunnel-coordinator-service-6266] - No matched worker with tag filter {group=platform}.

Zeta or Flink or Spark Version

zeta

Java or Scala Version

1.8.0_311

Screenshots

No response

Are you willing to submit PR?

  • [X] Yes I am willing to submit a PR!

Code of Conduct

chenqianwen avatar Aug 23 '24 04:08 chenqianwen