seatunnel icon indicating copy to clipboard operation
seatunnel copied to clipboard

[Bug] [jdbc] 任务会卡主

Open 13813586515 opened this issue 1 year ago • 0 comments

Search before asking

  • [X] I had searched in the issues and found no similar issues.

What happened

使用ds来调度st,任务会卡住,导致定时跑的任务无法继续

SeaTunnel Version

2.3.6

SeaTunnel Config

env {
  parallelism = 10
  job.mode = "BATCH"
}

source {
    Jdbc {
        driver = com.microsoft.sqlserver.jdbc.SQLServerDriver
        url = "jdbc:sqlserver://192.168.0.123:1433;databaseName=BSERP3_LP"
        user = sa
        password = "123"
        # Define query logic as required
      table_list = [
        {
          table_path = "BSERP3_LP.dbo.fjsx9"
          # Use query filetr rows & columns
          query = "select * from BSERP3_LP.dbo.fjsx9 "
        }
        
    ]

    }
}

 

sink {
  Doris {
    fenodes = "192.168.0.168:8030,192.168.0.169:8030,192.168.0.170:8030"
    username = root
    password = "123"
    database = "ods_bs"
    table = "ods_${table_name}"
    # 保证每个文件唯一,拷贝之后文件需要修改此处
    sink.label-prefix = "bs-product-${table_name}-jdbc"
    sink.enable-2pc = "true"
    # sink.enable-delete = "true"
    save_mode_create_template="CREATE TABLE IF NOT EXISTS `${database}`.`${table_name}` (${rowtype_fields},dt datetime(0) default current_timestamp(0) on update current_timestamp(0)) ENGINE=OLAP UNIQUE KEY (SXDM) DISTRIBUTED BY HASH (SXDM) BUCKETS 3 PROPERTIES ( \"replication_allocation\" = \"tag.location.default: 1\",\"in_memory\" = \"false\",\"storage_format\" = \"V2\", \"disable_auto_compaction\" = \"false\")"
    doris.config {
      format = "json"
      read_json_by_line = "true"
    }
  }
}

Running Command

集群

Error Exception

任务卡主不动

Zeta or Flink or Spark Version

No response

Java or Scala Version

No response

Screenshots

image image image

Are you willing to submit PR?

  • [ ] Yes I am willing to submit a PR!

Code of Conduct

13813586515 avatar Aug 21 '24 10:08 13813586515