seatunnel icon indicating copy to clipboard operation
seatunnel copied to clipboard

[Bug] [Module Name] flink使用start_mode = "timestamp"无效

Open xuefengshuai opened this issue 1 year ago • 0 comments

Search before asking

  • [X] I had searched in the issues and found no similar issues.

What happened

使用flink同步kafka到hive,

SeaTunnel Version

2.3.6

SeaTunnel Config

env {
  parallelism =1 
  job.mode = "BATCH"
}
source {
  Kafka {
    schema = {
      fields {
        test = "string"
      }
    }
    format = json
    topic = "test"
    format_error_handle_way = "skip"
    bootstrap.servers = "***:**"
    kafka.config = {
      client.id = client_1
      max.poll.records = 500
      start_mode = "timestamp"
      start_mode.timestamp="1724658555000"
      enable.auto.commit = "false"
      format_error_handle_way = "skip"
    }
  }  
}

sink {
    Hive {
    table_name = "data_ods.test"
    metastore_uri = "*"
  }
}

Running Command

/opt/apache-seatunnel-2.3.6/bin/start-seatunnel-flink-15-connector-v2.sh --config test --deploy-mode run --target yarn-per-job

Error Exception

Zeta or Flink or Spark Version

flink1.16.2

Java or Scala Version

1.8

Screenshots

No response

Are you willing to submit PR?

  • [X] Yes I am willing to submit a PR!

Code of Conduct

xuefengshuai avatar Aug 27 '24 07:08 xuefengshuai