seatunnel
seatunnel copied to clipboard
[Bug] [jdbc] 任务会卡主
Search before asking
- [X] I had searched in the issues and found no similar issues.
What happened
使用ds来调度st,任务会卡住,导致定时跑的任务无法继续
SeaTunnel Version
2.3.6
SeaTunnel Config
env {
parallelism = 10
job.mode = "BATCH"
}
source {
Jdbc {
driver = com.microsoft.sqlserver.jdbc.SQLServerDriver
url = "jdbc:sqlserver://192.168.0.123:1433;databaseName=BSERP3_LP"
user = sa
password = "123"
# Define query logic as required
table_list = [
{
table_path = "BSERP3_LP.dbo.fjsx9"
# Use query filetr rows & columns
query = "select * from BSERP3_LP.dbo.fjsx9 "
}
]
}
}
sink {
Doris {
fenodes = "192.168.0.168:8030,192.168.0.169:8030,192.168.0.170:8030"
username = root
password = "123"
database = "ods_bs"
table = "ods_${table_name}"
# 保证每个文件唯一,拷贝之后文件需要修改此处
sink.label-prefix = "bs-product-${table_name}-jdbc"
sink.enable-2pc = "true"
# sink.enable-delete = "true"
save_mode_create_template="CREATE TABLE IF NOT EXISTS `${database}`.`${table_name}` (${rowtype_fields},dt datetime(0) default current_timestamp(0) on update current_timestamp(0)) ENGINE=OLAP UNIQUE KEY (SXDM) DISTRIBUTED BY HASH (SXDM) BUCKETS 3 PROPERTIES ( \"replication_allocation\" = \"tag.location.default: 1\",\"in_memory\" = \"false\",\"storage_format\" = \"V2\", \"disable_auto_compaction\" = \"false\")"
doris.config {
format = "json"
read_json_by_line = "true"
}
}
}
Running Command
集群
Error Exception
任务卡主不动
Zeta or Flink or Spark Version
No response
Java or Scala Version
No response
Screenshots
Are you willing to submit PR?
- [ ] Yes I am willing to submit a PR!
Code of Conduct
- [X] I agree to follow this project's Code of Conduct