chunjun icon indicating copy to clipboard operation
chunjun copied to clipboard

A data integration framework

Results 293 chunjun issues
Sort by recently updated
recently updated
newest added

### Search before asking - [ ] I had searched in the [issues](https://github.com/DTStack/chunjun/issues) and found no similar question. - [ ] I had googled my question but i didn't get...

bug

flinkx-connector-kafka: Could not resolve dependencies for project com.dtstack.flinkx:flinkx-connector-kafka:jar:1.12-SNAPSHOT: Failure to find com.pingcap.ticdc.cdc:ticdc-decoder:jar:5.2.0-SNAPSHOT in https://github.com/dtstack/maven-repository/raw/master/ was cached in the local repository, resolution will not be reattempted until the update interval of...

### Search before asking - [X] I had searched in the [issues](https://github.com/DTStack/chunjun/issues) and found no similar issues. ### What happened 0,环境: chunjun版本:v1.12.5(2022-07-25发布的) source(oracle 12c)-->sink(greenplum 6.16.0,对应postgresql 9.4.24) 1,问题: json:mode insert时,正常同步数据;update模式时,报错: Caused...

bug

**Describe the bug** 当source或reader并行度>1,轮询读取数据时(例如:MySQL),第一个切片的InputFormat中会重复读取数据。 **Screenshots** Chunjun Master分支代码中当source或reader并行度>1,轮询读取数据(例如:MySQL)时,会出现数据重复读取的情况。例如:设置mysql source的并行度为2时,mysql指定表此时只有2条数据,但是在Flink web UI中可以很明显的看见数据读取量不正确,经控制台打印分析,只有第一个子任务会重复读取数据: ![image](https://user-images.githubusercontent.com/51312128/175223790-08995fa0-4fe2-469f-a21b-85228d5a5b02.png) ![image](https://user-images.githubusercontent.com/51312128/175223811-1dadd79e-994d-4759-aa10-a6d1793ea612.png) ![image](https://user-images.githubusercontent.com/51312128/175223827-5e515abf-f0ef-4199-96f3-90c7b330f665.png)

bug

### Search before asking - [x] I had searched in the [issues](https://github.com/DTStack/chunjun/issues) and found no similar question. - [x] I had googled my question but i didn't get any help....

question

**Describe the bug** 背景: 测试使用binlog-x插件读取数据源端Mysql数据表中数据,获取mysql实时增量数据,同步写入Sink目标端Clickhouse中。 执行脚本如下: ${CHUNJUN_HOME}/bin/start-chunjun -mode local -jobType sync -job /xxx_job.json -chunjunDistDir ${CHUNJUN_HOME}/ xxx_job.json内容具体如下: { "job" : { "content" : [ { "reader" : { "parameter" : {...

bug

当实现增量实时数据Sink到Clickhouse中时,根据rowKind类型值执行相关语义操作, 而clickhouse的 DELETE 与UPDATE_BEFORE 具体实现代码为空。 因此当执行数据更新操作时,将update拆分成update_before 和update_after,对于update_before则采用delete,update_after则采用insert。 ## Which issue you fix [issue 1037](https://github.com/DTStack/chunjun/issues/1037)

### Search before asking - [X] I had searched in the [issues](https://github.com/DTStack/chunjun/issues) and found no similar question. - [ ] I had googled my question but i didn't get any...

question

### Search before asking - [X] I had searched in the [issues](https://github.com/DTStack/chunjun/issues) and found no similar issues. ### What happened I am using sql job to get data from sqlserver....

bug
good first issue