chunjun
chunjun copied to clipboard
A data integration framework
### Search before asking - [X] I had searched in the [issues](https://github.com/DTStack/chunjun/issues) and found no similar question. - [X] I had googled my question but i didn't get any help....
### Search before asking - [X] I had searched in the [issues](https://github.com/DTStack/chunjun/issues) and found no similar issues. ### What happened 我在使用postgresql增量同步时发现了下面的int4类型报错。 ``` 2023-06-27 16:34:35.549 [main] INFO com.dtstack.chunjun.util.PluginUtil - ChunJun executionMode:...
### Search before asking - [X] I had searched in the [issues](https://github.com/DTStack/chunjun/issues) and found no similar issues. ### What happened 一: 参数设置如下 argsList.add("-remoteChunJunDistDir"); argsList.add("hdfs://nameHAservice/user/badmin/ruitest/usrlib/chunjun-dist"); 即使我填写是hdfs地址,但是这段远程代码只能判断本地的jar是否存在,而不能判断远程的jar是否存在。导致后续一系列的问题 二:后面我通过设置yarn.provided.usrlib.dir 参数来解决这个无法配置远程chunjun包的问题 stringBuilder .append("{") .append("\"execution.target\":\"yarn-per-job\"")...
### Search before asking - [X] I had searched in the [issues](https://github.com/DTStack/chunjun/issues) and found no similar issues. ### What happened 当我想采用 binlog文件名 + 索引位 消费数据的数据,配置不生效,是我的配置有问题吗?目前官网文档不全 ### 我的配置信息如下: ```json { "job":...
时间精度问题
### Search before asking - [X] I had searched in the [issues](https://github.com/DTStack/chunjun/issues) and found no similar issues. ### What happened 目前项目上使用 时间戳当作增量字段【startLocation】,同步dm数据,当同步2009年9月9号之前的数据的时候,项目报错: ```txt Unknown time unit:startLocation=xxxxxxxxxx ``` 经查验源代码中有如下逻辑,代码位置 `com.dtstack.chunjun.connector.jdbc.util.JdbcUtil#getMillis` 代码如下:...
### Search before asking - [X] I had searched in the [issues](https://github.com/DTStack/chunjun/issues) and found no similar issues. ### What happened 看到之前的issue已经处理过这样的问题,https://github.com/DTStack/chunjun/pull/1450; 我的代码已经是1.12最新的代码,重新拉的新项目; 在运行mysql-clickhouse是时是没问题的; 运行clickhouse-clickhouse报空指针: ### What you expected to happen...
### Search before asking - [ ] I had searched in the [issues](https://github.com/DTStack/chunjun/issues) and found no similar question. - [ ] I had googled my question but i didn't get...
### Search before asking - [X] I had searched in the [issues](https://github.com/DTStack/chunjun/issues) and found no similar issues. ### What happened 问题: flinkSQL kafka-sink可以消费topic数据,hive sink接收到数据,但是往hdfs上写入文件时,一直为空,即使强制刷新,.data文件一直为空  问题代码:  执行SQL: CREATE TABLE...
## Purpose of this pull request 解决JdbcUtil格式化时间戳转换为毫秒和提取纳秒的精度问题,修改为默认单位为毫秒,不再进行多余的判断,因为无法判断传入的时间戳是什么类型的 ## Which issue you fix Fixes # (1699). ## Checklist: - [ yes ] I have executed the **'mvn spotless:apply'** command to format...
### Search before asking - [ ] I had searched in the [issues](https://github.com/DTStack/chunjun/issues) and found no similar question. - [ ] I had googled my question but i didn't get...