chunjun issues

如何贡献代码

3

## Development Task 1、chunjun1.12 已经修复hive无法指定分区 2、chunjun1.12已经扩展hive读 3、chunjun1.12已经扩展robbitmq

biandou1313

enhancement

Add prefix in redis sink key to adapt the business

1

--- name: "Feature request" about: As a user, I want to request a New Feature on the product title: Add prefix in redis sink key to adapt the business labels:...

jefftlin

feature-request

[feat-755]Add prefix in redis sink key to adapt the business

We can config our redis key with what we like to describe to identify our business by setting a field called “keyPrefix” in redis conf. [755](https://github.com/DTStack/chunjun/issues/755)

jefftlin

master分支，yarnper模式报错 files does not exist

脚本： java -cp /opt/chunjun/lib/* com.dtstack.chunjun.client.Launcher -mode yarn-per-job -jobType sync -job /opt/chunjun/chunjun-examples/json/stream/stream.json -chunjunDistDir chunjun-dist -flinkConfDir /opt/chunjun/flinkconf -hadoopConfDir /opt/chunjun/hadoopconf -flinkLibDir /opt/chunjun/flinklib -confProp "{\"flink.checkpoint.interval\":60000,\"yarn.application.queue\":\"default\"}" 报错摘要： File file:/home/flink/.flink/application_1653375620246_0033/chunjun-connector-stream-master.jar does not exist 报错日志： Application application_1653375620246_0033...

753972506

可否提供docker hub [docker image]

1

**Is your feature request related to a problem? Please describe.** A clear and concise description of what the problem is. Ex. I'm always frustrated when [...] **Describe the solution you'd...

TrumanDu

feature-request

读取ftp数据的时候会报错

4

读取ftp数据的时候，FtpSourceFactory#createSource，ftpConfig.setColumn 每个FieldConf的index为null，会导致FtpInputFormat#nextRecordInternal 里的分支永远不会执行，需要修改一下将图1的图片改为 ftpConfig.setColumn(syncConf.getReader().getFieldList());

shaolei7788

bug

读取mysql数据写到hbase时报异常

3

mysql表字段是int类型在jdbc阶段转为BigDecimalColumn ，但是在hbase写入阶段又没有对应的类型，就会抛异常

shaolei7788

bug

同时设置增量字段和切分键，切分键会被增量字段覆盖

1

com.dtstack.chunjun.connector.jdbc.source.JdbcInputFormatBuilder#checkFormat `if (conf.isIncrement()) { if (StringUtils.isBlank(conf.getIncreColumn())) { sb.append("increColumn can't be empty when increment is true;\n"); } **conf.setSplitPk(conf.getIncreColumn());** if (conf.getParallelism() > 1) { conf.setSplitStrategy("mod"); } }`

liugddx