chunjun
chunjun copied to clipboard
DTStack
A data integration framework
详见附件。 [hive_sink_kerberos配置报错.docx](https://github.com/DTStack/chunjun/files/8924909/hive_sink_kerberos.docx)
**Describe the bug** A clear and concise description of what the bug is. **To Reproduce** Steps to reproduce the behavior: 1. Go to '...' 2. Click on '....' 3. Scroll...
polling featre optimization,when set polling value true, we need to check increColumn must not null
Kudu output-format writeSingleRecordInternal failed. java.lang.ClassCastException: org.apache.flink.table.data.GenericRowData cannot be cast to com.dtstack.flinkx.element.ColumnRowData at com.dtstack.flinkx.connector.kudu.sink.KuduOutputFormat.writeSingleRecordInternal(KuduOutputFormat.java:77) at com.dtstack.flinkx.sink.format.BaseRichOutputFormat.writeSingleRecord(BaseRichOutputFormat.java:486) at com.dtstack.flinkx.sink.format.BaseRichOutputFormat.writeRecord(BaseRichOutputFormat.java:246) at com.dtstack.flinkx.sink.format.BaseRichOutputFormat.writeRecord(BaseRichOutputFormat.java:85) at com.dtstack.flinkx.sink.DtOutputFormatSinkFunction.invoke(DtOutputFormatSinkFunction.java:117) at org.apache.flink.streaming.api.operators.StreamSink.processElement(StreamSink.java:54) com.dtstack.flinkx.connector.kudu.converter.KuduColumnConverter.java 77 line val converter ColumnRowData.
使用发现，kafkareader仅支持简单的json类型，且json中字段名称还要与要写往rdb中的字段一致才行，无法通过配置rdb字段与kafka json数据中的字段的映射关系来解析json。 同时text类型，也无法针对csv, tsv等格式进行字段关系映射。 希望能够添加对这些数据格式的支持，而不仅仅是只能同步原始数据的
1、构建失败 ` [ERROR] Failed to execute goal pl.project13.maven:git-commit-id-plugin:2.2.6:revision (default) on project flinkx-parent: Execution default of goal pl.project13.maven:git-commit-id-plugin:2.2.6:revision failed: A required class was missing while executing pl.project13.maven:git-commit-id-plugin:2.2.6:revision: com/fasterxml/jackson/core/type/TypeReference` 2、启动失败 `java.io.FileNotFoundException: File...
JSON脚本: ``` { "job": { "content": [ { "reader": { "parameter": { "jdbcUrl": "jdbc:oracle:thin:@192.168.147.128:1521:helowin", "username": "qyj", "password": "qyj", "supportAutoAddLog": false, "table": [ "QYJ.test_01" ], "cat": "UPDATE,INSERT,DELETE", "pavingData": true, "readPosition": "CURRENT",...
