chunjun

chunjun copied to clipboard

http connector的使用说明

2

提供了http connector，但没有具体的使用说明文档，希望能够在文档里面完善补充下。 两个具体问题： 1、现在是默认每隔3s去调用一次接口嘛？ ``` 2022-03-07 16:08:09.078 [Legacy Source Thread - Source: httpsourcefactory -> Sink: streamsinkfactory (1/1)#0] INFO com.dtstack.flinkx.connector.stream.util.TablePrintUtil - +-------------------------------------------------------------------------------------+ | col0 | +-------------------------------------------------------------------------------------+ | {"date":"03-07-2022","milliseconds_since_epoch":1646640488971,"time":"08:08:08 AM"} | +-------------------------------------------------------------------------------------+...

tmljob

oracle logminer 实时采集 到kafka 报错

1

{"root-exception":"org.apache.flink.runtime.JobException: Recovery is suppressed by FailureRateRestartBackoffTimeStrategy(FailureRateRestartBackoffTimeStrategy(failuresIntervalMS=60000,backoffTimeMS=1000,maxFailuresPerInterval=2) at org.apache.flink.runtime.executiongraph.failover.flip1.ExecutionFailureHandler.handleFailure(ExecutionFailureHandler.java:118) at org.apache.flink.runtime.executiongraph.failover.flip1.ExecutionFailureHandler.getFailureHandlingResult(ExecutionFailureHandler.java:80) at org.apache.flink.runtime.scheduler.DefaultScheduler.handleTaskFailure(DefaultScheduler.java:233) at org.apache.flink.runtime.scheduler.DefaultScheduler.maybeHandleTaskFailure(DefaultScheduler.java:224) at org.apache.flink.runtime.scheduler.DefaultScheduler.updateTaskExecutionStateInternal(DefaultScheduler.java:215) at org.apache.flink.runtime.scheduler.SchedulerBase.updateTaskExecutionState(SchedulerBase.java:666) at org.apache.flink.runtime.scheduler.SchedulerNG.updateTaskExecutionState(SchedulerNG.java:89) at org.apache.flink.runtime.jobmaster.JobMaster.updateTaskExecutionState(JobMaster.java:446) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at...

Saltingfish

自定义flink jobId，如果传了jobId 就用指定的jobId,如果没传就使用flink自动生成的jobId

1

自定义flink jobId，如果传了jobId 就用指定的jobId,如果没传就使用flink自动生成的jobId

shaolei7788

[feat][connectors redis]redis sink key根据业务需要添加前缀

2

在redis的sink配置中添加prefix字段，类型为string，写入sink的数据的key能够根据有无这个前缀决定是否加上，如果加上，则key为原来的key前面加上前缀以及分隔符。

jefftlin

怎么让一个产品经理看懂这个并且融入到产品设计中去呢？

2

如题，对 chunjun 很感兴趣，但太懂代码，希望手上的产品数据采集可以用上 chunjun ，我该怎么做呢？

yaoleifly

**Describe the bug** try to read mysql and write to hdfs in parquet type batch model , mysql have decimal(10,2) type ,if I define this in mysqlreader got Unsupported type...

lordk911

## General Question { "fields": [ { "javaObject": "xxx", "binarySection": { "segments": [ { "heapMemory": [ 49, 50, 48, 55, 48, 54, 57, 53 ], "address": 16, "addressLimit": 24, "size":...

murongpingtian

binlogreader <==>kafkasink ,filter过滤无效，报Caused by: java.lang.IllegalArgumentException: user has not select privilege on [ "xxx." ]

2

 { "job": { "content": [{ "reader": { "name": "binlogreader", "parameter": { "cat": "insert,update,delete", "filter": "canal\\.test.*", "host": "192.168.1.211", "jdbcUrl": "jdbc:mysql://192.168.1.211:3309/xxx?characterEncoding=UTF-8&useSSL=false", "password": "root", "pavingData": false, "port": 3309, "splitUpdate": false, "table": [""],...

pual-wei

standalone模式启动flink，提交flinkx任务，在重启flink后任务未恢复

1

standalone启动，flink配置如下 state.backend: filesystem state.checkpoints.dir: file:///data/flink-checkpoints state.savepoints.dir: file:///data/flink-savepoints

codingxmh

chunjun kudu json filter 过滤条件怎么使用有用例或文档吗？文档中这个链接已经无法访问了。 https://docs.kudu.com/manual/crud/#read-operations

jctanking