bireme

bireme copied to clipboard

- feat: support table sync not in public schema - fix: support the timestamp field type(long) - fix: scheduler thread stuck in an endless loop, CPU 100% - fix: remove...

cobolbaby

如果Transformer/Merger/Loader线程执行较慢，那Kafka Offset就迟迟不能提交。 这种情况下，应该会造成重复消费到同样的数据吧。具体见如下代码: https://github.com/HashDataInc/bireme/blob/9cfc128230e7a718394132d9a51ec7d1019d08be/src/main/java/cn/hashdata/bireme/pipeline/KafkaPipeLine.java#L44-L51 Ps: 看来bireme只能依赖主键做兜底了。

cobolbaby

postgres执行DELETE操作时brieme报以下错误： ``` 16:47:20 ERROR Debezium-debezium1-debezium1.public.test_s - Stack Trace: cn.hashdata.bireme.BiremeException: Transform failed. at cn.hashdata.bireme.Dispatcher.dispatch(Dispatcher.java:60) ~[bireme-2.0.0-alpha-1.jar:?] at cn.hashdata.bireme.pipeline.PipeLine.startDispatch(PipeLine.java:150) [bireme-2.0.0-alpha-1.jar:?] at cn.hashdata.bireme.pipeline.PipeLine.executePipeline(PipeLine.java:106) [bireme-2.0.0-alpha-1.jar:?] at cn.hashdata.bireme.pipeline.PipeLine.call(PipeLine.java:87) [bireme-2.0.0-alpha-1.jar:?] at cn.hashdata.bireme.pipeline.PipeLine.call(PipeLine.java:39) [bireme-2.0.0-alpha-1.jar:?] at java.util.concurrent.FutureTask.run(FutureTask.java:266) [?:1.8.0_212] at...

LittleWuCoding

Update GetPrimaryKeys.java

1

主键和表初始化检查时，解决只能使用public schema的问题

sunguofeng

When we delete a record on source , the Bireme service stops and has the below error. 15:39:32 INFO Provider debezium1 - Provider debezium1 Start. 15:48:16 FATAL Dispatcher - Dispatcher...

pandikirushnan

怎样设置同步ddl，比如 alter table tbName add/drop columnNm...

1

lingfengzui

lingfengzui

source：mongodb4.0 use debezium，already load data into kafka ,and output stand json but in bireme into greenplum ,raise the error: > 4:59:14 INFO Bireme - start Bireme daemon. 14:59:14 INFO Bireme...

jameswangcnbj

从debezium解析的mongo数据中获得的格式： "{\"_id\": \"087a33ee-75a8-4eda-8d3b-ccfdff2e1855\",\"caseId\": 17476973}" 运行bireme的时候报json格式错误,bireme能在解析的时候处理吗

jameswangcnbj

bire2.0支持mongo配置吗

5

源mongdodb，目的greenplum config.properties > data_source = debezium debezium.type = debezium debezium.namespace = mongotest debezium.kafka.server = 127.0.0.1:9092 debezium.kafka.groupid = bireme 数据已经在kafka中，topic是mongotest.case.test 启动报错，错误信息 > cn.hashdata.bireme.BiremeException: error occurs in this way! at cn.hashdata.bireme.Bireme.getTableInfo(Bireme.java:117) ~[bireme-2.0.0-alpha-1.jar:?]...

jameswangcnbj