porter icon indicating copy to clipboard operation
porter copied to clipboard

不能同步数据的问题

Open kingtiger2 opened this issue 6 years ago • 0 comments

环境: task配置: taskId=102 nodeId=7e0ec95b-a870-4bc3-93e7-d57759daa789 consumer.consumerName=JdbcFetch consumer.source.clientType=JDBCConsume consumer.source.url=jdbc:mysql://192.168.1.144:3307/ds_data?useUnicode=true&characterEncoding=utf8&useSSL=false consumer.source.userName=root consumer.source.password=123456 consumer.source.table.0.table=ds_data.t_test consumer.source.table.0.incrementColumn=id consumer.source.table.0.timestampColumn=ts consumer.source.table.0.timestampColumnCast=unix_timestamp(ts)*1000

loader.loaderName=JdbcMultiThread #loader.loaderName=JdbcBatch loader.source.clientType=JDBC loader.source.url=jdbc:mysql://192.168.1.144:3307/target_data?useUnicode=true&characterEncoding=utf8&useSSL=false loader.source.userName=root loader.source.password=123456

mapper[0].schema=ds_data,target_data mapper[0].table=t_test,t_test

日志:

2019-06-27 17:22:13.217 INFO 12834 --- [TaskWork-[taskId:102]-[consumer:ds_data.t_test]-main] c.v.m.porter.task.worker.TaskWork : 从注册中心拉取任务状态信息[102-ds_data.t_test] 2019-06-27 17:22:13.220 INFO 12834 --- [TaskWork-[taskId:102]-[consumer:ds_data.t_test]-main] c.v.m.porter.task.worker.TaskWork : 启动StageJob[102-ds_data.t_test] 2019-06-27 17:22:13.220 INFO 12834 --- [TaskWork-[taskId:102]-[consumer:ds_data.t_test]-main] c.v.m.p.common.client.AbstractClient : starting 2019-06-27 17:22:13.284 INFO 12834 --- [TaskWork-[taskId:102]-[consumer:ds_data.t_test]-main] c.v.m.p.common.client.AbstractClient : already start! 2019-06-27 17:22:13.286 INFO 12834 --- [TaskWork-[taskId:102]-[consumer:ds_data.t_test]-main] c.v.m.p.common.client.AbstractClient : starting 2019-06-27 17:22:13.287 INFO 12834 --- [TaskWork-[taskId:102]-[consumer:ds_data.t_test]-main] c.v.m.p.common.client.AbstractClient : already start! 2019-06-27 17:22:13.288 INFO 12834 --- [TaskWork-[taskId:102]-[consumer:ds_data.t_test]-main] c.v.m.porter.task.worker.TaskWork : 开始获取任务消费泳道[102-ds_data.t_test]上次同步点 2019-06-27 17:22:13.290 INFO 12834 --- [TaskWork-[taskId:102]-[consumer:ds_data.t_test]-main] c.v.m.porter.task.worker.TaskWork : 获取任务消费泳道[102-ds_data.t_test]上次同步点->,通知SelectJob 2019-06-27 17:22:13.309 INFO 12834 --- [TaskWork-[taskId:102]-[consumer:ds_data.t_test]-main] c.v.m.porter.task.worker.TaskWork : 计算任务消费泳道[102-ds_data.t_test]最终同步点->[{"incrementColumn":"ID","table":"DS_DATA.T_TEST","timestampColumn":"TS"}],通知SelectJob 2019-06-27 17:22:13.313 INFO 12834 --- [TaskWork-[taskId:102]-[consumer:ds_data.t_test]-main] c.v.m.porter.task.worker.TaskWork : 任务信号量[102-ds_data.t_test]:TRANSMIT 2019-06-27 17:22:13.446 INFO 12834 --- [suixingpay-13-JdbcConsumeClient-fetch-pool-0] com.alibaba.druid.pool.DruidDataSource : {dataSource-1} inited 2019-06-27 17:22:13.861 INFO 12834 --- [suixingpay-13-JdbcConsumeClient-fetch-pool-0] c.v.m.p.p.c.jdbc.client.JdbcClient : schema:ds_data,table:t_test,detail:{"columns":[{"name":"name","primaryKey":false,"required":false,"typeCode":12},{"name":"id","primaryKey":true,"required":true,"typeCode":4},{"name":"ts","primaryKey":false,"required":false,"typeCode":93}],"noPrimaryKey":false,"schemaName":"ds_data","tableName":"t_test"}

kingtiger2 avatar Jun 27 '19 09:06 kingtiger2