rocketmq-externals icon indicating copy to clipboard operation
rocketmq-externals copied to clipboard

[rocketmq-replicator] Realize consumption offset synchronization

Open Git-Yang opened this issue 3 years ago • 3 comments

  1. Please describe the feature you are requesting.
  • Provide MetaSinkTask, call MetaSinkTask in WorkerDirectTask to write data directly to the target cluster.
  • In MetaSinkTask, the updateConsumeOffset method will be called to update the target cluster consumeOffset.
  1. Provide any additional detail on your proposed use case for this feature.
  • #824
  1. Indicate the importance of this issue to you (blocker, must-have, should-have, nice-to-have). Are you currently using any workarounds to address this issue?
  • should-have
  1. If there are some sub-tasks using -[] for each subtask and create a corresponding issue to map to the sub task:
  • Maintain BrokerName mapping(ISSUE has not been submitted)
  • Maintain the ConsumeOffset deviation between the target cluster and the source cluster(ISSUE has not been submitted)

Git-Yang avatar Oct 27 '21 03:10 Git-Yang

@lizhiboo Hello, do you think the above implementation is not in line with the original intention of the community design? Can I have a brief conversation with you?

Git-Yang avatar Oct 27 '21 12:10 Git-Yang

@lizhiboo Hello, do you think the above implementation is not in line with the original intention of the community design? Can I have a brief conversation with you?

My apologize, I think all tasks is finished.

lizhiboo avatar Nov 02 '21 09:11 lizhiboo

rocketmq-connect already has an independent repository, you can go to this repository to submit PR, issue. https://github.com/apache/rocketmq-connect

odbozhou avatar Apr 22 '22 05:04 odbozhou