kafka-ui icon indicating copy to clipboard operation
kafka-ui copied to clipboard

BE: Serde: Support mm2 topics serdes

Open fallen-up opened this issue 1 year ago • 0 comments

Issue submitter TODO list

  • [X] I've searched for an already existing issues here
  • [X] I'm running a supported version of the application which is listed here and the feature is not present there

Is your proposal related to a problem?

No response

Describe the feature you're interested in

mirrormaker2 has some service topics in a special format, since kafka version 2.7.0 it is now possible to view them manually. It would be great if kafka-ui could do this too.

documentation: https://cwiki.apache.org/confluence/display/KAFKA/KIP-597%3A+MirrorMaker2+internal+topics+Formatters https://github.com/apache/kafka/pull/8604

examples: HeartbeatFormatter: ./bin/kafka-console-consumer.sh --bootstrap-server localhost:9092 --topic heartbeats --formatter org.apache.kafka.connect.mirror.formatters.HeartbeatFormatter --from-beginning Heartbeat{sourceClusterAlias=B, targetClusterAlias=A, timestamp=1588502119726}

CheckpointFormatter: ./bin/kafka-console-consumer.sh --bootstrap-server localhost:9093 --topic A.checkpoints.internal --formatter org.apache.kafka.connect.mirror.formatters.CheckpointFormatter --from-beginning Checkpoint{consumerGroupId=qwert, topicPartition=A.heartbeat, upstreamOffset=631, downstreamOffset=631, metatadata=}

OffsetSyncFormatter: ./bin/kafka-console-consumer.sh --bootstrap-server localhost:9092 --topic mm2-offset-syncs.B.internal --formatter org.apache.kafka.connect.mirror.formatters.OffsetSyncFormatter --from-beginning OffsetSync{topicPartition=heartbeat-0, upstreamOffset=0, downstreamOffset=0}

Describe alternatives you've considered

No response

Version you're running

1.0.0

Additional context

No response

fallen-up avatar Jun 13 '24 15:06 fallen-up