inlong icon indicating copy to clipboard operation
inlong copied to clipboard

[Feature] Add TubeMQ Command Tools

Open dockerzhang opened this issue 3 years ago • 4 comments

Description

like tubectl, we can create/delete topic, produce/consume message.

Use case

No response

Are you willing to submit PR?

  • [ ] Yes, I am willing to submit a PR!

Code of Conduct

dockerzhang avatar Jul 11 '22 08:07 dockerzhang

@dockerzhang Hi,I want to do this task.

DavidYoungdj avatar Jul 22 '22 15:07 DavidYoungdj

Purpose

Add TubeMQ command tools like the kafka command tools.We can create/delete the topics,produce/consume the message.

Plan

About creating / deleting a topic

  1. Set parameters to add / remove topics based on the type of parameter passed in.
  2. Call the client's code to create the admin of the client
  3. Check whether the partitions are correct and handle other exceptions. For example, the partitions must be greater than 0
  4. Make the network request and have the server of the Controller role accept the request processing logic
  5. Perform calibration check
  6. The data is stored in the master node

Generating / consume information

  • Producer
  1. Set necessary parameters, such as obtaining server metadata, conditions for successfully writing data, and retry times
  2. Create TubeMQproducer
  3. Determine the topic, key, and message body to send
  4. Send the message
  • Consumer
  1. If the topic is empty, the exception is handled. Otherwise, the subscription status is reset and the subscription information and metadata are updated
  2. Ensuring thread Safety
  3. It can communicate with Cluster, register Consumer with Coordinator, and pull and update metadata
  4. Sends all requests to be sent and processes all received responses

DavidYoungdj avatar Aug 01 '22 12:08 DavidYoungdj

@DavidYoungdj do you still work on this issue?

dockerzhang avatar Sep 19 '22 08:09 dockerzhang

Sorry for that I'm not work on this issue.I need to focus on my course now.

------------------ 原始邮件 ------------------ 发件人: "apache/inlong" @.>; 发送时间: 2022年9月19日(星期一) 下午4:34 @.>; 抄送: "骑马与砍杀@@.@.>; 主题: Re: [apache/inlong] [Feature] Add TubeMQ Command Tools (Issue #4972)

@DavidYoungdj do you still work on this issue?

— Reply to this email directly, view it on GitHub, or unsubscribe. You are receiving this because you were mentioned.Message ID: @.***>

DavidYoungdj avatar Sep 19 '22 09:09 DavidYoungdj

This issue is stale because it has been open for 60 days with no activity.

github-actions[bot] avatar Nov 19 '22 02:11 github-actions[bot]