AutoMQ
[Good First Issue] Add Consumer Percentage Control for Catch-up Reading in Performance Test
Background
AutoMQ provides the automq-perf-test.sh script to test performance under different scenarios. Currently, it supports testing "catch-up read" (cold read) scenarios by:
- Sending a batch of messages.
- Delaying consumption until messages have accumulated for a specified period.
- Observing consumption throughput and its impact on producers.
However, the current implementation starts all consumers simultaneously, which does not reflect real-world scenarios where only a subset of topics experience catch-up reads at the same time.
Required Changes
Add a new optional command-line argument (e.g., --consumers-during-catchup) to the automq-perf-test.sh script to control the num of consumers activated during catch-up read scenarios.
Link not working.
Add command-line argument here? Where is the logic for controlling the num of consumers activated?
Link not working.
Add command-line argument here? Where is the logic for controlling the num of consumers activated?
The link has been updated.
You can check the logic related to consumers during performance testing in the org.apache.kafka.tools.automq.perf.ConsumerService.
