kafka-benchmark icon indicating copy to clipboard operation
kafka-benchmark copied to clipboard

Running Kafka consumer

Open stephenlee86 opened this issue 5 years ago • 1 comments

Consumer and producer benchmarks were executed on different nodes. The producer benchmark executes fine but the consumer benchmark doesn't halt or show any output. I reduced the message limit but that doesnt have any impact. Any idea?

Below is the output.

kafka-benchmark# kafka-benchmark consumer config/base_consumer.yaml 10B_100MB
kafka-benchmark# kafka-benchmark producer config/base_producer.yaml 10B_bursts
Scenario: 10B_bursts, repeat 5 times, 10 seconds pause after each
* Produced 20000000 messages (190.735 MB) in 17.409 seconds using 6 threads
    1148831 messages/s
    10.956 MB/s
* Produced 20000000 messages (190.735 MB) in 17.135 seconds using 6 threads
    1167202 messages/s
    11.131 MB/s
* Produced 20000000 messages (190.735 MB) in 17.563 seconds using 6 threads
    1138758 messages/s
    10.860 MB/s
* Produced 20000000 messages (190.735 MB) in 17.238 seconds using 6 threads
    1160227 messages/s
    11.065 MB/s
* Produced 20000000 messages (190.735 MB) in 17.135 seconds using 6 threads
    1167202 messages/s
    11.131 MB/s
Average: 1156323 messages/s, 11.028 MB/s

stephenlee86 avatar Aug 20 '18 17:08 stephenlee86