benchmark

benchmark copied to clipboard

I'm trying to understand how to run this benchmark, so I have installed Kafka (2.13-3.8.0) on my Ubuntu machine and started it as follows:

kafka-storage.sh format -t $KAFKA_CLUSTER_ID -c config/kraft/server.properties
kafka-server-start.sh config/kraft/server.properties

config/kraft/server.properties is a default configuration provided in the Kafka distribution.

I then run the benchmark as follows with --drivers kafka-exactly-once.yaml and simple-workload.yaml, and I've further modified the workload to run for only 1min instead of 5.

After a bunch of information is printed by the benchmark, it displays lines like the following every 10 seconds:

17:10:27.939 [pool-2-thread-1] INFO KafkaTopicCreator - Created topics 0/1

Eventually I get a line like this:

17:15:18.032 [kafka-admin-client-thread | adminclient-1] INFO NetworkClient - [AdminClient clientId=adminclient-1] Node -1 disconnected.

Then it continues with lines about Created topics 0/1.

I don't know if it's not managing to create a topic or something, and I don't know what to expect of a normal benchmark execution. I assume the benchmark is connecting fine to my Kafka deployment since, if I kill Kafka, the benchmark starts complaining. It complains also if I specify the wrong port in the kafka-exactly-once.yaml configuration.

Could you help me figure our what could be going wrong?