jocko
jocko copied to clipboard
Various errors when testing with kafkacat
This is what I did:
- Terminal 1:
createtopic --topic=logs; jocko
- Terminal 2:
kafkacat -P -b 127.0.0.1:9092 -t logs -p 0
- Terminal 3:
kafkacat -C -b 127.0.0.1:9092 -t logs -p 0
I am sometimes able to send messages, but it is crashing on me with various errors:
% Reached end of topic logs [0] at offset 2
% ERROR: Topic logs [0] error: Message at offset 2 is too large to fetch, try increasing receive.message.max.bytes
%3|1490267581.359|FAIL|rdkafka#consumer-1| [thrd:127.0.0.1:9092/bootstrap]: 127.0.0.1:9092/bootstrap: Receive failed: Disconnected
%5|1490267581.359|FAIL|rdkafka#consumer-1| [thrd:127.0.0.1:9092/bootstrap]: 127.0.0.1:9092/bootstrap: Connection closed
% ERROR: Local: Broker transport failure: 127.0.0.1:9092/bootstrap: Receive failed: Disconnected
% ERROR: Local: Broker transport failure: 127.0.0.1:9092/bootstrap: Connection closed
and similar.
I'm doing a similar test, I'm not getting any errors but lots of debug messages like this :
2017-03-30 16:02:20 [DEBUG] jocko: correlation id [23], request size [26], key [3]
2017-03-30 16:02:21 [DEBUG] jocko: correlation id [24], request size [26], key [3]
2017-03-30 16:02:22 [DEBUG] jocko: correlation id [25], request size [26], key [3]
2017-03-30 16:02:23 [DEBUG] jocko: correlation id [26], request size [26], key [3]
2017-03-30 16:02:24 [DEBUG] jocko: correlation id [27], request size [26], key [3]
And I don't get any messages on the consumer. Can we have a simple working getting started tutorial ?
I'm suffering exactly these errors on latest master, as well as various issues with another (sarama based) client. I've been entirely unable to get anything except examples/sarama/main.go
working.
This is because kafkacat
is asking for APIVersions (key:18) which is not implemented at the time.
See: https://github.com/travisjeffery/jocko/blob/master/server/server.go#L139
kafkacat -C -b 127.0.0.1:9092 -t test_topic
%3|1509902328.974|PROTOERR|rdkafka#consumer-1| [thrd:127.0.0.1:9092/bootstrap]: 127.0.0.1:9092/1: Remaining data after message set parse: 164 bytes
%3|1509902329.076|PROTOERR|rdkafka#consumer-1| [thrd:127.0.0.1:9092/bootstrap]: 127.0.0.1:9092/1: Protocol parse failure at 4/168 (rd_kafka_fetch_reply_handle:2749) (incorrect broker.version.fallback?)