kcat icon indicating copy to clipboard operation
kcat copied to clipboard

i am getting this error(failed to acquire meta data) and not able to fix it.please help me

Open rishavjaiswal opened this issue 5 years ago • 23 comments

issue issue2

rishavjaiswal avatar May 21 '19 06:05 rishavjaiswal

try enabling debugging to see what is going on: kafkacat -L -b kafka-1:19092 -d broker

edenhill avatar May 21 '19 06:05 edenhill

i got this...what does it mean and how to get rid of it newissue

rishavjaiswal avatar May 21 '19 06:05 rishavjaiswal

What is your version of kafkacat and librdkafka? kafkacat -V

nit: It'd be good if you could paste the output as text (within backtick quotes for formatting) rather than screenshots.

edenhill avatar May 21 '19 06:05 edenhill

lucky@lucky-Inspiron-N4010:~/kafkacluster$ kafkacat -v Error: -b <broker,..> missing

Usage: kafkacat [file1 file2 ..] kafkacat - Apache Kafka producer and consumer tool https://github.com/edenhill/kafkacat Copyright (c) 2014-2015, Magnus Edenhill Version KAFKACAT_VERSION (JSON) (librdkafka 0.11.1)

rishavjaiswal avatar May 21 '19 07:05 rishavjaiswal

thats the output

rishavjaiswal avatar May 21 '19 07:05 rishavjaiswal

That looks really old. Upgrade both librdkafka and kafkacat. Easiest way is to remove kafkacat from your system, then download the kafkacat source code and follow the bootstrap instructions: https://github.com/edenhill/kafkacat#quick-build

edenhill avatar May 21 '19 07:05 edenhill

https://github.com/edenhill/kafkacat kafkacat.c is the source code for it?

rishavjaiswal avatar May 21 '19 09:05 rishavjaiswal

https://github.com/edenhill/kafkacat/archive/1.4.0.tar.gz

edenhill avatar May 21 '19 09:05 edenhill

Follow the instructions here: https://github.com/edenhill/kafkacat#quick-build

edenhill avatar May 21 '19 09:05 edenhill

after running ./bootstrap.sh whats next?

rishavjaiswal avatar May 21 '19 09:05 rishavjaiswal

if bootstrap.sh succeeds you should have a kafkacat binary in the current directory, try: ./kafkacat -V

edenhill avatar May 21 '19 09:05 edenhill

after running ./bootstrap.sh i got output as : ...... ... .. kafkacat.o format.o tools.o json.o -o kafkacat -L/usr/local/lib -lm -ldl -lpthread -lrt -Wl,-Bstatic -lyajl -Wl,-Bdynamic tmp-bootstrap/usr/local/lib/librdkafka.a -L/usr/local/lib -lm -ldl -lpthread -lrt
/usr/bin/ld: cannot find -lyajl collect2: error: ld returned 1 exit status mklove/Makefile.base:150: recipe for target 'kafkacat' failed make: *** [kafkacat] Error 1

rishavjaiswal avatar May 21 '19 09:05 rishavjaiswal

Then there must have been a previous error as well. Please scan the output of bootstrap.sh for errors and paste them here.

What version of ubuntu are you using?

edenhill avatar May 21 '19 10:05 edenhill

i am using ubuntu 16.04

output of bootstrap.sh is:

lucky@lucky-Inspiron-N4010:~/kafkacluster/kafkacat-1.4.0$ ./bootstrap.sh Directory librdkafka already exists, not downloading https://github.com/edenhill/librdkafka/archive/master.tar.gz Directory libyajl already exists, not downloading https://github.com/lloyd/yajl/archive/master.tar.gz Building librdkafka make[1]: Entering directory '/home/lucky/kafkacluster/kafkacat-1.4.0/tmp-bootstrap/librdkafka/src' Checking librdkafka integrity librdkafka.so.1 OK librdkafka.a OK Symbol visibility OK make[1]: Leaving directory '/home/lucky/kafkacluster/kafkacat-1.4.0/tmp-bootstrap/librdkafka/src' make[1]: Entering directory '/home/lucky/kafkacluster/kafkacat-1.4.0/tmp-bootstrap/librdkafka/src-cpp' Creating shared library librdkafka++.so.1 gcc -shared -Wl,-soname,librdkafka++.so.1 RdKafka.o ConfImpl.o HandleImpl.o ConsumerImpl.o ProducerImpl.o KafkaConsumerImpl.o TopicImpl.o TopicPartitionImpl.o MessageImpl.o HeadersImpl.o QueueImpl.o MetadataImpl.o -o librdkafka++.so.1 -L../src -lrdkafka -lstdc++ Checking librdkafka++ integrity librdkafka++.so.1 OK librdkafka++.a OK make[1]: Leaving directory '/home/lucky/kafkacluster/kafkacat-1.4.0/tmp-bootstrap/librdkafka/src-cpp' make -C examples make[1]: Entering directory '/home/lucky/kafkacluster/kafkacat-1.4.0/tmp-bootstrap/librdkafka/examples' make[1]: Nothing to be done for 'all'. make[1]: Leaving directory '/home/lucky/kafkacluster/kafkacat-1.4.0/tmp-bootstrap/librdkafka/examples' Checking integrity CONFIGURATION.md OK examples/rdkafka_example OK examples/rdkafka_performance OK examples/rdkafka_example_cpp OK make[1]: Entering directory '/home/lucky/kafkacluster/kafkacat-1.4.0/tmp-bootstrap/librdkafka/src' Checking librdkafka integrity librdkafka.so.1 OK librdkafka.a OK Symbol visibility OK make[1]: Leaving directory '/home/lucky/kafkacluster/kafkacat-1.4.0/tmp-bootstrap/librdkafka/src' make[1]: Entering directory '/home/lucky/kafkacluster/kafkacat-1.4.0/tmp-bootstrap/librdkafka/src-cpp' Creating shared library librdkafka++.so.1 gcc -shared -Wl,-soname,librdkafka++.so.1 RdKafka.o ConfImpl.o HandleImpl.o ConsumerImpl.o ProducerImpl.o KafkaConsumerImpl.o TopicImpl.o TopicPartitionImpl.o MessageImpl.o HeadersImpl.o QueueImpl.o MetadataImpl.o -o librdkafka++.so.1 -L../src -lrdkafka -lstdc++ Checking librdkafka++ integrity librdkafka++.so.1 OK librdkafka++.a OK make[1]: Leaving directory '/home/lucky/kafkacluster/kafkacat-1.4.0/tmp-bootstrap/librdkafka/src-cpp' make[1]: Entering directory '/home/lucky/kafkacluster/kafkacat-1.4.0/tmp-bootstrap/librdkafka/src' Install librdkafka to /home/lucky/kafkacluster/kafkacat-1.4.0/tmp-bootstrap//usr/local install -d $DESTDIR/usr/local/include/librdkafka &&
install -d $DESTDIR/usr/local/lib &&
install rdkafka.h $DESTDIR/usr/local/include/librdkafka &&
install librdkafka.a $DESTDIR/usr/local/lib &&
install librdkafka.so.1 $DESTDIR/usr/local/lib &&
[ -f "rdkafka.pc" ] && (
install -d $DESTDIR/usr/local/lib/pkgconfig &&
install -m 0644 rdkafka.pc $DESTDIR/usr/local/lib/pkgconfig
) &&
[ -f "rdkafka-static.pc" ] && (
install -d $DESTDIR/usr/local/lib/pkgconfig &&
install -m 0644 rdkafka-static.pc $DESTDIR/usr/local/lib/pkgconfig
) &&
(cd $DESTDIR/usr/local/lib && ln -sf librdkafka.so.1 librdkafka.so) make[1]: Leaving directory '/home/lucky/kafkacluster/kafkacat-1.4.0/tmp-bootstrap/librdkafka/src' make[1]: Entering directory '/home/lucky/kafkacluster/kafkacat-1.4.0/tmp-bootstrap/librdkafka/src-cpp' Install librdkafka++ to /home/lucky/kafkacluster/kafkacat-1.4.0/tmp-bootstrap//usr/local install -d $DESTDIR/usr/local/include/librdkafka &&
install -d $DESTDIR/usr/local/lib &&
install rdkafkacpp.h $DESTDIR/usr/local/include/librdkafka &&
install librdkafka++.a $DESTDIR/usr/local/lib &&
install librdkafka++.so.1 $DESTDIR/usr/local/lib &&
[ -f "rdkafka++.pc" ] && (
install -d $DESTDIR/usr/local/lib/pkgconfig &&
install -m 0644 rdkafka++.pc $DESTDIR/usr/local/lib/pkgconfig
) &&
[ -f "rdkafka++-static.pc" ] && (
install -d $DESTDIR/usr/local/lib/pkgconfig &&
install -m 0644 rdkafka++-static.pc $DESTDIR/usr/local/lib/pkgconfig
) &&
(cd $DESTDIR/usr/local/lib && ln -sf librdkafka++.so.1 librdkafka++.so) make[1]: Leaving directory '/home/lucky/kafkacluster/kafkacat-1.4.0/tmp-bootstrap/librdkafka/src-cpp' Build of librdkafka SUCCEEDED! Building libyajl == removing old build files == running CMake in build directory ./configure: 41: ./configure: cmake: not found The "cmake" program is required to configure yajl. It's available from most ports/packaging systems and http://cmake.org Build of libyajl FAILED! Failed to build libyajl: JSON support will probably be disabled Building kafkacat Using -L/usr/local/lib -lm -ldl -lpthread -lrt for rdkafka Using for yajl using cache file config.cache checking for OS or distribution... ok (Ubuntu) checking for C compiler from CC env... failed checking for gcc (by command)... ok (cached) checking executable ld... ok (cached) checking executable nm... ok (cached) checking executable objdump... ok (cached) checking executable strip... ok (cached) checking for pkgconfig (by command)... ok (cached) checking for install (by command)... ok (cached) checking for rdkafka (by pkg-config)... ok checking for rdkafka (by compile)... ok (cached) checking for librdkafka metadata API... ok (cached) checking for librdkafka KafkaConsumer support... ok (cached) checking for yajl (by pkg-config)... ok checking for yajl (by compile)... ok (cached) Generated Makefile.config Generated config.h

Configuration summary: prefix /usr/local ARCH x86_64 CPU generic MKL_APP_NAME
MKL_APP_DESC_ONELINE
MKL_DISTRO Ubuntu SOLIB_EXT .so CC gcc LD ld NM nm OBJDUMP objdump STRIP strip CPPFLAGS -Itmp-bootstrap/usr/local/include -g -O2 -Wall -Wsign-compare -Wfloat-equal -Wpointer-arith -Wcast-align PKG_CONFIG pkg-config INSTALL install LDFLAGS_STATIC -Wl,-Bstatic LDFLAGS_DYNAMIC -Wl,-Bdynamic HAS_LDFLAGS_STATIC y KAFKACAT_VERSION 1.4.0 CFLAGS -I/usr/include/yajl LIBS -Wl,-Bstatic -lyajl -Wl,-Bdynamic tmp-bootstrap/usr/local/lib/librdkafka.a -L/usr/local/lib -lm -ldl -lpthread -lrt
ENABLE_KAFKACONSUMER y ENABLE_JSON y exec_prefix /usr/local bindir /usr/local/bin sbindir /usr/local/sbin libexecdir /usr/local/libexec datadir /usr/local/share sysconfdir /usr/local/etc sharedstatedir /usr/local/com localstatedir /usr/local/var libdir /usr/local/lib includedir /usr/local/include infodir /usr/local/info mandir /usr/local/man Generated config.cache

Now type 'make' to build gcc -MD -MP -Itmp-bootstrap/usr/local/include -Itmp-bootstrap/usr/local/include -g -O2 -Wall -Wsign-compare -Wfloat-equal -Wpointer-arith -Wcast-align -I/usr/include/yajl -c kafkacat.c -o kafkacat.o mgcc -MD -MP -Itmp-bootstrap/usr/local/include -Itmp-bootstrap/usr/local/include -g -O2 -Wall -Wsign-compare -Wfloat-equal -Wpointer-arith -Wcast-align -I/usr/include/yajl -c format.c -o format.o gcc -MD -MP -Itmp-bootstrap/usr/local/include -Itmp-bootstrap/usr/local/include -g -O2 -Wall -Wsign-compare -Wfloat-equal -Wpointer-arith -Wcast-align -I/usr/include/yajl -c tools.c -o tools.o akegcc -MD -MP -Itmp-bootstrap/usr/local/include -Itmp-bootstrap/usr/local/include -g -O2 -Wall -Wsign-compare -Wfloat-equal -Wpointer-arith -Wcast-align -I/usr/include/yajl -c json.c -o json.o Creating program kafkacat gcc -Itmp-bootstrap/usr/local/include -Itmp-bootstrap/usr/local/include -g -O2 -Wall -Wsign-compare -Wfloat-equal -Wpointer-arith -Wcast-align kafkacat.o format.o tools.o json.o -o kafkacat -L/usr/local/lib -lm -ldl -lpthread -lrt -Wl,-Bstatic -lyajl -Wl,-Bdynamic tmp-bootstrap/usr/local/lib/librdkafka.a -L/usr/local/lib -lm -ldl -lpthread -lrt
/usr/bin/ld: cannot find -lyajl collect2: error: ld returned 1 exit status mklove/Makefile.base:150: recipe for target 'kafkacat' failed make: *** [kafkacat] Error 1 lucky@lucky-Inspiron-N4010:~/kafkacluster/kafkacat-1.4.0$ ./bootstrap.sh Directory librdkafka already exists, not downloading https://github.com/edenhill/librdkafka/archive/master.tar.gz Directory libyajl already exists, not downloading https://github.com/lloyd/yajl/archive/master.tar.gz Building librdkafka make[1]: Entering directory '/home/lucky/kafkacluster/kafkacat-1.4.0/tmp-bootstrap/librdkafka/src' Checking librdkafka integrity librdkafka.so.1 OK librdkafka.a OK Symbol visibility OK make[1]: Leaving directory '/home/lucky/kafkacluster/kafkacat-1.4.0/tmp-bootstrap/librdkafka/src' make[1]: Entering directory '/home/lucky/kafkacluster/kafkacat-1.4.0/tmp-bootstrap/librdkafka/src-cpp' Creating shared library librdkafka++.so.1 gcc -shared -Wl,-soname,librdkafka++.so.1 RdKafka.o ConfImpl.o HandleImpl.o ConsumerImpl.o ProducerImpl.o KafkaConsumerImpl.o TopicImpl.o TopicPartitionImpl.o MessageImpl.o HeadersImpl.o QueueImpl.o MetadataImpl.o -o librdkafka++.so.1 -L../src -lrdkafka -lstdc++ Checking librdkafka++ integrity librdkafka++.so.1 OK librdkafka++.a OK make[1]: Leaving directory '/home/lucky/kafkacluster/kafkacat-1.4.0/tmp-bootstrap/librdkafka/src-cpp' make -C examples make[1]: Entering directory '/home/lucky/kafkacluster/kafkacat-1.4.0/tmp-bootstrap/librdkafka/examples' make[1]: Nothing to be done for 'all'. make[1]: Leaving directory '/home/lucky/kafkacluster/kafkacat-1.4.0/tmp-bootstrap/librdkafka/examples' Checking integrity CONFIGURATION.md OK examples/rdkafka_example OK examples/rdkafka_performance OK examples/rdkafka_example_cpp OK make[1]: Entering directory '/home/lucky/kafkacluster/kafkacat-1.4.0/tmp-bootstrap/librdkafka/src' Checking librdkafka integrity librdkafka.so.1 OK librdkafka.a OK Symbol visibility OK make[1]: Leaving directory '/home/lucky/kafkacluster/kafkacat-1.4.0/tmp-bootstrap/librdkafka/src' make[1]: Entering directory '/home/lucky/kafkacluster/kafkacat-1.4.0/tmp-bootstrap/librdkafka/src-cpp' Creating shared library librdkafka++.so.1 gcc -shared -Wl,-soname,librdkafka++.so.1 RdKafka.o ConfImpl.o HandleImpl.o ConsumerImpl.o ProducerImpl.o KafkaConsumerImpl.o TopicImpl.o TopicPartitionImpl.o MessageImpl.o HeadersImpl.o QueueImpl.o MetadataImpl.o -o librdkafka++.so.1 -L../src -lrdkafka -lstdc++ Checking librdkafka++ integrity librdkafka++.so.1 OK librdkafka++.a OK make[1]: Leaving directory '/home/lucky/kafkacluster/kafkacat-1.4.0/tmp-bootstrap/librdkafka/src-cpp' make[1]: Entering directory '/home/lucky/kafkacluster/kafkacat-1.4.0/tmp-bootstrap/librdkafka/src' Install librdkafka to /home/lucky/kafkacluster/kafkacat-1.4.0/tmp-bootstrap//usr/local install -d $DESTDIR/usr/local/include/librdkafka &&
install -d $DESTDIR/usr/local/lib &&
install rdkafka.h $DESTDIR/usr/local/include/librdkafka &&
install librdkafka.a $DESTDIR/usr/local/lib &&
install librdkafka.so.1 $DESTDIR/usr/local/lib &&
[ -f "rdkafka.pc" ] && (
install -d $DESTDIR/usr/local/lib/pkgconfig &&
install -m 0644 rdkafka.pc $DESTDIR/usr/local/lib/pkgconfig
) &&
[ -f "rdkafka-static.pc" ] && (
install -d $DESTDIR/usr/local/lib/pkgconfig &&
install -m 0644 rdkafka-static.pc $DESTDIR/usr/local/lib/pkgconfig
) &&
(cd $DESTDIR/usr/local/lib && ln -sf librdkafka.so.1 librdkafka.so) make[1]: Leaving directory '/home/lucky/kafkacluster/kafkacat-1.4.0/tmp-bootstrap/librdkafka/src' make[1]: Entering directory '/home/lucky/kafkacluster/kafkacat-1.4.0/tmp-bootstrap/librdkafka/src-cpp' Install librdkafka++ to /home/lucky/kafkacluster/kafkacat-1.4.0/tmp-bootstrap//usr/local install -d $DESTDIR/usr/local/include/librdkafka &&
install -d $DESTDIR/usr/local/lib &&
install rdkafkacpp.h $DESTDIR/usr/local/include/librdkafka &&
install librdkafka++.a $DESTDIR/usr/local/lib &&
install librdkafka++.so.1 $DESTDIR/usr/local/lib &&
[ -f "rdkafka++.pc" ] && (
install -d $DESTDIR/usr/local/lib/pkgconfig &&
install -m 0644 rdkafka++.pc $DESTDIR/usr/local/lib/pkgconfig
) &&
[ -f "rdkafka++-static.pc" ] && (
install -d $DESTDIR/usr/local/lib/pkgconfig &&
install -m 0644 rdkafka++-static.pc $DESTDIR/usr/local/lib/pkgconfig
) &&
(cd $DESTDIR/usr/local/lib && ln -sf librdkafka++.so.1 librdkafka++.so) make[1]: Leaving directory '/home/lucky/kafkacluster/kafkacat-1.4.0/tmp-bootstrap/librdkafka/src-cpp' Build of librdkafka SUCCEEDED! Building libyajl == removing old build files == running CMake in build directory ./configure: 41: ./configure: cmake: not found The "cmake" program is required to configure yajl. It's available from most ports/packaging systems and http://cmake.org Build of libyajl FAILED! Failed to build libyajl: JSON support will probably be disabled Building kafkacat Using -L/usr/local/lib -lm -ldl -lpthread -lrt for rdkafka Using for yajl using cache file config.cache checking for OS or distribution... ok (Ubuntu) checking for C compiler from CC env... failed checking for gcc (by command)... ok (cached) checking executable ld... ok (cached) checking executable nm... ok (cached) checking executable objdump... ok (cached) checking executable strip... ok (cached) checking for pkgconfig (by command)... ok (cached) checking for install (by command)... ok (cached) checking for rdkafka (by pkg-config)... ok checking for rdkafka (by compile)... ok (cached) checking for librdkafka metadata API... ok (cached) checking for librdkafka KafkaConsumer support... ok (cached) checking for yajl (by pkg-config)... ok checking for yajl (by compile)... ok (cached) Generated Makefile.config Generated config.h

Configuration summary: prefix /usr/local ARCH x86_64 CPU generic MKL_APP_NAME
MKL_APP_DESC_ONELINE
MKL_DISTRO Ubuntu SOLIB_EXT .so CC gcc LD ld NM nm OBJDUMP objdump STRIP strip CPPFLAGS -Itmp-bootstrap/usr/local/include -g -O2 -Wall -Wsign-compare -Wfloat-equal -Wpointer-arith -Wcast-align PKG_CONFIG pkg-config INSTALL install LDFLAGS_STATIC -Wl,-Bstatic LDFLAGS_DYNAMIC -Wl,-Bdynamic HAS_LDFLAGS_STATIC y KAFKACAT_VERSION 1.4.0 CFLAGS -I/usr/include/yajl LIBS -Wl,-Bstatic -lyajl -Wl,-Bdynamic tmp-bootstrap/usr/local/lib/librdkafka.a -L/usr/local/lib -lm -ldl -lpthread -lrt
ENABLE_KAFKACONSUMER y ENABLE_JSON y exec_prefix /usr/local bindir /usr/local/bin sbindir /usr/local/sbin libexecdir /usr/local/libexec datadir /usr/local/share sysconfdir /usr/local/etc sharedstatedir /usr/local/com localstatedir /usr/local/var libdir /usr/local/lib includedir /usr/local/include infodir /usr/local/info mandir /usr/local/man Generated config.cache

Now type 'make' to build gcc -MD -MP -Itmp-bootstrap/usr/local/include -Itmp-bootstrap/usr/local/include -g -O2 -Wall -Wsign-compare -Wfloat-equal -Wpointer-arith -Wcast-align -I/usr/include/yajl -c kafkacat.c -o kafkacat.o gcc -MD -MP -Itmp-bootstrap/usr/local/include -Itmp-bootstrap/usr/local/include -g -O2 -Wall -Wsign-compare -Wfloat-equal -Wpointer-arith -Wcast-align -I/usr/include/yajl -c format.c -o format.o gcc -MD -MP -Itmp-bootstrap/usr/local/include -Itmp-bootstrap/usr/local/include -g -O2 -Wall -Wsign-compare -Wfloat-equal -Wpointer-arith -Wcast-align -I/usr/include/yajl -c tools.c -o tools.o gcc -MD -MP -Itmp-bootstrap/usr/local/include -Itmp-bootstrap/usr/local/include -g -O2 -Wall -Wsign-compare -Wfloat-equal -Wpointer-arith -Wcast-align -I/usr/include/yajl -c json.c -o json.o Creating program kafkacat gcc -Itmp-bootstrap/usr/local/include -Itmp-bootstrap/usr/local/include -g -O2 -Wall -Wsign-compare -Wfloat-equal -Wpointer-arith -Wcast-align kafkacat.o format.o tools.o json.o -o kafkacat -L/usr/local/lib -lm -ldl -lpthread -lrt -Wl,-Bstatic -lyajl -Wl,-Bdynamic tmp-bootstrap/usr/local/lib/librdkafka.a -L/usr/local/lib -lm -ldl -lpthread -lrt
/usr/bin/ld: cannot find -lyajl collect2: error: ld returned 1 exit status mklove/Makefile.base:150: recipe for target 'kafkacat' failed make: *** [kafkacat] Error 1

rishavjaiswal avatar May 21 '19 14:05 rishavjaiswal

./configure: 41: ./configure: cmake: not found

You need to install cmake (sudo apt install cmake). Please follow the instructions previously given.

edenhill avatar May 21 '19 14:05 edenhill

./kafkacat -V ran succesfully.

output is kafkacat - Apache Kafka producer and consumer tool https://github.com/edenhill/kafkacat Copyright (c) 2014-2017, Magnus Edenhill Version 1.4.0 (JSON) (librdkafka 1.0.0 builtin.features=snappy,sasl,regex,lz4,sasl_plain,plugins)

rishavjaiswal avatar May 21 '19 16:05 rishavjaiswal

after runnung kafkacat -L -b kafka-1:19092 -d broker i got this:-

%7|1558461714.621|BRKMAIN|rdkafka#producer-1| [thrd::0/internal]: :0/internal: Enter main broker thread %7|1558461714.621|BROKER|rdkafka#producer-1| [thrd:app]: kafka-1:19092/bootstrap: Added new broker with NodeId -1 %7|1558461714.621|STATE|rdkafka#producer-1| [thrd::0/internal]: :0/internal: Broker changed state INIT -> UP %7|1558461714.621|BRKMAIN|rdkafka#producer-1| [thrd:kafka-1:19092/bootstrap]: kafka-1:19092/bootstrap: Enter main broker thread %7|1558461714.621|CONNECT|rdkafka#producer-1| [thrd:kafka-1:19092/bootstrap]: kafka-1:19092/bootstrap: broker in state INIT connecting %7|1558461714.622|CONNECT|rdkafka#producer-1| [thrd:kafka-1:19092/bootstrap]: kafka-1:19092/bootstrap: Connecting to ipv4#192.168.1.231:19092 (plaintext) with socket 7 %7|1558461714.622|STATE|rdkafka#producer-1| [thrd:kafka-1:19092/bootstrap]: kafka-1:19092/bootstrap: Broker changed state INIT -> CONNECT % ERROR: Failed to acquire metadata: Local: Broker transport failure

rishavjaiswal avatar May 21 '19 18:05 rishavjaiswal

Seems like it is not able to connect to the broker in due time (5s). Can you connect to the broker with telnet kafka-1 9092 ?

edenhill avatar May 21 '19 18:05 edenhill

after trying with telnet

Trying 192.168.1.231... telnet: Unable to connect to remote host: Connection timed out

rishavjaiswal avatar May 21 '19 18:05 rishavjaiswal

./kafkacat -V says this version: kafkacat - Apache Kafka producer and consumer tool https://github.com/edenhill/kafkacat Copyright (c) 2014-2017, Magnus Edenhill Version 1.4.0 (JSON) (librdkafka 1.0.0 builtin.features=snappy,sasl,regex,lz4,sasl_plain,plugins)

whereas when i am running kafkacat -V its showing : kafkacat: invalid option -- 'V' Error: unknown argument

Usage: kafkacat [file1 file2 ..] kafkacat - Apache Kafka producer and consumer tool https://github.com/edenhill/kafkacat Copyright (c) 2014-2015, Magnus Edenhill Version KAFKACAT_VERSION (JSON) (librdkafka 0.11.1)

rishavjaiswal avatar May 21 '19 18:05 rishavjaiswal

Trying 192.168.1.231...
telnet: Unable to connect to remote host: Connection timed out

So that's your problem, your broker can't be reached, for whatever reason: no route to broker, broker host being down, firewall/filtering, etc.

edenhill avatar May 21 '19 18:05 edenhill

i stopped firewall but i am still not getting please tell me what to do

rishavjaiswal avatar May 22 '19 03:05 rishavjaiswal

I'm sorry but it is impossible for me to troubleshoot your networking / cluster / infra problems. Please reach out to your operations team.

edenhill avatar May 22 '19 20:05 edenhill