docker-images icon indicating copy to clipboard operation
docker-images copied to clipboard
verified publisher icon confluentinc

Schema Registry docker container exits as soon as it starts

Open guidothekp opened this issue 10 years ago • 0 comments

Hello, When I try to bring up schema registry docker instance, as per the README, the instance dies after a few seconds. This seems to be related to https://github.com/confluentinc/docker-images/issues/2, which was fixed in the build I am using.

The OS is CentOS Linux release 7.2.1511 (Core).

Here's what I did.

First, I started the docker files as per the README. I even put in a sleep of 90s to delay the schema registry to avoid the aforementioned timing issue.

docker run -d --name zookeeper -p 2181:2181 confluent/zookeeper
docker run -d --name kafka -p 9092:9092 --link zookeeper:zookeeper \
    --env KAFKA_ADVERTISED_HOST_NAME="127.0.0.1" --env KAFKA_ADVERTISED_PORT=9092 \
    confluent/kafka
sleep 90
docker run -d --name schema-registry -p 8081:8081 --link zookeeper:zookeeper \
    --link kafka:kafka confluent/schema-registry
docker run -d --name rest-proxy -p 8082:8082 --link zookeeper:zookeeper \
    --link kafka:kafka --link schema-registry:schema-registry confluent/rest-proxy

After a minute, the schema-registry simply dies. docker logs -f schema-registry shows the following:

SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/usr/share/java/confluent-common/slf4j-log4j12-1.7.6.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/usr/share/java/schema-registry/slf4j-log4j12-1.7.6.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]
[2016-04-01 06:49:27,076] INFO SchemaRegistryConfig values: 
    master.eligibility = true
    port = 8081
    kafkastore.timeout.ms = 500
    kafkastore.init.timeout.ms = 60000
    debug = false
    kafkastore.zk.session.timeout.ms = 30000
    request.logger.name = io.confluent.rest-utils.requests
    metrics.sample.window.ms = 30000
    schema.registry.zk.namespace = schema_registry
    kafkastore.topic = _schemas
    avro.compatibility.level = backward
    shutdown.graceful.ms = 1000
    response.mediatype.preferred = [application/vnd.schemaregistry.v1+json, application/vnd.schemaregistry+json, application/json]
    metrics.jmx.prefix = kafka.schema.registry
    host.name = 7bb6ad89fb64
    metric.reporters = []
    kafkastore.commit.interval.ms = -1
    kafkastore.connection.url = 172.17.2.44:2181
    metrics.num.samples = 2
    response.mediatype.default = application/vnd.schemaregistry.v1+json
    kafkastore.topic.replication.factor = 3
 (io.confluent.kafka.schemaregistry.rest.SchemaRegistryConfig:135)
[2016-04-01 06:49:27,400] INFO Initialized the consumer offset to -1 (io.confluent.kafka.schemaregistry.storage.KafkaStoreReaderThread:87)
[2016-04-01 06:49:27,797] WARN Creating the schema topic _schemas using a replication factor of 1, which is less than the desired one of 3. If this is a production environment, it's crucial to add more brokers and increase the replication factor of the topic. (io.confluent.kafka.schemaregistry.storage.KafkaStore:172)
[2016-04-01 06:49:27,854] INFO [kafka-store-reader-thread-_schemas], Starting  (io.confluent.kafka.schemaregistry.storage.KafkaStoreReaderThread:68)
[2016-04-01 06:50:27,911] ERROR Error starting the schema registry (io.confluent.kafka.schemaregistry.rest.SchemaRegistryRestApplication:57)
io.confluent.kafka.schemaregistry.exceptions.SchemaRegistryInitializationException: Error initializing kafka store while initializing schema registry
    at io.confluent.kafka.schemaregistry.storage.KafkaSchemaRegistry.init(KafkaSchemaRegistry.java:164)
    at io.confluent.kafka.schemaregistry.rest.SchemaRegistryRestApplication.setupResources(SchemaRegistryRestApplication.java:55)
    at io.confluent.kafka.schemaregistry.rest.SchemaRegistryRestApplication.setupResources(SchemaRegistryRestApplication.java:37)
    at io.confluent.rest.Application.createServer(Application.java:104)
    at io.confluent.kafka.schemaregistry.rest.Main.main(Main.java:42)
Caused by: io.confluent.kafka.schemaregistry.storage.exceptions.StoreInitializationException: io.confluent.kafka.schemaregistry.storage.exceptions.StoreException: Failed to write Noop record to kafka store.
    at io.confluent.kafka.schemaregistry.storage.KafkaStore.init(KafkaStore.java:151)
    at io.confluent.kafka.schemaregistry.storage.KafkaSchemaRegistry.init(KafkaSchemaRegistry.java:162)
    ... 4 more
Caused by: io.confluent.kafka.schemaregistry.storage.exceptions.StoreException: Failed to write Noop record to kafka store.
    at io.confluent.kafka.schemaregistry.storage.KafkaStore.getLatestOffset(KafkaStore.java:363)
    at io.confluent.kafka.schemaregistry.storage.KafkaStore.waitUntilKafkaReaderReachesLastOffset(KafkaStore.java:220)
    at io.confluent.kafka.schemaregistry.storage.KafkaStore.init(KafkaStore.java:149)
    ... 5 more

Zookeeper has the following ominous message:

OpenJDK 64-Bit Server VM warning: Cannot open file /var/log/kafka/zookeeper-gc.log due to Permission denied

[2016-04-01 06:47:56,061] INFO Reading configuration from: /etc/kafka/zookeeper.properties (org.apache.zookeeper.server.quorum.QuorumPeerConfig)
[2016-04-01 06:47:56,063] INFO autopurge.snapRetainCount set to 3 (org.apache.zookeeper.server.DatadirCleanupManager)
[2016-04-01 06:47:56,063] INFO autopurge.purgeInterval set to 0 (org.apache.zookeeper.server.DatadirCleanupManager)
[2016-04-01 06:47:56,063] INFO Purge task is not scheduled. (org.apache.zookeeper.server.DatadirCleanupManager)
[2016-04-01 06:47:56,063] WARN Either no config or no quorum defined in config, running  in standalone mode (org.apache.zookeeper.server.quorum.QuorumPeerMain)
[2016-04-01 06:47:56,076] INFO Reading configuration from: /etc/kafka/zookeeper.properties (org.apache.zookeeper.server.quorum.QuorumPeerConfig)
[2016-04-01 06:47:56,076] INFO Starting server (org.apache.zookeeper.server.ZooKeeperServerMain)
[2016-04-01 06:47:56,081] INFO Server environment:zookeeper.version=3.4.6-1569965, built on 02/20/2014 09:09 GMT (org.apache.zookeeper.server.ZooKeeperServer)
[2016-04-01 06:47:56,081] INFO Server environment:host.name=8e978e62801c (org.apache.zookeeper.server.ZooKeeperServer)
[2016-04-01 06:47:56,082] INFO Server environment:java.version=1.7.0_95 (org.apache.zookeeper.server.ZooKeeperServer)
[2016-04-01 06:47:56,082] INFO Server environment:java.vendor=Oracle Corporation (org.apache.zookeeper.server.ZooKeeperServer)
[2016-04-01 06:47:56,082] INFO Server environment:java.home=/usr/lib/jvm/java-7-openjdk-amd64/jre (org.apache.zookeeper.server.ZooKeeperServer)
[2016-04-01 06:47:56,082] INFO Server environment:java.class.path=:/usr/bin/../core/build/dependant-libs-2.10.4*/*.jar:/usr/bin/../examples/build/libs//kafka-examples*.jar:/usr/bin/../contrib/hadoop-consumer/build/libs//kafka-hadoop-consumer*.jar:/usr/bin/../contrib/hadoop-producer/build/libs//kafka-hadoop-producer*.jar:/usr/bin/../clients/build/libs/kafka-clients*.jar:/usr/bin/../libs/*.jar:/usr/bin/../share/java/kafka/jopt-simple-3.2.jar:/usr/bin/../share/java/kafka/kafka-clients-0.8.2.2.jar:/usr/bin/../share/java/kafka/kafka.jar:/usr/bin/../share/java/kafka/kafka_2.10-0.8.2.2-javadoc.jar:/usr/bin/../share/java/kafka/kafka_2.10-0.8.2.2-scaladoc.jar:/usr/bin/../share/java/kafka/kafka_2.10-0.8.2.2-sources.jar:/usr/bin/../share/java/kafka/kafka_2.10-0.8.2.2-test.jar:/usr/bin/../share/java/kafka/kafka_2.10-0.8.2.2.jar:/usr/bin/../share/java/kafka/log4j-1.2.16.jar:/usr/bin/../share/java/kafka/lz4-1.2.0.jar:/usr/bin/../share/java/kafka/metrics-core-2.2.0.jar:/usr/bin/../share/java/kafka/scala-library-2.10.4.jar:/usr/bin/../share/java/kafka/slf4j-api-1.7.6.jar:/usr/bin/../share/java/kafka/slf4j-log4j12-1.6.1.jar:/usr/bin/../share/java/kafka/snappy-java-1.1.1.7.jar:/usr/bin/../share/java/kafka/zkclient-0.3.jar:/usr/bin/../share/java/kafka/zookeeper-3.4.6.jar:/usr/bin/../core/build/libs/kafka_2.10*.jar (org.apache.zookeeper.server.ZooKeeperServer)
[2016-04-01 06:47:56,082] INFO Server environment:java.library.path=/usr/java/packages/lib/amd64:/usr/lib/x86_64-linux-gnu/jni:/lib/x86_64-linux-gnu:/usr/lib/x86_64-linux-gnu:/usr/lib/jni:/lib:/usr/lib (org.apache.zookeeper.server.ZooKeeperServer)
[2016-04-01 06:47:56,082] INFO Server environment:java.io.tmpdir=/tmp (org.apache.zookeeper.server.ZooKeeperServer)
[2016-04-01 06:47:56,082] INFO Server environment:java.compiler=<NA> (org.apache.zookeeper.server.ZooKeeperServer)
[2016-04-01 06:47:56,082] INFO Server environment:os.name=Linux (org.apache.zookeeper.server.ZooKeeperServer)
[2016-04-01 06:47:56,082] INFO Server environment:os.arch=amd64 (org.apache.zookeeper.server.ZooKeeperServer)
[2016-04-01 06:47:56,082] INFO Server environment:os.version=3.10.0-327.10.1.el7.x86_64 (org.apache.zookeeper.server.ZooKeeperServer)
[2016-04-01 06:47:56,082] INFO Server environment:user.name=confluent (org.apache.zookeeper.server.ZooKeeperServer)
[2016-04-01 06:47:56,082] INFO Server environment:user.home=/home/confluent (org.apache.zookeeper.server.ZooKeeperServer)
[2016-04-01 06:47:56,082] INFO Server environment:user.dir=/ (org.apache.zookeeper.server.ZooKeeperServer)
[2016-04-01 06:47:56,086] INFO tickTime set to 2000 (org.apache.zookeeper.server.ZooKeeperServer)
[2016-04-01 06:47:56,086] INFO minSessionTimeout set to -1 (org.apache.zookeeper.server.ZooKeeperServer)
[2016-04-01 06:47:56,086] INFO maxSessionTimeout set to -1 (org.apache.zookeeper.server.ZooKeeperServer)
[2016-04-01 06:47:56,096] INFO binding to port 0.0.0.0/0.0.0.0:2181 (org.apache.zookeeper.server.NIOServerCnxnFactory)
[2016-04-01 06:47:56,762] INFO Accepted socket connection from /172.17.2.45:38533 (org.apache.zookeeper.server.NIOServerCnxnFactory)
[2016-04-01 06:47:56,767] INFO Client attempting to establish new session at /172.17.2.45:38533 (org.apache.zookeeper.server.ZooKeeperServer)
[2016-04-01 06:47:56,769] INFO Creating new log file: log.1 (org.apache.zookeeper.server.persistence.FileTxnLog)
[2016-04-01 06:47:56,787] INFO Established session 0x153d09409ca0000 with negotiated timeout 6000 for client /172.17.2.45:38533 (org.apache.zookeeper.server.ZooKeeperServer)
[2016-04-01 06:47:56,820] INFO Got user-level KeeperException when processing sessionid:0x153d09409ca0000 type:create cxid:0x4 zxid:0x3 txntype:-1 reqpath:n/a Error Path:/brokers Error:KeeperErrorCode = NoNode for /brokers (org.apache.zookeeper.server.PrepRequestProcessor)
[2016-04-01 06:47:56,839] INFO Got user-level KeeperException when processing sessionid:0x153d09409ca0000 type:create cxid:0xa zxid:0x7 txntype:-1 reqpath:n/a Error Path:/config Error:KeeperErrorCode = NoNode for /config (org.apache.zookeeper.server.PrepRequestProcessor)
[2016-04-01 06:47:56,854] INFO Got user-level KeeperException when processing sessionid:0x153d09409ca0000 type:create cxid:0x10 zxid:0xb txntype:-1 reqpath:n/a Error Path:/admin Error:KeeperErrorCode = NoNode for /admin (org.apache.zookeeper.server.PrepRequestProcessor)
[2016-04-01 06:47:57,067] INFO Got user-level KeeperException when processing sessionid:0x153d09409ca0000 type:setData cxid:0x1a zxid:0xf txntype:-1 reqpath:n/a Error Path:/controller_epoch Error:KeeperErrorCode = NoNode for /controller_epoch (org.apache.zookeeper.server.PrepRequestProcessor)
[2016-04-01 06:47:57,114] INFO Got user-level KeeperException when processing sessionid:0x153d09409ca0000 type:delete cxid:0x29 zxid:0x11 txntype:-1 reqpath:n/a Error Path:/admin/preferred_replica_election Error:KeeperErrorCode = NoNode for /admin/preferred_replica_election (org.apache.zookeeper.server.PrepRequestProcessor)
[2016-04-01 06:49:27,311] INFO Accepted socket connection from /172.17.2.46:50163 (org.apache.zookeeper.server.NIOServerCnxnFactory)
[2016-04-01 06:49:27,313] WARN Connection request from old client /172.17.2.46:50163; will be dropped if server is in r-o mode (org.apache.zookeeper.server.ZooKeeperServer)
[2016-04-01 06:49:27,313] INFO Client attempting to establish new session at /172.17.2.46:50163 (org.apache.zookeeper.server.ZooKeeperServer)
[2016-04-01 06:49:27,314] INFO Established session 0x153d09409ca0001 with negotiated timeout 30000 for client /172.17.2.46:50163 (org.apache.zookeeper.server.ZooKeeperServer)
[2016-04-01 06:49:27,528] INFO Accepted socket connection from /172.17.2.46:50164 (org.apache.zookeeper.server.NIOServerCnxnFactory)
[2016-04-01 06:49:27,528] WARN Connection request from old client /172.17.2.46:50164; will be dropped if server is in r-o mode (org.apache.zookeeper.server.ZooKeeperServer)
[2016-04-01 06:49:27,528] INFO Client attempting to establish new session at /172.17.2.46:50164 (org.apache.zookeeper.server.ZooKeeperServer)
[2016-04-01 06:49:27,535] INFO Established session 0x153d09409ca0002 with negotiated timeout 6000 for client /172.17.2.46:50164 (org.apache.zookeeper.server.ZooKeeperServer)
[2016-04-01 06:49:27,593] INFO Got user-level KeeperException when processing sessionid:0x153d09409ca0002 type:create cxid:0x1 zxid:0x15 txntype:-1 reqpath:n/a Error Path:/consumers/schema-registry-7bb6ad89fb64-8081/ids Error:KeeperErrorCode = NoNode for /consumers/schema-registry-7bb6ad89fb64-8081/ids (org.apache.zookeeper.server.PrepRequestProcessor)
[2016-04-01 06:49:27,600] INFO Got user-level KeeperException when processing sessionid:0x153d09409ca0002 type:create cxid:0x2 zxid:0x16 txntype:-1 reqpath:n/a Error Path:/consumers/schema-registry-7bb6ad89fb64-8081 Error:KeeperErrorCode = NoNode for /consumers/schema-registry-7bb6ad89fb64-8081 (org.apache.zookeeper.server.PrepRequestProcessor)
[2016-04-01 06:49:27,689] INFO Accepted socket connection from /172.17.2.47:49313 (org.apache.zookeeper.server.NIOServerCnxnFactory)
[2016-04-01 06:49:27,691] INFO Client attempting to establish new session at /172.17.2.47:49313 (org.apache.zookeeper.server.ZooKeeperServer)
[2016-04-01 06:49:27,699] INFO Established session 0x153d09409ca0003 with negotiated timeout 30000 for client /172.17.2.47:49313 (org.apache.zookeeper.server.ZooKeeperServer)
[2016-04-01 06:49:27,813] INFO Got user-level KeeperException when processing sessionid:0x153d09409ca0001 type:setData cxid:0x7 zxid:0x1b txntype:-1 reqpath:n/a Error Path:/config/topics/_schemas Error:KeeperErrorCode = NoNode for /config/topics/_schemas (org.apache.zookeeper.server.PrepRequestProcessor)
[2016-04-01 06:49:27,816] INFO Got user-level KeeperException when processing sessionid:0x153d09409ca0001 type:create cxid:0x8 zxid:0x1c txntype:-1 reqpath:n/a Error Path:/config/topics Error:KeeperErrorCode = NodeExists for /config/topics (org.apache.zookeeper.server.PrepRequestProcessor)
[2016-04-01 06:49:27,868] INFO Got user-level KeeperException when processing sessionid:0x153d09409ca0000 type:create cxid:0x39 zxid:0x1f txntype:-1 reqpath:n/a Error Path:/brokers/topics/_schemas/partitions/0 Error:KeeperErrorCode = NoNode for /brokers/topics/_schemas/partitions/0 (org.apache.zookeeper.server.PrepRequestProcessor)
[2016-04-01 06:49:27,872] INFO Got user-level KeeperException when processing sessionid:0x153d09409ca0000 type:create cxid:0x3a zxid:0x20 txntype:-1 reqpath:n/a Error Path:/brokers/topics/_schemas/partitions Error:KeeperErrorCode = NoNode for /brokers/topics/_schemas/partitions (org.apache.zookeeper.server.PrepRequestProcessor)
[2016-04-01 06:49:27,895] INFO Got user-level KeeperException when processing sessionid:0x153d09409ca0002 type:create cxid:0x20 zxid:0x24 txntype:-1 reqpath:n/a Error Path:/consumers/schema-registry-7bb6ad89fb64-8081/owners/_schemas Error:KeeperErrorCode = NoNode for /consumers/schema-registry-7bb6ad89fb64-8081/owners/_schemas (org.apache.zookeeper.server.PrepRequestProcessor)
[2016-04-01 06:49:27,902] INFO Got user-level KeeperException when processing sessionid:0x153d09409ca0002 type:create cxid:0x21 zxid:0x25 txntype:-1 reqpath:n/a Error Path:/consumers/schema-registry-7bb6ad89fb64-8081/owners Error:KeeperErrorCode = NoNode for /consumers/schema-registry-7bb6ad89fb64-8081/owners (org.apache.zookeeper.server.PrepRequestProcessor)
[2016-04-01 06:50:28,253] WARN caught end of stream exception (org.apache.zookeeper.server.NIOServerCnxn)
EndOfStreamException: Unable to read additional data from client sessionid 0x153d09409ca0001, likely client has closed socket
    at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228)
    at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
    at java.lang.Thread.run(Thread.java:745)
[2016-04-01 06:50:28,258] INFO Closed socket connection for client /172.17.2.46:50163 which had sessionid 0x153d09409ca0001 (org.apache.zookeeper.server.NIOServerCnxn)
[2016-04-01 06:50:28,258] WARN caught end of stream exception (org.apache.zookeeper.server.NIOServerCnxn)
EndOfStreamException: Unable to read additional data from client sessionid 0x153d09409ca0002, likely client has closed socket
    at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228)
    at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
    at java.lang.Thread.run(Thread.java:745)
[2016-04-01 06:50:28,258] INFO Closed socket connection for client /172.17.2.46:50164 which had sessionid 0x153d09409ca0002 (org.apache.zookeeper.server.NIOServerCnxn)
[2016-04-01 06:50:34,000] INFO Expiring session 0x153d09409ca0002, timeout of 6000ms exceeded (org.apache.zookeeper.server.ZooKeeperServer)
[2016-04-01 06:50:34,001] INFO Processed session termination for sessionid: 0x153d09409ca0002 (org.apache.zookeeper.server.PrepRequestProcessor)
[2016-04-01 06:50:58,000] INFO Expiring session 0x153d09409ca0001, timeout of 30000ms exceeded (org.apache.zookeeper.server.ZooKeeperServer)
[2016-04-01 06:50:58,001] INFO Processed session termination for sessionid: 0x153d09409ca0001 (org.apache.zookeeper.server.PrepRequestProcessor)

The Kafka logs are:

[2016-04-01 06:47:56,688] INFO Verifying properties (kafka.utils.VerifiableProperties)
[2016-04-01 06:47:56,709] INFO Property advertised.host.name is overridden to 127.0.0.1 (kafka.utils.VerifiableProperties)
[2016-04-01 06:47:56,709] INFO Property advertised.port is overridden to 9092 (kafka.utils.VerifiableProperties)
[2016-04-01 06:47:56,709] INFO Property auto.create.topics.enable is overridden to true (kafka.utils.VerifiableProperties)
[2016-04-01 06:47:56,709] INFO Property broker.id is overridden to 0 (kafka.utils.VerifiableProperties)
[2016-04-01 06:47:56,709] INFO Property delete.topic.enable is overridden to true (kafka.utils.VerifiableProperties)
[2016-04-01 06:47:56,709] INFO Property log.cleaner.enable is overridden to true (kafka.utils.VerifiableProperties)
[2016-04-01 06:47:56,709] INFO Property log.dirs is overridden to /var/lib/kafka (kafka.utils.VerifiableProperties)
[2016-04-01 06:47:56,709] INFO Property log.retention.check.interval.ms is overridden to 300000 (kafka.utils.VerifiableProperties)
[2016-04-01 06:47:56,709] INFO Property log.retention.hours is overridden to 168 (kafka.utils.VerifiableProperties)
[2016-04-01 06:47:56,709] INFO Property log.segment.bytes is overridden to 1073741824 (kafka.utils.VerifiableProperties)
[2016-04-01 06:47:56,710] INFO Property num.io.threads is overridden to 8 (kafka.utils.VerifiableProperties)
[2016-04-01 06:47:56,710] INFO Property num.network.threads is overridden to 3 (kafka.utils.VerifiableProperties)
[2016-04-01 06:47:56,710] INFO Property num.partitions is overridden to 1 (kafka.utils.VerifiableProperties)
[2016-04-01 06:47:56,710] INFO Property num.recovery.threads.per.data.dir is overridden to 1 (kafka.utils.VerifiableProperties)
[2016-04-01 06:47:56,710] INFO Property port is overridden to 9092 (kafka.utils.VerifiableProperties)
[2016-04-01 06:47:56,710] INFO Property socket.receive.buffer.bytes is overridden to 102400 (kafka.utils.VerifiableProperties)
[2016-04-01 06:47:56,710] INFO Property socket.request.max.bytes is overridden to 104857600 (kafka.utils.VerifiableProperties)
[2016-04-01 06:47:56,710] INFO Property socket.send.buffer.bytes is overridden to 102400 (kafka.utils.VerifiableProperties)
[2016-04-01 06:47:56,710] INFO Property zookeeper.connect is overridden to 172.17.2.44:2181 (kafka.utils.VerifiableProperties)
[2016-04-01 06:47:56,710] INFO Property zookeeper.connection.timeout.ms is overridden to 6000 (kafka.utils.VerifiableProperties)
[2016-04-01 06:47:56,731] INFO [Kafka Server 0], starting (kafka.server.KafkaServer)
[2016-04-01 06:47:56,732] INFO [Kafka Server 0], Connecting to zookeeper on 172.17.2.44:2181 (kafka.server.KafkaServer)
[2016-04-01 06:47:56,738] INFO Starting ZkClient event thread. (org.I0Itec.zkclient.ZkEventThread)
[2016-04-01 06:47:56,743] INFO Client environment:zookeeper.version=3.4.6-1569965, built on 02/20/2014 09:09 GMT (org.apache.zookeeper.ZooKeeper)
[2016-04-01 06:47:56,743] INFO Client environment:host.name=f4459ee12fce (org.apache.zookeeper.ZooKeeper)
[2016-04-01 06:47:56,743] INFO Client environment:java.version=1.7.0_95 (org.apache.zookeeper.ZooKeeper)
[2016-04-01 06:47:56,743] INFO Client environment:java.vendor=Oracle Corporation (org.apache.zookeeper.ZooKeeper)
[2016-04-01 06:47:56,743] INFO Client environment:java.home=/usr/lib/jvm/java-7-openjdk-amd64/jre (org.apache.zookeeper.ZooKeeper)
[2016-04-01 06:47:56,743] INFO Client environment:java.class.path=:/usr/bin/../core/build/dependant-libs-2.10.4*/*.jar:/usr/bin/../examples/build/libs//kafka-examples*.jar:/usr/bin/../contrib/hadoop-consumer/build/libs//kafka-hadoop-consumer*.jar:/usr/bin/../contrib/hadoop-producer/build/libs//kafka-hadoop-producer*.jar:/usr/bin/../clients/build/libs/kafka-clients*.jar:/usr/bin/../libs/*.jar:/usr/bin/../share/java/kafka/jopt-simple-3.2.jar:/usr/bin/../share/java/kafka/kafka-clients-0.8.2.2.jar:/usr/bin/../share/java/kafka/kafka.jar:/usr/bin/../share/java/kafka/kafka_2.10-0.8.2.2-javadoc.jar:/usr/bin/../share/java/kafka/kafka_2.10-0.8.2.2-scaladoc.jar:/usr/bin/../share/java/kafka/kafka_2.10-0.8.2.2-sources.jar:/usr/bin/../share/java/kafka/kafka_2.10-0.8.2.2-test.jar:/usr/bin/../share/java/kafka/kafka_2.10-0.8.2.2.jar:/usr/bin/../share/java/kafka/log4j-1.2.16.jar:/usr/bin/../share/java/kafka/lz4-1.2.0.jar:/usr/bin/../share/java/kafka/metrics-core-2.2.0.jar:/usr/bin/../share/java/kafka/scala-library-2.10.4.jar:/usr/bin/../share/java/kafka/slf4j-api-1.7.6.jar:/usr/bin/../share/java/kafka/slf4j-log4j12-1.6.1.jar:/usr/bin/../share/java/kafka/snappy-java-1.1.1.7.jar:/usr/bin/../share/java/kafka/zkclient-0.3.jar:/usr/bin/../share/java/kafka/zookeeper-3.4.6.jar:/usr/bin/../core/build/libs/kafka_2.10*.jar (org.apache.zookeeper.ZooKeeper)
[2016-04-01 06:47:56,743] INFO Client environment:java.library.path=/usr/java/packages/lib/amd64:/usr/lib/x86_64-linux-gnu/jni:/lib/x86_64-linux-gnu:/usr/lib/x86_64-linux-gnu:/usr/lib/jni:/lib:/usr/lib (org.apache.zookeeper.ZooKeeper)
[2016-04-01 06:47:56,743] INFO Client environment:java.io.tmpdir=/tmp (org.apache.zookeeper.ZooKeeper)
[2016-04-01 06:47:56,743] INFO Client environment:java.compiler=<NA> (org.apache.zookeeper.ZooKeeper)
[2016-04-01 06:47:56,743] INFO Client environment:os.name=Linux (org.apache.zookeeper.ZooKeeper)
[2016-04-01 06:47:56,743] INFO Client environment:os.arch=amd64 (org.apache.zookeeper.ZooKeeper)
[2016-04-01 06:47:56,743] INFO Client environment:os.version=3.10.0-327.10.1.el7.x86_64 (org.apache.zookeeper.ZooKeeper)
[2016-04-01 06:47:56,743] INFO Client environment:user.name=confluent (org.apache.zookeeper.ZooKeeper)
[2016-04-01 06:47:56,743] INFO Client environment:user.home=/home/confluent (org.apache.zookeeper.ZooKeeper)
[2016-04-01 06:47:56,743] INFO Client environment:user.dir=/ (org.apache.zookeeper.ZooKeeper)
[2016-04-01 06:47:56,743] INFO Initiating client connection, connectString=172.17.2.44:2181 sessionTimeout=6000 watcher=org.I0Itec.zkclient.ZkClient@76415e70 (org.apache.zookeeper.ZooKeeper)
[2016-04-01 06:47:56,758] INFO Opening socket connection to server 172.17.2.44/172.17.2.44:2181. Will not attempt to authenticate using SASL (unknown error) (org.apache.zookeeper.ClientCnxn)
[2016-04-01 06:47:56,762] INFO Socket connection established to 172.17.2.44/172.17.2.44:2181, initiating session (org.apache.zookeeper.ClientCnxn)
[2016-04-01 06:47:56,789] INFO Session establishment complete on server 172.17.2.44/172.17.2.44:2181, sessionid = 0x153d09409ca0000, negotiated timeout = 6000 (org.apache.zookeeper.ClientCnxn)
[2016-04-01 06:47:56,791] INFO zookeeper state changed (SyncConnected) (org.I0Itec.zkclient.ZkClient)
[2016-04-01 06:47:56,919] INFO Loading logs. (kafka.log.LogManager)
[2016-04-01 06:47:56,925] INFO Logs loading complete. (kafka.log.LogManager)
[2016-04-01 06:47:56,976] INFO Starting log cleanup with a period of 300000 ms. (kafka.log.LogManager)
[2016-04-01 06:47:56,977] INFO Starting log flusher with a default period of 9223372036854775807 ms. (kafka.log.LogManager)
[2016-04-01 06:47:56,992] INFO Awaiting socket connections on 0.0.0.0:9092. (kafka.network.Acceptor)
[2016-04-01 06:47:56,993] INFO [Socket Server on Broker 0], Started (kafka.network.SocketServer)
[2016-04-01 06:47:57,031] INFO Will not load MX4J, mx4j-tools.jar is not in the classpath (kafka.utils.Mx4jLoader$)
[2016-04-01 06:47:57,065] INFO 0 successfully elected as leader (kafka.server.ZookeeperLeaderElector)
[2016-04-01 06:47:57,130] INFO Registered broker 0 at path /brokers/ids/0 with address 127.0.0.1:9092. (kafka.utils.ZkUtils$)
[2016-04-01 06:47:57,137] INFO [Kafka Server 0], started (kafka.server.KafkaServer)
[2016-04-01 06:47:57,167] INFO New leader is 0 (kafka.server.ZookeeperLeaderElector$LeaderChangeListener)
[2016-04-01 06:49:27,926] INFO [ReplicaFetcherManager on broker 0] Removed fetcher for partitions [_schemas,0] (kafka.server.ReplicaFetcherManager)
[2016-04-01 06:49:27,947] INFO Completed load of log _schemas-0 with log end offset 0 (kafka.log.Log)
[2016-04-01 06:49:27,950] INFO Created log for partition [_schemas,0] in /var/lib/kafka with properties {segment.index.bytes -> 10485760, file.delete.delay.ms -> 60000, segment.bytes -> 1073741824, flush.ms -> 9223372036854775807, delete.retention.ms -> 86400000, index.interval.bytes -> 4096, retention.bytes -> -1, min.insync.replicas -> 1, cleanup.policy -> compact, unclean.leader.election.enable -> true, segment.ms -> 604800000, max.message.bytes -> 1000012, flush.messages -> 9223372036854775807, min.cleanable.dirty.ratio -> 0.5, retention.ms -> 604800000, segment.jitter.ms -> 0}. (kafka.log.LogManager)
[2016-04-01 06:49:27,950] WARN Partition [_schemas,0] on broker 0: No checkpointed highwatermark is found for partition [_schemas,0] (kafka.cluster.Partition)

I appreciate any help. Thank you.

guidothekp avatar Apr 01 '16 16:04 guidothekp