CMAK icon indicating copy to clipboard operation
CMAK copied to clipboard

Cluster not detected?

Open jessetandor opened this issue 5 years ago • 1 comments

First time trying Kafka-manager and off to a good start but I can't get it talking to zookeeper correctly. ...Here is my config:

# Copyright 2015 Yahoo Inc. Licensed under the Apache License, Version 2.0
# See accompanying LICENSE file.

# This is the main configuration file for the application.
# ~~~~~

# Secret key
# ~~~~~
# The secret key is used to secure cryptographics functions.
# If you deploy your application to several instances be sure to use the same key!
play.crypto.secret="xxx"
play.crypto.secret=${?APPLICATION_SECRET}
play.http.session.maxAge="1h"

# The application languages
# ~~~~~
play.i18n.langs=["en"]

play.http.requestHandler = "play.http.DefaultHttpRequestHandler"
play.http.context = "/"
play.application.loader=loader.KafkaManagerLoader

kafka-manager.zkhosts="zookeeper-node.xxxx.:xxx"
kafka-manager.zkhosts=${?ZK_HOSTS}
pinned-dispatcher.type="PinnedDispatcher"
pinned-dispatcher.executor="thread-pool-executor"
application.features=["KMClusterManagerFeature","KMTopicManagerFeature","KMPreferredReplicaElectionFeature","KMReassignPartitionsFeature"]

akka {
  loggers = ["akka.event.slf4j.Slf4jLogger"]
  loglevel = "INFO"
}

akka.logger-startup-timeout = 60s

basicAuthentication.enabled=false
basicAuthentication.enabled=${?KAFKA_MANAGER_AUTH_ENABLED}

basicAuthentication.ldap.enabled=false
basicAuthentication.ldap.enabled=${?KAFKA_MANAGER_LDAP_ENABLED}
basicAuthentication.ldap.server=""
basicAuthentication.ldap.server=${?KAFKA_MANAGER_LDAP_SERVER}
basicAuthentication.ldap.port=389
basicAuthentication.ldap.port=${?KAFKA_MANAGER_LDAP_PORT}
basicAuthentication.ldap.username=""
basicAuthentication.ldap.username=${?KAFKA_MANAGER_LDAP_USERNAME}
basicAuthentication.ldap.password=""
basicAuthentication.ldap.password=${?KAFKA_MANAGER_LDAP_PASSWORD}
basicAuthentication.ldap.search-base-dn=""
basicAuthentication.ldap.search-base-dn=${?KAFKA_MANAGER_LDAP_SEARCH_BASE_DN}
basicAuthentication.ldap.search-filter="(uid=$capturedLogin$)"
basicAuthentication.ldap.search-filter=${?KAFKA_MANAGER_LDAP_SEARCH_FILTER}
basicAuthentication.ldap.group-filter=""
basicAuthentication.ldap.group-filter=${?KAFKA_MANAGER_LDAP_GROUP_FILTER}
basicAuthentication.ldap.connection-pool-size=10
basicAuthentication.ldap.connection-pool-size=${?KAFKA_MANAGER_LDAP_CONNECTION_POOL_SIZE}
basicAuthentication.ldap.ssl=false
basicAuthentication.ldap.ssl=${?KAFKA_MANAGER_LDAP_SSL}

basicAuthentication.username="admin"
basicAuthentication.username=${?KAFKA_MANAGER_USERNAME}
basicAuthentication.password="password"
basicAuthentication.password=${?KAFKA_MANAGER_PASSWORD}

basicAuthentication.realm="Kafka-Manager"
basicAuthentication.excluded=["/api/health"] # ping the health of your instance without authentification

kafka-manager.consumer.properties.file=${?CONSUMER_PROPERTIES_FILE}

The only change here is the resolvable address zookeeper-node:xxx.

Im passing a jaas file to kafka-manager ( ./kafka-manager -Djava.security.auth.login.config=/Users/User/Desktop/zookeeper_jaas.conf)

Client {
  org.apache.zookeeper.server.auth.DigestLoginModule required
  username="xxx"
  password="xxxx";
};

The only obvious error's i see are : ERROR in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - Failed to create parent directories for [/Users/user/Desktop/kafka-manager/kafka-manager-master/target/universal/kafka-manager-2.0.0.2/application.home_IS_UNDEFINED/logs/application.log]

And

ERROR in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - openFile(application.home_IS_UNDEFINED/logs/application.log,true) call failed. java.io.FileNotFoundException: application.home_IS_UNDEFINED/logs/application.log (No such file or directory)

The connections looks good?

2019-12-05 14:13:06,449 - [INFO] o.a.z.ZooKeeper - Initiating client connection, connectString=zookeeper-node:xxxx sessionTimeout=60000 watcher=org.apache.curator.ConnectionState@5fa2e5f0
2019-12-05 14:13:06,477 - [INFO] k.m.a.KafkaManagerActor - zk=zookeeper-node:xxx
2019-12-05 14:13:06,477 - [INFO] k.m.a.KafkaManagerActor - baseZkPath=/kafka-manager
2019-12-05 14:13:06,630 - [INFO] o.a.z.Login - Client successfully logged in.
2019-12-05 14:13:06,634 - [INFO] o.a.z.c.ZooKeeperSaslClient - Client will use DIGEST-MD5 as SASL mechanism.
2019-12-05 14:13:06,704 - [INFO] play.api.Play - Application started (Prod)
2019-12-05 14:13:06,705 - [INFO] o.a.z.ClientCnxn - Opening socket connection to server zookeeper-node:xxx. Will attempt to SASL-authenticate using Login Context section 'Client'
2019-12-05 14:13:06,801 - [INFO] o.a.z.ClientCnxn - Socket connection established to zookeeper-node:xxxx, initiating session
2019-12-05 14:13:06,878 - [INFO] o.a.z.ClientCnxn - Session establishment complete on server zookeeper-node:xxxx:xxxx, sessionid = 0x101d358a7ed06e7, negotiated timeout = 40000

The basic UI loads but no clusters are shown. Any advice on how to proceed would be greatly appreciated, thanks!

jessetandor avatar Dec 05 '19 12:12 jessetandor

Hi @jessetandor Can you provide some more context here ?

ta1bbty avatar Jun 22 '20 17:06 ta1bbty