Zookeeper Process failed when HDFS process started in Mesos

[mytechskill]

I have setup a cluster with 7 node each having 4cpu, 16GB RAM and 50GB memory. Trying to setup hdfs on it. 1st 3 node as a master unfortunately when I started HDFS it is giving me error "Offer does not have enough resources" continuously.

While checking the status of zookeeper it also giving below error "INFO [ProcessThread(sid:2 cport:-1)::PrepRequestProcessor@645] - Got user-level KeeperException when processing sessionid:0x25679a5dc6b001d type:create cxid:0x57b38785 zxid:0x8a000015b5 txntype:-1 reqpath:n/a Error Path:/hdfs-mesos/hdfs/tasks Error:KeeperErrorCode = NodeExists for /hdfs-mesos/hdfs/tasks"

Every time it creates a new zkfc and namenode process but after certain interval it fails but journalnode remain in running state. In sandbox log getting below error

"INFO zookeeper.ClientCnxn: Opening socket connection to server localhost/127.0.0.1:2181. Will not attempt to authenticate using SASL (unknown error)"

Note: Previously when I was using mesos0.28 with zookeeper3.4.5 there were no such error once I upgraded to mesos1.0 and zookeeper3.4.6 the above error being displayed.

Can anyone please let me know the minimum requirement to do the setup or where I am missing.

Thanks in Advance!!!

[kensipe]

perhaps you have exceeded the maxclientcnxns of zk. that is a common issue.

[mytechskill]

Hi Ken,

What and where I should change maxclientcnxns value.

On Tue, Aug 23, 2016 at 12:27 AM, Ken Sipe [email protected] wrote:

perhaps you have exceeded the maxclientcnxns of zk. that is a common issue.

— You are receiving this because you authored the thread. Reply to this email directly, view it on GitHub https://github.com/mesosphere/hdfs/issues/269#issuecomment-241514183, or mute the thread https://github.com/notifications/unsubscribe-auth/AUA2YRJshH3I1HvtZrQHqi2LEK7pxwvuks5qifEsgaJpZM4Ji1qW .

[kensipe]

maxclientcnxns is a configuration in zoo.cfg

https://zookeeper.apache.org/doc/r3.2.2/zookeeperAdmin.html

let me know if it doesn't help

[triclambert]

Please note that this repository is now deprecated. See this issue for a more detailed explanation.