CMAK icon indicating copy to clipboard operation
CMAK copied to clipboard

Failed to add cluster on 3.0.0.1

Open rsaggino opened this issue 5 years ago • 21 comments

Using the latest CMAK release (3.0.0.1) this happens while trying to add a cluster:

2020-02-21 12:42:37,602 - [ERROR] k.m.KafkaManager - Failed on input : KMAddCluster(ClusterConfig(TEST,CuratorConfig(server:2181/cmak,100,100,1000),true,2.1.1,false,None,None,false,false,false,false,false,false,Some(ClusterTuning(Some(30),Some(2),Some(100),Some(2),Some(100),Some(2),Some(100),Some(30),Some(5),Some(4),Some(1000),Some(4),Some(1000),Some(4),Some(1000),Some(30000),Some(1000000),Some(7))),PLAINTEXT,None,None))
org.apache.zookeeper.KeeperException$UnimplementedException: KeeperErrorCode = Unimplemented for /kafka-manager/mutex
        at org.apache.zookeeper.KeeperException.create(KeeperException.java:106)
        at org.apache.zookeeper.KeeperException.create(KeeperException.java:54)
        at org.apache.zookeeper.ZooKeeper.create(ZooKeeper.java:1538)
        at org.apache.curator.utils.ZKPaths.mkdirs(ZKPaths.java:291)
        at org.apache.curator.framework.imps.CreateBuilderImpl$11.call(CreateBuilderImpl.java:746)
        at org.apache.curator.framework.imps.CreateBuilderImpl$11.call(CreateBuilderImpl.java:723)
        at org.apache.curator.RetryLoop.callWithRetry(RetryLoop.java:109)
        at org.apache.curator.framework.imps.CreateBuilderImpl.pathInForeground(CreateBuilderImpl.java:720)
        at org.apache.curator.framework.imps.CreateBuilderImpl.protectedPathInForeground(CreateBuilderImpl.java:484)
        at org.apache.curator.framework.imps.CreateBuilderImpl.forPath(CreateBuilderImpl.java:474)
2020-02-21 12:42:37,602 - [ERROR] k.m.ApiError$ - error : KeeperErrorCode = Unimplemented for /kafka-manager/mutex
org.apache.zookeeper.KeeperException$UnimplementedException: KeeperErrorCode = Unimplemented for /kafka-manager/mutex
        at org.apache.zookeeper.KeeperException.create(KeeperException.java:106)
        at org.apache.zookeeper.KeeperException.create(KeeperException.java:54)
        at org.apache.zookeeper.ZooKeeper.create(ZooKeeper.java:1538)
        at org.apache.curator.utils.ZKPaths.mkdirs(ZKPaths.java:291)
        at org.apache.curator.framework.imps.CreateBuilderImpl$11.call(CreateBuilderImpl.java:746)
        at org.apache.curator.framework.imps.CreateBuilderImpl$11.call(CreateBuilderImpl.java:723)
        at org.apache.curator.RetryLoop.callWithRetry(RetryLoop.java:109)
        at org.apache.curator.framework.imps.CreateBuilderImpl.pathInForeground(CreateBuilderImpl.java:720)
        at org.apache.curator.framework.imps.CreateBuilderImpl.protectedPathInForeground(CreateBuilderImpl.java:484)
        at org.apache.curator.framework.imps.CreateBuilderImpl.forPath(CreateBuilderImpl.java:474)

I am using Zookeeper 3.4.9.

Is this a configuration issue?

rsaggino avatar Feb 21 '20 11:02 rsaggino

I am also facing same issue and was about to open an issue for same

akashdgoel avatar Feb 21 '20 13:02 akashdgoel

I am unable to reproduce this. Try using the compiled binary attached to 3.0.0.2 release as asset.

patelh avatar Feb 27 '20 07:02 patelh

I am unable to reproduce this. Try using the compiled binary attached to 3.0.0.2 release as asset.

The binary release works.

rsaggino avatar Feb 28 '20 08:02 rsaggino

I am also facing same issue

6westboy9 avatar Feb 29 '20 01:02 6westboy9

I encountered the same problem

coding-chenkaikai avatar Mar 03 '20 11:03 coding-chenkaikai

I am using Zookeeper 3.4.10 same issue

pj9039 avatar Mar 04 '20 03:03 pj9039

@6westboy9 @coding-chenkaikai @pj9039 use the binary release...

patelh avatar Mar 04 '20 05:03 patelh

@6westboy9 @coding-chenkaikai @pj9039 use the binary release... It would be great to understand what is going wrong, could you please specify how you are building it? (Java version, os release etc.)

Thanks

rsaggino avatar Mar 06 '20 09:03 rsaggino

I ran into the same issue. As a workaround, I had to create /kafka-manager/mutex/locks and /kafka-manager/mutex/leases nodes manually. After that, I am able to add clusters.

agunturu avatar Mar 09 '20 01:03 agunturu

我用的版本是cmak-3.0.0.4,启动的时候发现同样的问题,需要在zk上手动创建/kafka-manager/mutex/locks、/kafka-manager/mutex/leases这两个节点

zheng-zy avatar Mar 25 '20 09:03 zheng-zy

我用的版本是cmak-3.0.0.4,启动的时候发现同样的问题,需要在zk上手动创建/kafka-manager/mutex/locks、/kafka-manager/mutex/leases这两个节点

Kafka萌新请问创建的ZK节点类型是什么类型呢?大佬能给出创建节点的命令吗?谢谢大佬!

JesseAtSZ avatar May 11 '20 11:05 JesseAtSZ

I ran into the same issue. As a workaround, I had to create /kafka-manager/mutex/locks and /kafka-manager/mutex/leases nodes manually. After that, I am able to add clusters.

Can you explain me where did you create?

quanghn96 avatar Jun 08 '20 10:06 quanghn96

  • my docker image version
    • zookeeper:3.4.14
    • wurstmeister/kafka:2.12-2.4.1
    • kafkamanager/kafka-manager:3.0.0.4
  • this worked for me
➜ docker exec -it zookeeper bash
root@98747a9eac65:/zookeeper-3.4.14# ./bin/zkCli.sh
[zk: localhost:2181(CONNECTED) 2] ls /kafka-manager
[configs, deleteClusters, clusters]
[zk: localhost:2181(CONNECTED) 3] create /kafka-manager/mutex ""
Created /kafka-manager/mutex
[zk: localhost:2181(CONNECTED) 5] create /kafka-manager/mutex/locks ""
Created /kafka-manager/mutex/locks
[zk: localhost:2181(CONNECTED) 6] create /kafka-manager/mutex/leases ""
Created /kafka-manager/mutex/leases

zhigang avatar Jun 15 '20 03:06 zhigang

Thanks @zhigang, was able to get it running on local with 1 zk and 2 kafka brokers.

Zookeeper 3.4.13 Kafka 2.2.1 CMAK 3.0.0.5

jmilagroso avatar Jun 22 '20 13:06 jmilagroso

I ran into the same issue. As a workaround, I had to create /kafka-manager/mutex/locks and /kafka-manager/mutex/leases nodes manually. After that, I am able to add clusters.

Can you explain me where did you create?

In zk cli. See https://github.com/yahoo/CMAK/issues/731#issuecomment-643880544

jmilagroso avatar Jun 22 '20 13:06 jmilagroso

  • my docker image version

    • zookeeper:3.4.14
    • wurstmeister/kafka:2.12-2.4.1
    • kafkamanager/kafka-manager:3.0.0.4
  • this worked for me

➜ docker exec -it zookeeper bash
root@98747a9eac65:/zookeeper-3.4.14# ./bin/zkCli.sh
[zk: localhost:2181(CONNECTED) 2] ls /kafka-manager
[configs, deleteClusters, clusters]
[zk: localhost:2181(CONNECTED) 3] create /kafka-manager/mutex ""
Created /kafka-manager/mutex
[zk: localhost:2181(CONNECTED) 5] create /kafka-manager/mutex/locks ""
Created /kafka-manager/mutex/locks
[zk: localhost:2181(CONNECTED) 6] create /kafka-manager/mutex/leases ""
Created /kafka-manager/mutex/leases

Worked like a charm

mahkorayem avatar Nov 24 '20 08:11 mahkorayem

Still happens in 3.0.0.5. Fixed manually as per above solutions...

lirazsh avatar Dec 10 '20 11:12 lirazsh

The problem still occurs. I understand that creating mutex folder is some kind of solutions, but this should work without creating it manually. Maybe this should be created automatically, but with the option to disable as a variable.......

lukasz-cpu avatar Sep 11 '21 09:09 lukasz-cpu

Update zookeeper to 3.5+ fix this for me.

My docker image version:

  • zookeeper:3.5
  • wurstmeister/kafka:2.12-2.4.0
  • kafkamanager/kafka-manager:3.0.0.4

sko00o avatar Dec 28 '21 06:12 sko00o

  • my docker image version

    * zookeeper:3.4.14
    * wurstmeister/kafka:2.12-2.4.1
    * kafkamanager/kafka-manager:3.0.0.4
    
    • this worked for me
➜ docker exec -it zookeeper bash
root@98747a9eac65:/zookeeper-3.4.14# ./bin/zkCli.sh
[zk: localhost:2181(CONNECTED) 2] ls /kafka-manager
[configs, deleteClusters, clusters]
[zk: localhost:2181(CONNECTED) 3] create /kafka-manager/mutex ""
Created /kafka-manager/mutex
[zk: localhost:2181(CONNECTED) 5] create /kafka-manager/mutex/locks ""
Created /kafka-manager/mutex/locks
[zk: localhost:2181(CONNECTED) 6] create /kafka-manager/mutex/leases ""
Created /kafka-manager/mutex/leases

worked for me too

man-jiteshm-sportsbet avatar Jan 10 '22 03:01 man-jiteshm-sportsbet

The problem still occurs. I understand that creating mutex folder is some kind of solutions, but this should work without creating it manually. Maybe this should be created automatically, but with the option to disable as a variable.......

我也觉得不应该自己去手动创建文件夹来解决问题,按道理来说应该是自动生成的,还有,那些说升级zk版本的,生产环境的组件版本最好不要乱动。

yasuolumia avatar May 09 '22 07:05 yasuolumia