Remove the dependency on zookeeper

[wForget]

Compass depends on many services so that it is difficult for me to install it quickly. Can we shrink some dependent services?

The zookeeper service is only used as a distributed lock in the task-metadata, maybe we can use redis instead.

[zebozhuang]

Compass depends on many services so that it is difficult for me to install it quickly. Can we shrink some dependent services?

The zookeeper service is only used as a distributed lock in the task-metadata, maybe we can use redis instead.

Zookeeper is also used by Kafka when Canal synchronizes scheduler data.

[wForget]

Zookeeper is also used by Kafka when Canal synchronizes scheduler data.

In my company, kafka is provided independently as a cloud service, which means I cannot use the same zookeeper in compass and kafka.

[zebozhuang]

Zookeeper is also used by Kafka when Canal synchronizes scheduler data.

In my company, kafka is provided independently as a cloud service, which means I cannot use the same zookeeper in compass and kafka.

Understood. It is ok to support task-meta lock with either Redis or Zookeeper but it is not the reason to shrink zookeeper, which are two different kinds of saying^_^.