clickhouse-kafka-connect icon indicating copy to clipboard operation
clickhouse-kafka-connect copied to clipboard

Connect state table may not exist on all clickhouse node in cluster

Open abhishekgahlot2 opened this issue 1 year ago • 3 comments

When running multiple clickhouse nodes behind load balancer.

Create connect state table is not created on all nodes or doesn't use ON CLUSTER configuration.

So on some node it may not be able to send data because the table doesn't exist and give error like

 Table default.connect_state does not exist.

abhishekgahlot2 avatar Apr 11 '24 21:04 abhishekgahlot2

Either we can specify on cluster mode here from parameters. i can raise pr if that makes sesnse?

abhishekgahlot2 avatar Apr 11 '24 21:04 abhishekgahlot2

Hmm that's an interesting one - is this on a self-hosted instance?

Paultagoras avatar Apr 18 '24 15:04 Paultagoras

yup, i had to create this table on self hosted clickhouse cluster to make the connector work.

abhishekgahlot2 avatar Apr 18 '24 17:04 abhishekgahlot2