clickhouse-kafka-connect

clickhouse-kafka-connect copied to clipboard

Support Delete mode

1

@cwurm requested support for tombstone messages to delete records from the storage. The use case is essential for customers sharing the same message pipeline among several DB and expecting records...

mshustov

Support automatic table schema evolution

2

**Description** In my organization we use clickhouse as analitical database that gets it's data from multiple sources via Kafka. Domain models change from time to time as business changes and...

mlivirov

Exponential backoff (test and/or implement)

1

Paultagoras

We should enhance the tests we have to include a DLQ on failure.

Paultagoras

ExtractTablesMapping's DESCRIBE query times out

4

### Describe the bug We see every 5-10 minutes, `DESCRIBE` queries timeout in Kafka Connect while they have 1ms execution_duration in `system.query_log`. We run our connector task with `tableRefreshInterval=15`. Based...

hekike

It might be a good idea (if it's possible) to only store problematic records into the DLQ (so that mixed batches can mostly succeed).

Paultagoras

**Is your feature request related to a problem? Please describe.** When the connector fails on Confluent Cloud, UI shows only an error message without the full stack trace  A...

mshustov

We have developed a retry mechanism for our Kafka connect. It uses the built-in mechanism of the Kafka Connect framework Tests in the implementation are missing.

mzitnik

Implement load testing to understand the performance limitations of the solution and how different settings affect it. - Define the types of workloads to simulate, and the performance metrics to...

mshustov

Issue #422 | Replacing Streams.zip with forEach on TupleFields

2

#422 Since the two lists in Streams.zip were not sorted wrt to column names, a mismatch occurred between names & values causing ClassCastException in `doWritePrimitive`

arnay-allen