clickhouse-kafka-connect
clickhouse-kafka-connect copied to clipboard
ClickHouse
ClickHouse Kafka Connector
We should have a detailed guide for setting up the connector with a RedPanda environment.
## Summary 1. Excluded excess data processing when state = `BEFORE_PROCESSING' 2. Fixed order of chunks in overlapping range cases 3. Prevented insertion of the 1 chunk in overlapping range...
**Is your feature request related to a problem? Please describe.** The current log levels are logging information at any write process. This is for our usecase with very high throughput...
This is meant to be a detailed step-by-step guide to setting up the connector with an on-prem environment, going end-to-end.
**Is your feature request related to a problem? Please describe.** I want to forward data in a binary format to ClickHouse. **Describe the solution you'd like** Something similar to String...
To simplify incident investigations, I'd propose including some of the metadata (such as event ID, Offset, Partition, etc.) in "log comment" to display in [query_log](https://clickhouse.com/docs/en/operations/system-tables/query_log)
Seems it should be recoverable exception, where temporary on ClickHouse Server Memory Limit Exceeded. ``` { name: "...", connector: { state: "RUNNING", worker_id: "connect:8083" }, tasks: [ { id: 0,...
Kafka Connect SinkRecord is supporting nested types It should be translated to JSON Type in ClickHouse
### Describe the bug Hey team, we are using ClickHouse, [JDBC](https://www.confluent.io/hub/confluentinc/kafka-connect-jdbc) and [BigQuery](https://www.confluent.io/hub/wepay/kafka-connect-bigquery) Kafka Connects with identical settings and resources: - 4GB RAM limit and requests in k8s - 2CPU...
I'd like to have the option to pass-through data from Kafka to ClickHouse, by specifying String or ByteArray converter. The data would go to a table with a String column....
