kafka-connect-cosmosdb
kafka-connect-cosmosdb copied to clipboard
microsoft
Kafka Connect connectors for Azure Cosmos DB
Related code line: https://github.com/microsoft/kafka-connect-cosmosdb/blob/b7773f8fc1396da9beda055d1a956de37d72f97d/src/main/java/com/azure/cosmos/kafka/connect/sink/CosmosDBSinkTask.java#L107 It might be possible, if the value of a column is `null`, that the line that emits this log might throw a `NullPointerException`. ``` Task is...
## Description - When trying to create a new instance of source connector with value converter set to **io.confluent.connect.avro.AvroConverter**. The lease container is created and a new schema is created...
**## Problem Statement** The README recommends using the MongoDB connector for the Cosmos DB Mongo API, however, it seems that since the Cosmos DB Mongo API doesn't support the connectionStatus...
## Description - A message with the wrong format is failing and not being written into the dead letter queue. ## Expected Behavior - Failures should go into the dead...
Currently, Kafka source connector is using changeFeedProcessor to pull changes. Will raise few challenges: 1. Offset tracking 2. load balancing ChangeFeed pull model will be a better suite.
**## Problem Statement** I want to stream my cosmos data to a Kafka topic. I need the Kafka messages to be keyed with my document id plus the partition key....
## Description Bulk Execution is failing when containers are partitioned by anything other than "id". **Error Message:** [2023-04-27 07:47:27,333] ERROR Could not upload record to CosmosDb, but tolerance is set...
**## Problem Statement** - Currently, we do not support Lease container creation on serverless CosmosDB accounts. - Java SDK supports that, we need to add that functionality to the Kafka...
https://github.com/microsoft/kafka-connect-cosmosdb/blob/84a32c063c05c9e982a3fc73e6ae89831257a00a/src/main/java/com/azure/cosmos/kafka/connect/source/CosmosDBSourceConnector.java#L59 If user gives maxTasks less than num containers , then few container will never be read . So we can have validation in config to avoid that case.
## Description I have tried and read nearly everything I can find but I cannot sink messages produced from the Debeznium SQL Server Connector (debezium-connector-sqlserver:1.6.0) which cause an error that...
