kafka-connect-cosmosdb

kafka-connect-cosmosdb copied to clipboard

Rather than relying on the docker-compose setup, which is slow to startup and resource intensive, let's try to use the `confluent local` CLI as the confluent platform setup mechanism. Docs:...

sivamu

Nice to have worker task:topic mapping in Sink connector

7

Currently the sink connector spins up as many workers as the maxTasks configuration and assigns all topics to all workers. Because of the topic -> collection mapping it would be...

jcocchi

Nice to have Sink create Database andor Collection if not exists

6

add a new config option **createCollection** and **createDatabase** of type Boolean. If set to true. Sink will attempt to create the database and collection(s) based on the database and collections...

jcocchi

Nice to have configurable batching in Sink when reading from Kafka

8

Will read as batch, by default. Batch size should default to a chosen value, and be configurable.

ryancrawcour

Must be able to configure CosmosDB retry policy

4

CosmosDB has a default built-in retry policy. Need to be able to change the configuration of the CosmosDB default retry policy based on Connector config settings.

ryancrawcour