kafka-connect-mongodb
kafka-connect-mongodb copied to clipboard
**Unofficial / Community** Kafka Connect MongoDB Sink Connector -> integrated 2019 into the official MongoDB Kafka Connector here: https://www.mongodb.com/kafka-connector
Bumps [mongodb-driver](https://github.com/mongodb/mongo-java-driver) from 3.12.0 to 3.12.8. Release notes Sourced from mongodb-driver's releases. Java Driver 3.12.8 (February 18, 2021) Release Notes: https://developer.mongodb.com/community/forums/t/mongodb-java-driver-3-12-8-released/16823 Java Driver 3.12.6 (July 8, 2020) Release Notes: https://developer.mongodb.com/community/forums/t/mongodb-java-driver-3-12-6-released/6448/2...
Source connector configuration ``` curl -i -X POST -H "Accept:application/json" -H "Content-Type:application/json" localhost:8083/connectors/ -d ' { "name": "announcer-connector", "config": { "connector.class": "io.debezium.connector.mongodb.MongoDbConnector", "mongodb.members.auto.discover": "true", "mongodb.hosts": "10.60.11.66:27017", "mongodb.name": "announcer", "mongodb.user": "***",...
Hi, we use your connector to send data to a MongoDB. Initially the mongo was installed in ReplicaSet mode on a cluster with 3 node, now it has been changed...
@hpgrahsl I am doing sink from Postgres to MongoDB by MongoSinkConnector with Kafka. (`Postgres` --> `Kafka` --> `MongoDB`) I can check there is `u`(= update) in `op`(= operationType) when I...
Bumps `jackson.version` from 2.10.1 to 2.12.1. Updates `jackson-core` from 2.10.1 to 2.12.1 Commits 67a2970 [maven-release-plugin] prepare release jackson-core-2.12.1 2649dd4 Prepare for 2.12.1 release 1e30c8c ... aa54f0a javadocs, javadocs e5cbda2 More...
@hpgrahsl I am getting below exception from sink. My sink propertirs: name=oz_next_assets_sink_01 key.converter=org.apache.kafka.connect.json.JsonConverter key.converter.schemas.enable=false value.converter=org.apache.kafka.connect.json.JsonConverter value.converter.schemas.enable=false internal.key.converter=org.apache.kafka.connect.json.JsonConverter internal.value.converter=org.apache.kafka.connect.json.JsonConverter internal.key.converter.schemas.enable=false internal.value.converter.schemas.enable=false connector.class=at.grahsl.kafka.connect.mongodb.MongoDbSinkConnector topics=oz_next_assets.oz_next.assets mongodb.connection.uri=mongodb://localhost:27017/oz_next_new?w=1&journal=true mongodb.change.data.capture.handler=at.grahsl.kafka.connect.mongodb.cdc.debezium.mongodb.MongoDbHandler mongodb.collections=assets mongodb.collection.oz_next_assets.oz_next.assets=assets #Route failed messages to...
When processing CDC events coming from Debezium's Source Connector for MongoDB there was a recent update which affects the handling how to encode the shard key of sharded collections in...
When Avro/Schema Registry is used, any information used to de-serialize a message is lost. While the result document structure still reflects the original Avro schema. Would be extremely useful to...
Similar to what other connectors offer, the MongoDB sink connector should expose JMX metrics in order to be able to monitor the processing of Kafka Connect Sink Records. Among others,...
The current behaviour of the connector w.r.t retries is a pretty naive one. It would make a lot of sense to implement an exponential backoff mechanism as a more robust...