kafka-connect-jdbc
kafka-connect-jdbc copied to clipboard
Kafka Connect connector for JDBC-compatible databases
We have a jdbc sink to a mysql host. The sink is configured with `max.retries = 100`. We had a short unavailability of our DB, which lead naturally to failure...
Similar to https://github.com/confluentinc/common/pull/341, change the pom's repository value to `https` as now required by default with newer versions of maven (3.8.1+, ref: https://issues.apache.org/jira/browse/MNG-7118).
Following is the connector property . MSSQL database is used. ``` name=item-source-connector connector.class=io.confluent.connect.jdbc.JdbcSourceConnector tasks.max=1 value.converter=org.apache.kafka.connect.json.JsonConverter value.converter.schemas.enable=false connection.url=jdbc:sqlserver://XYZ\\Development:61236;databaseName=adb-development;user=username;password=password mode=incrementing table.whitelist=Item incrementing.column.name=ItemID topic.prefix=Item- batch.max.rows=100 ``` While running the kafka connect standalone, It...
Hi, I have large dataset (10kk~) to be fetch by kafka connector, from begining, its possible without creating N views and N connectors, just reading from database according jdbc batch...
I am trying to connect to MS SQL table and detect changes based on timestamp mode. The table in MS SQL has a column of type DateTime2. When I run...
Streaming Avro data to MySQL with the JDBC Sink, connector aborts if switching from `"pk.mode": "none"` to ` "pk.mode": "kafka"` with the error: Caused by: org.apache.kafka.connect.errors.ConnectException: Cannot ALTER to add...
`Caused by: org.apache.kafka.connect.errors.ConnectException: Sink connector 'test-sink' is configured with 'delete.enabled=false' and 'pk.mode=none' and therefore requires records with a non-null Struct value and non-null Struct schema, but found record at (topic='quickstart-events',partition=0,offset=0,timestamp=1645938414713)...
## Problem current connect does not support db2 jdbc driver ## Solution Update the dependency configuration file by adding db2 jdbc driver information ##### Does this solution apply anywhere else?...
It would be useful if the JDBC sink connector had better support for when messages are read that cannot be written to the target database. This includes errors such as...
Kafka Connect Version : 7.0.1 Jdbc Sink Conector version : 10.2.5 Facing Casting issue when using JDBC sink connector while inserting/sinking varchar data into postgres db with datatype as Ltree....