kafka-connect-protobuf-converter

kafka-connect-protobuf-converter copied to clipboard

Snyk has created this PR to fix one or more vulnerable packages in the `maven` dependencies of this project. #### Changes included in this PR - Changes to the following...

snyk-bot

StackOverFlowError at toConnectSchema

3

Hi! I'm getting this error when trying to start my Kafka connector ``` [2021-06-11 14:29:10,173] ERROR Failed to start task mqtt-source-0 (org.apache.kafka.connect.runtime.Worker:560) java.lang.StackOverflowError at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.base/java.lang.reflect.Method.invoke(Method.java:566) at com.google.protobuf.GeneratedMessageV3.invokeOrDie(GeneratedMessageV3.java:1856) at...

TobiasKrok

It would be nice to have support for wrapped messages. For instance, consider having `Message` object with a few fields, one of each is `payloadMessage`, a payload with its schema....

rvdovychenko-sift

Only supports primitive message fields?

2

I'm attempting to use this in a source connector to convert from connect format to protobuf and am getting an `Unknown schema type: STRUCT` exception when it's trying to convert...

ctoomey

Is there a plan to support the `optional` keyword? Upgrading the protobuf-java library is required for that as well. I have a local fork which makes it work, but it's...

claudebossy

A support for schema registry and auto schema evolution between source/sink connectors

2

I'm using Kafka connect JDBC connectors via Json, Avro and Protobuf. As for Protobuf, `kafka-connect-protobuf-converter` may be practically a de-facto standard as converter in Kafka connect. It is very grateful...

dorocoder

Use with producer client

1

Hi, Is it possible to use this converter with a producer client instead of a connetor? I am asking this because I tried configuring a connector for my data source...

rakeshbgupta

Proto class kafka.message.ExchangeMessage$Order not found in the classpath

1

I am trying to setup a mongo-kafka-connector against Apache Kafka 2.5. ExchangeMessage.proto -------------------- syntax = "proto3"; package exchange_message_def; option java_package = "kafka.message"; option java_outer_classname = "ExchangeMessage"; option optimize_for = SPEED;...

steephengeorge

We tested out this converter on a debezium topic and we noticed that it doesn't translate debezium logical types. There are a bunch of debezium logical types: https://debezium.io/documentation/reference/0.10/connectors/mysql.html#data-types and I'm...

mtagle

ProtobufData#fromConnectData throws NullPointerException if the int64 (logical Timestamp type) field's value is null. ``` org.apache.kafka.connect.errors.ConnectException: Tolerance exceeded in error handler at org.apache.kafka.connect.runtime.errors.RetryWithToleranceOperator.execAndHandleError(RetryWithToleranceOperator.java:178) at org.apache.kafka.connect.runtime.errors.RetryWithToleranceOperator.execute(RetryWithToleranceOperator.java:104) at org.apache.kafka.connect.runtime.WorkerSourceTask.convertTransformedRecord(WorkerSourceTask.java:284) at org.apache.kafka.connect.runtime.WorkerSourceTask.sendRecords(WorkerSourceTask.java:309) at org.apache.kafka.connect.runtime.WorkerSourceTask.execute(WorkerSourceTask.java:234)...

rahul-aravind-opti