kafka-connect-protobuf-converter
kafka-connect-protobuf-converter copied to clipboard
Protobuf converter plugin for Kafka Connect
StackOverflow Exception while using my own protoClassName having field type google.protobuf.Struct
Hi, I'm using protobuf-converter for S3 sink connector for ingesting protobuf from kafka to S3. my sink config looks like - Map.entry("connector.class", "io.confluent.connect.s3.S3SinkConnector"), Map.entry("topics", "topicName"), Map.entry("tasks.max", 1), Map.entry("flush.size", 100), Map.entry("rotate.schedule.interval.ms",...
If you have a protobuf file like this MessageA{ MessageB hello = 1; } MessageB{ MessageC hello = 1; } MessageC{ String abc =1; } Then this would result in...
Hello, I've installed protobuf convertor and build my own protobuf definition jar. I've put it into ../confluent/share/java/kafka-serde-tools/ directory in my connector definition I set up `"value.converter.protoClassName":"com.rl.messaging.messages.BusinessEventMessages$BusinessEvent"` `when I'm starting connector...
Currently, `kafka-connect-protobuf-converter` converts proto messages to the object with keys in `snake_case`. It happens on line 71: [https://github.com/blueapron/kafka-connect-protobuf-converter/blob/master/src/main/java/com/blueapron/connect/protobuf/ProtobufData.java#L71](https://github.com/blueapron/kafka-connect-protobuf-converter/blob/master/src/main/java/com/blueapron/connect/protobuf/ProtobufData.java#L71) ```String name = descriptor.getName();``` Having an option that toggles between `snake_case` and...
Assume a following simple protobuf schema ``` message NestedStruct_1 { optional int64 nestedField_1 } message NestedStruct_2 { optional int64 nestedField_2 } message Struct_1 { optional NestedStruct_1 nested = 1; }...
I have been trying to produce data using Javaclient and store data in postgres using sink-connector. i can post data into topic in protobuf format, but sink-connector seems not working....
Hi I am using kafka connect file sink so i was able to successfully sink the topic content to file but same file when i try to load to some...
Snyk has created this PR to fix one or more vulnerable packages in the `maven` dependencies of this project. #### Changes included in this PR - Changes to the following...
This PR was automatically created by Snyk using the credentials of a real user.Snyk has created this PR to upgrade org.apache.kafka:connect-api from 1.0.0 to 1.1.1. :information_source: Keep your dependencies up-to-date....
This PR was automatically created by Snyk using the credentials of a real user.Snyk has created this PR to upgrade com.google.protobuf:protobuf-java-util from 3.11.1 to 3.21.5. :information_source: Keep your dependencies up-to-date....