kafka-connect-protobuf-converter icon indicating copy to clipboard operation
kafka-connect-protobuf-converter copied to clipboard

Sink connector with protobuf is not working!

Open oviyan opened this issue 5 years ago • 0 comments

I have been trying to produce data using Javaclient and store data in postgres using sink-connector. i can post data into topic in protobuf format, but sink-connector seems not working. Just make sure that data being posted and available in topic, i built consumer in Java-client, and i can see data.

So data is there in topic, but something wrong with my sink-connector config. please find config details below, any help much appreciated!

connect-standalone.properties: bootstrap.servers=localhost:9092 key.converter=com.blueapron.connect.protobuf.ProtobufConverter value.converter=com.blueapron.connect.protobuf.ProtobufConverter key.converter.schemas.enable=false value.converter.schemas.enable=true offset.storage.file.filename=/tmp/connect.offsets offset.flush.interval.ms=10000

connect-postgres-protobuf.properties:

name=sink-postgres connector.class=io.confluent.connect.jdbc.JdbcSinkConnector tasks.max=2 topics=docker-proto-topic connection.url=jdbc:postgresql://localhost:5432/kafka-test connection.user=postgres connection.password=*** insert.mode=insert value.converter=com.blueapron.connect.protobuf.ProtobufConverter value.converter.protoClassName=com.test.extraction.model.protobuf.AlbumOuterClass$Album key.converter=com.blueapron.connect.protobuf.ProtobufConverter auto.create=true auto.evolve=false offset.storage.file.filename=/tmp/post-sink.offsets

oviyan avatar Jan 07 '20 15:01 oviyan