kafka-connect-protobuf-converter
kafka-connect-protobuf-converter copied to clipboard
Sink connector with protobuf is not working!
I have been trying to produce data using Javaclient and store data in postgres using sink-connector. i can post data into topic in protobuf format, but sink-connector seems not working. Just make sure that data being posted and available in topic, i built consumer in Java-client, and i can see data.
So data is there in topic, but something wrong with my sink-connector config. please find config details below, any help much appreciated!
connect-standalone.properties: bootstrap.servers=localhost:9092 key.converter=com.blueapron.connect.protobuf.ProtobufConverter value.converter=com.blueapron.connect.protobuf.ProtobufConverter key.converter.schemas.enable=false value.converter.schemas.enable=true offset.storage.file.filename=/tmp/connect.offsets offset.flush.interval.ms=10000
connect-postgres-protobuf.properties:
name=sink-postgres connector.class=io.confluent.connect.jdbc.JdbcSinkConnector tasks.max=2 topics=docker-proto-topic connection.url=jdbc:postgresql://localhost:5432/kafka-test connection.user=postgres connection.password=*** insert.mode=insert value.converter=com.blueapron.connect.protobuf.ProtobufConverter value.converter.protoClassName=com.test.extraction.model.protobuf.AlbumOuterClass$Album key.converter=com.blueapron.connect.protobuf.ProtobufConverter auto.create=true auto.evolve=false offset.storage.file.filename=/tmp/post-sink.offsets