kafka-connect-storage-cloud
kafka-connect-storage-cloud copied to clipboard
Exception/error when using Avro Converter
While to trying to use kafka connect for Avro to parquet conversion, getting below error 2022-09-13T04:31:25.000-07:00 [Worker-09b46c2558b13220a] Caused by: java.lang.ClassNotFoundException: com.google.common.base.Ticker [Worker-09b46c2558b13220a] Caused by: java.lang.ClassNotFoundException: com.google.common.base.Ticker
connector configuration:
connector.class=io.confluent.connect.s3.S3SinkConnector s3.region=xxx partition.duration.ms=3600000 flush.size=1000 topics=msk-test1 tasks.max=4 timezone=UTC locale=en-US offset.flush.interval.ms=120000 value.converter.schema.registry.url=yyy key.converter.schemas.enable=true format.class=io.confluent.connect.s3.format.parquet.ParquetFormat partitioner.class=io.confluent.connect.storage.partitioner.TimeBasedPartitioner value.converter.schemas.enable=true value.converter=io.confluent.connect.avro.avroConverter storage.class=io.confluent.connect.s3.storage.S3Storage key.converter=io.confluent.connect.avro.avroConverter key.converter.schema.registry.url=yyy s3.bucket.name=zzz path.format='''date_month'''=YYYY-MM/'''date_hour'''=YYYY-MM-dd-HH rotate.schedule.interval.ms=3600000
Using below:
confluentinc-kafka-connect-avro-converter-7.2.1 confluentinc-kafka-connect-s3-10.2.0
Duplicates #444
Duplicates #444
Does it? It's still missing in confluent-kafka-connect-avro-converter.
still missing in confluent-kafka-connect-avro-converter
Then that's a separate issue you should report to the schema-registry repo, where that converter exists.
Regardless, if you have S3 sink connector (this repo) on the classpath, then Avro Converter should be able to find Guava classes