kafka-connect-storage-cloud icon indicating copy to clipboard operation
kafka-connect-storage-cloud copied to clipboard

Exception/error when using Avro Converter

Open kiranbiswal opened this issue 2 years ago • 3 comments

While to trying to use kafka connect for Avro to parquet conversion, getting below error 2022-09-13T04:31:25.000-07:00 [Worker-09b46c2558b13220a] Caused by: java.lang.ClassNotFoundException: com.google.common.base.Ticker [Worker-09b46c2558b13220a] Caused by: java.lang.ClassNotFoundException: com.google.common.base.Ticker

connector configuration:

connector.class=io.confluent.connect.s3.S3SinkConnector s3.region=xxx partition.duration.ms=3600000 flush.size=1000 topics=msk-test1 tasks.max=4 timezone=UTC locale=en-US offset.flush.interval.ms=120000 value.converter.schema.registry.url=yyy key.converter.schemas.enable=true format.class=io.confluent.connect.s3.format.parquet.ParquetFormat partitioner.class=io.confluent.connect.storage.partitioner.TimeBasedPartitioner value.converter.schemas.enable=true value.converter=io.confluent.connect.avro.avroConverter storage.class=io.confluent.connect.s3.storage.S3Storage key.converter=io.confluent.connect.avro.avroConverter key.converter.schema.registry.url=yyy s3.bucket.name=zzz path.format='''date_month'''=YYYY-MM/'''date_hour'''=YYYY-MM-dd-HH rotate.schedule.interval.ms=3600000

Using below:

confluentinc-kafka-connect-avro-converter-7.2.1 confluentinc-kafka-connect-s3-10.2.0

kiranbiswal avatar Sep 13 '22 15:09 kiranbiswal

Duplicates #444

OneCricketeer avatar Sep 16 '22 13:09 OneCricketeer

Duplicates #444

Does it? It's still missing in confluent-kafka-connect-avro-converter.

colinleroy avatar Mar 28 '23 11:03 colinleroy

still missing in confluent-kafka-connect-avro-converter

Then that's a separate issue you should report to the schema-registry repo, where that converter exists.

Regardless, if you have S3 sink connector (this repo) on the classpath, then Avro Converter should be able to find Guava classes

OneCricketeer avatar Mar 29 '23 00:03 OneCricketeer