kafka-connect-storage-common

kafka-connect-storage-common copied to clipboard

FieldPartitioner Map and Nested Value Support

5

Also accept dot-separated field names like Time Partitioner's RecordField does Closes #32

OneCricketeer

Update parquet version

1

To add zstd-jni and support zstd-jni compression easily in connectors. cf: https://github.com/apache/parquet-mr/pull/793 ## Problem Currently, to access the zstd compression. We need to add the Hadoop native library, cf: https://github.com/confluentinc/kafka-connect-storage-cloud/issues/570#issuecomment-1384326683...

bluesheeptoken

Bump libthrift from 0.13.0 to 0.14.0

1

Bumps [libthrift](https://github.com/apache/thrift) from 0.13.0 to 0.14.0. Release notes Sourced from libthrift's releases. Version 0.14.0 For release 0.14.0 head over to the official release download source: http://thrift.apache.org/download The assets below are...

dependabot[bot]

Hey, I noticed that this SchemaSourceConnector shows up in the final packaged artifact for multiple connectors. Is this intended to be packaged, or is it a test-only class that users...

gharris1727

Add a parameter to disable using a topic name as a partition part

ostetsenko

We use KafkaConnect to dump topics to AWS S3. Analyzing data is pretty simple with Athena + AWS Glue (Crawlers) + AWS S3. It looks like a common way for...

ostetsenko

## Problem https://github.com/confluentinc/schema-registry/pull/1873 introduced the option to scrub invalid schema names, but the storage connectors can't take advantage of it as it's not an exposed config. ## Solution Expose the...

mukkachaitanya

kafka s3 sink connect complains Error retrieving Avro value schema version for id 12345

4

I'm trying to set up a kafka s3 sink connector that will consume messages in avro format and dump to s3 compatible storage (minio) in parquet format. This pipe line...

jma562

Vulnerable package update

2

## Problem Some vulnerable packages are reported in kafka-connect-storage-common git. 1. Netty 4.1.71.Final https://nvd.nist.gov/vuln/detail/CVE-2022-24823 Fixed in 4.1.77 version 2. Jetty 9.4.43.v20210629 https://nvd.nist.gov/vuln/detail/CVE-2022-2048 Fixed in 9.4.48.v20220622 ## Solution Bumping up to...

pranayk01

CVE-2022-42003, CVE-2022-42004 (jackson-databind)

1

jackson-databind 2.13.2.1 includes two HIGH severity CVEs: CVE-2022-42003 - Fix: upgrade to >= 2.14.0-rc1 CVE-2022-42004 - Fix: upgrade to >= 2.13.4

cameronwaterman