kafka-connect-storage-common
kafka-connect-storage-common copied to clipboard
confluentinc
Shared software among connectors that target distributed filesystems and cloud storage.
Found when scanning an image with JFrog XRAY that pulls in `kafka-connect-storage-common`. > XRAY-125253 > Severity: High > Type: Security > Summary: Apache Commons IO input/InfiniteCircularInputStream.java InfiniteCircularInputStream::read() Function Buffer Handling...
How can I partitioning with key? If I use fieldpartitioner, partition.field.name should be set to which value? And if I want to partitioning my data with key and hold just...
Hi, I implement a custom partitioner for the sink and source s3 connector. Partitioner: package io.confluent.connect.storage.partitioner; import java.util.List; import java.util.Locale; import java.util.Map; import org.apache.kafka.connect.sink.SinkRecord; import org.joda.time.DateTimeZone; import org.slf4j.Logger; import org.slf4j.LoggerFactory;...
When the [pom.xml file references the confluent maven repository](https://github.com/confluentinc/kafka-connect-storage-common/blob/487c6be201e5d1204f91c0ad7b6bddd587e1a037/pom.xml#L74), it uses (insecure) instead of (secure). This conflicts with the 3.8.1+ versions of maven, which block the use of HTTP repositories...
1. https://nvd.nist.gov/vuln/detail/CVE-2022-24823 Fixed in 4.1.77 version 2. https://nvd.nist.gov/vuln/detail/CVE-2022-2048 Fixed in 9.4.48.v20220622
Update pom.xml to use hadoop version 3.3.3 to remediate security vulnerabilities CVE-2021-37404 CVE-2022-26612 This addresses the issue raised here: https://github.com/confluentinc/kafka-connect-storage-cloud/issues/508 ## Problem ## Solution ##### Does this solution apply anywhere...
JSON support in Kafka Connect is known to not have too much functionality built in for JSON at the moment. However, it would be really nice to allow for stringified...
## Problem ## Solution ##### Does this solution apply anywhere else? - [ ] yes - [ ] no ##### If yes, where? ## Test Strategy ##### Testing done: -...
Similarly to reported here the build on fresh m2 repo (after following steps in FAQ for Confluent s3) doesn't work: https://github.com/confluentinc/kafka-connect-storage-common/issues/60 ``` [INFO] kafka-connect-storage-hive ......................... FAILURE [ 6.034 s] [INFO]...
https://github.com/confluentinc/kafka-connect-storage-common/wiki/FAQ ``` git clone https://github.com/confluentinc/kafka/; cd kafka ./gradlew installAll * What went wrong: Task 'installAll' not found in root project 'kafka'. Some candidates are: 'install'. ```
Metadata
Owner
Metadata
Shared software among connectors that target distributed filesystems and cloud storage.