s3-connector-for-apache-kafka

s3-connector-for-apache-kafka copied to clipboard

Bumps [com.amazonaws:aws-java-sdk-s3](https://github.com/aws/aws-sdk-java) from 1.12.670 to 1.12.713. Changelog Sourced from com.amazonaws:aws-java-sdk-s3's changelog. 1.12.713 2024-05-01 AWS SecurityHub Features Updated CreateMembers API request with limits. Agents for Amazon Bedrock Features This release adds...

dependabot[bot]

Bumps [com.amazonaws:aws-java-sdk-sts](https://github.com/aws/aws-sdk-java) from 1.12.649 to 1.12.713. Changelog Sourced from com.amazonaws:aws-java-sdk-sts's changelog. 1.12.713 2024-05-01 AWS SecurityHub Features Updated CreateMembers API request with limits. Agents for Amazon Bedrock Features This release adds...

dependabot[bot]

Hi all, I'm not an expert in java so it is difficult to me to know if the tombstone records are supported. If had seen that the null key values...

isalvat

Use default or custom provider chain for s3 authentication

1

This PR replaces https://github.com/Aiven-Open/s3-connector-for-apache-kafka/pull/227 which was originally implemented by @steephengeorge. Most of the hard work was already done by @steephengeorge and this PR is a duplicate that addresses the last...

markallanson

Use default or custom provider chain for s3 authentication

13

steephengeorge

Extend timestamp variable parameters in File name format

1

# Scenario Overview We use s3 filename template `prefix/'%Y_%m_%d__%H_%M_%S_%f` to sort filenames alphabetically. The next new file is guaranteed to receive the following name in alphabetical order. In kafka, we...

BulgakovKD

If not already currently possible (I wasn't able to find any mention of it in the docs), it would be great to be able to configure `aws.access.key.id` and `aws.secret.access.key` from...

erikcw

Out-of-Memory errors when sinking large topics

4

# Scenario Overview We have several topics, each of them already containing gigabytes of data (~1-10 millions of records). We need to export the data to S3. # Issue: Using...

vpapanchev

When using the S3 connector and grouping records by key we have encountered this error: > consumer` poll timeout has expired. This means the time between subsequent calls to poll()...

stephen-harris

S3 Source Connector

7

Hello, Is there an S3 Source connector that can read the data uploaded by this Sink connector?

arnitolog