gcs-connector-for-apache-kafka
gcs-connector-for-apache-kafka copied to clipboard
Aiven-Open
Aiven's GCS Sink Connector for Apache Kafka®
Hi all, hope everithing is fine. Currently we are working on a feature that uses this connector to dump debezium CDC messages. Our deployed connector is currently working based on...
Users willing to leverage GCS capability to decompress gzip objects on server-side when accessing them through the Storage API requested the fixed-metadata `Content-Encoding` (default: null) to become configurable so that...
Could this be because of this: https://issues.apache.org/jira/browse/PARQUET-1866 maybe? ```log 2022-12-01 00:56:14,469 ERROR [kafka-sink-connector-gcs|task-0] WorkerSinkTask{id=kafka-sink-connector-gcs-0} Commit of offsets threw an unexpected exception for sequence number 6: null (org.apache.kafka.connect.runtime.WorkerSinkTask) [task-thread-kafka-sink-connector-gcs-0] org.apache.kafka.connect.errors.ConnectException: java.lang.RuntimeException:...
Hi I do know I have raised an [issue](https://github.com/aiven/gcs-connector-for-apache-kafka/issues/204) for availability to send avro data to GCS using the GCS sink connector. I am trying a workaround but i am...
I have the following file for gcs sink connector for events to be stored in parquet format? But this thing is not working. Is there anything more needed for parquet...
I'm running into an issue where the connector's JVM exists with an OOM error when sinking a topic freshly snapshotted through a PG database through Debezium. The setup: - 2...
It's possible to change the time that dump is made into the GCS bucket? I see that every 3 minutes the files are saved and the only variable that I...
I am trying to create files in CSV format for storage on a GCS bucket. It seems with encoding set to Base64, the CSV files remain as such in plaintext,...
After upgrade to `google-cloud-nio:0.123.24` (and associated `google-cloud-storage:2.4.5`), `GcsSinkTaskGroupByTopicPartitionPropertiesTest.limited` started running very long time. It used to be a couple of minutes, but is unknown (I wan't patient enough to wait...
