kafka-connect-hdfs

kafka-connect-hdfs copied to clipboard

Bump libthrift from 0.13.0 to 0.14.0

1

Bumps [libthrift](https://github.com/apache/thrift) from 0.13.0 to 0.14.0. Release notes Sourced from libthrift's releases. Version 0.14.0 For release 0.14.0 head over to the official release download source: http://thrift.apache.org/download The assets below are...

dependabot[bot]

log4j update schedule

1

May I know the update schedule to the 2.17 version of log4j?

Kimakjun

Hi, We creating a hdfs sink connector based with a partition.field.name. This partition field is present in the middle of the avro data. HDFS Connector creates hive table structure as...

swathimocharla

java.util.ConcurrentModificationException during task rebalancing

1

We're using 5.4.3 version of Confluent and observed that during a task rebalancing, it threw the below exception for multiple partitions: ``` [ERROR] 2021-12-12 03:34:16,891 org.apache.kafka.connect.runtime.WorkerTask doRun - WorkerSinkTask{id=hdfs-connector-prod-399} Task...

smj19

Issue in a Kerberized environment a day after renew ticket

2

Hi, I have a problem in a Kerberized environment: when I start the connector everything is working fine, I obtain my Kerberos credentials and the connector start writing without issues....

dinegri

hdfs: java.io.FileNotFoundException: File does not exist ,while file was there

6

I'm really new in apache environment, and currently im trying to ingest kafka topics into hdfs using hdfs3sink connector. Most of my apache environment was installed via ambari HDP. i...

yuliansen

how to ensure exactly once delivery?

1

https://docs.confluent.io/kafka-connect-hdfs3-sink/current/overview.html#exactly-once-delivery > The connector uses a write-ahead log to ensure each record is written to HDFS exactly once. Also, the connector manages offsets by encoding the Kafka offset information into...

kimnami

NullPoint Exception, io.confluent.connect.hdfs3.Hdfs3SinkTask.open

1

I'm using the hdfs3 connector to consume data in kafka and stack it in hdfs3. My Kafka confluent, sink connect version is below. ``` kafka-confluent:5.4.2-1 confluentinc/kafka-connect-hdfs3:latest ``` and my connect...

Kimakjun

using wrong user/keytab while there are multiple hdfs-sink connections

1

I got two hdfs-sink connections, in the config, the first will get data from topic 1 and sink to /hdfs/url1 (user1, using keytab1), the second will get data from topic...

charlielin

use of many connections with multiple keytabs

9

I used two hdfs-sink connections, the first will get data from topic 1 and sink to /hdfs/url1 (use of keytab1) the second will get data from topic 2 and sink...

aminejamoussi