kafka-connect-hdfs icon indicating copy to clipboard operation
kafka-connect-hdfs copied to clipboard

Kafka Connect HDFS connector

Results 131 kafka-connect-hdfs issues
Sort by recently updated
recently updated
newest added

Hi, I am using the following docker image to run my workers: confluentinc/cp-kafka-connect:3.2.2. I looked at the existing issues and it does look a lot like [178](https://github.com/confluentinc/kafka-connect-hdfs/issues/178), but it seems...

## Problem ## Solution ##### Does this solution apply anywhere else? - [ ] yes - [ ] no ##### If yes, where? ## Test Strategy ##### Testing done: -...

## Problem ## Solution ##### Does this solution apply anywhere else? - [ ] yes - [ ] no ##### If yes, where? ## Test Strategy ##### Testing done: -...

## Problem When using a custom partitioner, one can opt out from having topic data separated into topic specific directory. But when writing data from N topics under the same...

Hive few years back added a ACID incremental rollup Merge and I was wondering if it was ever considered to add it to to kafka-connect-hdfs on top of the APPEND...

Kafka Connect HDFS is running in distributed mode (_the same problem was observed in standalone mode_). Sometimes after Kafka Connect HDFS is restarted, small (4 bytes) parquet files appear in...

## Problem I'm new to this project. When I forked the project to the local computer,my IDEA ide throw an exception about cannot resolve parent project. ![shortcut1](https://user-images.githubusercontent.com/37236056/161796789-72ba96f1-18a4-4331-9294-b0bae0747d7c.png) ``` Could not...

## Problem Hive 2.3.7 breaks the connector as described https://github.com/confluentinc/kafka-connect-hdfs/issues/578 We verified the repro and bumped hive in the parent here https://github.com/confluentinc/kafka-connect-storage-common/pull/213 but we didn't upgrade the dependency in the...

I'm using Kafka Connect HDFS Connector to write Avro topics with Decimal fields. I'm using integration with Hive. When reading data I'm getting following exception: Error: java.io.IOException: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.ClassCastException: org.apache.hadoop.hive.serde2.io.HiveDecimalWritable...

This patch introduces a change in WAL and recovery process. The idea is to avoid expensive scan of all table files that could take longer than one hour for large...