kafka-connect-storage-common icon indicating copy to clipboard operation
kafka-connect-storage-common copied to clipboard

Deprecated HiveFactory Support

Open serefacet opened this issue 3 years ago • 1 comments

Hello all,

I'm just curious why the hiveFactory method is deprecated in Format class. I'm not able to find any explanation as a replacement even though it's used by kafka-connect-hdfs connector.

I'm asking this question because we are thinking about adding Hive partitions from Kafka S3 Connector in order to access the data whenever it's transferred to S3. Now, we are handling this requirement with a scheduled workflow that checks the partition folders in S3 and adds corresponding Hive partitions if not exists. But, we would like to handle that through Kafka Connect.

To sum up, we just want to check the project roadmap before implementing this feature. If the hive support is no longer considered in the future, we don't want to lock into the specific Kafka Connect versions.

Thank you in advance

serefacet avatar Mar 04 '21 13:03 serefacet

Look like hive support is not about to get remove from storage-commun -> https://github.com/confluentinc/kafka-connect-storage-common/pull/203

raphaelauv avatar Aug 07 '21 14:08 raphaelauv