kafka-connect-fs
kafka-connect-fs copied to clipboard
mmolimar
Kafka Connect FileSystem Connector
The current parquet dependency is for the 1.11.x version, which doesn't support INT96 types. Older datasets generated by Spark applications may have used this type. Parquet 1.12+ has added support...
Hi, I am using FsSourceConnector Kafka connector to ingest CSV files into a Kafka topic. I am using confluentinc/cp-helm-charts, with custom build docker image for Kafka connect (Added FsSourceConnector connector...
I need help with the connector. I'm trying to make a simple source but the file is on a windows server (I have the IP and the access port). I'm...
Hi, I would like to enable your FS Connector at my environment with specs below: Apache Kafka : 1.0.0 HDP : 3.1.4 Scala : 2.11.12 I tired to update pom...
Sorry for making an issue for this topic, but i am stuck a couple of days already. Maybe someone could help me out :) I want the 'FileSystem Source Connector'...
I am trying to move the csv file to another folder after processing is done. I can see it being processed to kafka topic but the file is not moved...
This might same with #89 , but I've tried several cron expressions and nothing works. No change on `offset.flush.internal.ms` so it uses default 60000 ms (as stated [here](https://docs.confluent.io/platform/current/connect/references/allconfigs.html)) This might...
Hi @mmolimar Thank you for the Kafka Connect FileSystem Connector. Current release v1.3.0 is using the cron-utlis-9.1.3 version which is having a security vulnerability. I see its already upgraded to...
I've json file with following content: { "integerField": "0", "structField": { "structField1": { "integerField": "0", "longField": "922", "stringField": "0_56c08500-02ff-4434-8fa6-8affccb6d60b", "booleanField": true, "decimalField": "0.0" } } } Deployed connector without providing...
When a file is processed, imagine file1.csv, I could not have the same file (if I copy it in the directory) processed again. Is it normal?
