kafka-connect-file-pulse

kafka-connect-file-pulse copied to clipboard

I have a log file where data in jsonl form is accumulated. {} {} {} It builds up underneath in form. The first time you connect the connector, read the...

gurudykim

Allow Special Character Handling

3

**Describe the issue** Using this programming to transfer data fails for data that includes Special Chars ( $%^& etc.) , especially when those Special Char's are in the Header (field...

e160842

LastModifiedFileFilter missing from 2.14.0-early-access

1

**Describe the bug** io.streamthoughts.kafka.connect.filepulse.fs.filter.LastModifiedFileFilter doesn't seem to be in [Release 2.14.0-early-access](https://github.com/streamthoughts/kafka-connect-file-pulse/releases/tag/2.14.0-early-access)

pmizenin

SerializationException: Error registering Avro schema

2

Hi, I am trying to create a s3 source connector with below configuration ```sh curl \ -i -X PUT -H "Accept:application/json" \ -H "Content-Type:application/json" http://localhost:8080/connectors/s3_source_connector/config \ -d '{ "connector.class": "io.streamthoughts.kafka.connect.filepulse.source.FilePulseSourceConnector",...

neeru-bhaskar

Schema Registry & Amazon S3 Move Cleanup Policy Questions

1

I am running the latest version of the bitnami kafak docker images using docker compose. It has zookeeper, kafka, connect, and ksqldb all configured and working with other connectors so...

jwhitehead77

Support for AWS S3 server-side-encryption

1

**Is your feature request related to a problem? Please describe.** I'm using File Pulse Source connector version 2.9.0 to read files in AWS S3 bucket and publish into kafka. I...

Aaronni03

Processing Hug files with JSON data takes hours together

2

Hi we have 3-4 files with 3GB. and have over 500 million records in each. These files needs to be processed by the kafka file pulse connector. for one file...

veeraraghukiranyerva

AzureBlobStorageFileSystemListing could not be found

2

Hello I am getting this error with the connector version **2.10.x**. I installed it over confluent hub. ` Connector Creation: validating the connector config for connector blob-to-kafka resulted in the...

irux

CSV file, filter with list of columns

10

Hi team, and thanks for a great product! I’m using FilePulseSourceConnector with CSVFilter type. My source files don’t have any headers. When I have the following configuration, everything is working...

ypynda

Running csv example results in an error

1

Docker Compose version v2.19.1 Docker version 23.0.1 Darwin Kernel Version 22.1.0: Sun Oct 9 20:14:30 PDT 2022; root:xnu-8792.41.9~2/RELEASE_ARM64_T8103 arm64 arm Working with commit 75304f913ad429f491932332d995d928a3561eae Posting the following results in an...

pmizenin