camel-kafka-connector

camel-kafka-connector copied to clipboard

Now that we are near to Camel 3.11.0 LTS release, I think it makes sense to bump to 1.0.0 and release, so we'll be in line with the Camel release...

oscerd

Information required on Camel file sink connector configurations

3

I have used CamelFileSInk connector in one of our project and I would like to write each messages that is being read from a Kafka topic by the connector into...

sammy445

telegram connector convert to json

23

is there a way to convert the output of a telegram connector (and actually of any other kind of Camel connector) into JSON? so far i only get this kind...

dberardo

camel-mongodb-kafka-connector “camel.source.endpoint.streamFilter” invalid

2

``` { "connector.class": "org.apache.camel.kafkaconnector.mongodb.CamelMongodbSourceConnector", "tasks.max": "1", "topics": "mongo.test-object.save.source", "camel.source.endpoint.consumerType": "changeStreams", "camel.source.path.connectionBean": "mongo", "errors.deadletterqueue.context.headers.enable": "true", "camel.source.endpoint.collection": "test_object", "camel.source.endpoint.database": "ac-test", "errors.deadletterqueue.topic.name": "mongo.test-object.save.source.deadletter", "value.converter.schemas.enable": "false", "errors.tolerance": "all", "errors.deadletterqueue.topic.replication.factor": "1", "camel.source.endpoint.streamFilter": "{'$match':{'$or':[{'operationType':'insert'},{'operationType':'update'},{'operationType':'replace'}]}}", "value.converter": "org.apache.kafka.connect.json.JsonConverter",...

yingbo-wu

Create example camel-salesforce connector

10

valdar

[camel-kafka-connector-docs-maven-plugin] : make some parameters configurable

1

Please see: https://github.com/apache/camel-kafka-connector/blob/main/tooling/camel-kafka-connector-docs-maven-plugin/src/main/java/org/apache/camel/kafkaconnector/maven/docs/UpdateDocComponentsListMojo.java#L51 https://github.com/apache/camel-kafka-connector/blob/main/tooling/camel-kafka-connector-docs-maven-plugin/src/main/java/org/apache/camel/kafkaconnector/maven/docs/UpdateDocComponentsListMojo.java#L171

valdar

Use the deliverable artifact in the plugin.path during testing

3

The `plugin.path` configured in the connect runtime uses either the path of the [packaged jar](https://github.com/apache/camel-kafka-connector/blob/2b46335a9d28bbf09ca37507d409b0db9322b616/tests/src/test/java/org/apache/camel/kafkaconnector/PluginPathHelper.java#L45) or the [compiled classes](https://github.com/apache/camel-kafka-connector/blob/2b46335a9d28bbf09ca37507d409b0db9322b616/tests/src/test/java/org/apache/camel/kafkaconnector/PluginPathHelper.java#L64). There is one circumstance where this is less than ideal: when...

orpiske

Question: S3 file get moved on failure also

10

Hello, I am using the `aws2-s3-kafka-source-connector` connector (https://github.com/apache/camel-kafka-connector/tree/camel-kafka-connector-0.7.x/connectors/camel-aws2-s3-kafka-connector) with the following configs. ``` apiVersion: kafka.strimzi.io/v1alpha1 kind: KafkaConnector metadata: name: name-connector labels: strimzi.io/cluster: kafka-connect-cluster spec: tasksMax: 1 class: org.apache.camel.kafkaconnector.aws2s3.CamelAws2s3SourceConnector config: client.id:...

ruchirvaninasdaq

Convert Struct to Map in the core so it can be used by JsonConverter, AvroConverter .. etc

1

There are components/connectors that need the message body to be in form of Map, for example Camel Stitch, Camel SQL .. etc. Hence if you have a JSON data message...

omarsmak

Couchbase fails due to incorrect URI format

15

When trying Couchbase with the given configuration, the connector fails complaining that the URL format is invalid: ```2020-10-22 14:08:06,300 [SinkConnector-0] ERROR org.apache.camel.processor.errorhandler.DefaultErrorHandler - Failed delivery for (MessageId: E1DBFDB5E174861-0000000000000000 on ExchangeId:...

orpiske