alpakka-kafka
alpakka-kafka copied to clipboard
Alpakka Kafka connector - Alpakka is a Reactive Enterprise Integration library for Java and Scala, based on Reactive Streams and Akka.
### Short description The `KafkaConsumerActor` will log any exceptions returned from polling records as `DEBUG`. This can hide important runtime error information when users don't have `DEBUG` enabled for Alpakka...
### Short description * Should `Producer.flow` which has been deprecated since 0.21 be removed? * In the longer term, should `flexiFlow` become the new `flow`? ### Details The `Producer.flexiFlow` was...
### Short description When exceptions are passed to the offset commit callback they are passed back to the original committer as an ask response which will fail the stream. We...
### Short description Apache Kafka provides a `MockConsumer` and `MockProducer` implementation. We should investigate if we can reuse and wrap these mocks in our own client mocking solution. ### Details...
After getting a partition assignment, KafkaConsumerActor tries to retrieve the position of the consumer: `def assignedPositions(assignedTps: Set[TopicPartition], consumer: Consumer[_, _], positionTimeout: java.time.Duration): Unit = { val assignedOffsets = assignedTps.map(tp =>...
### Short description It's been observed that every time an Alpakka Kafka source app is run that all partitions are first revoked before assignments take place. We should investigate why...
The new support to not backpressure for commit replies should be promoted to official API or deprecated and be removed again. This is a discussion issue for reference from the...
Stopping a transactional flow is currently somewhat awkward (https://doc.akka.io/docs/alpakka-kafka/current/transactions.html#recovery-from-failure). I wonder if an approach like `SharedKillSwitch` could work here, where the user instantiates one `SharedDrainingControl` (naming is hard) and passes...
## Purpose Resolves #791 ## Changes Introduces waiting for commit message before emitting from an element from the `TransactionalProducerStage`. This has the following effect on the logic: After the `TransactionalProducerStage`...
## Short description Show use with Avro's `SpecificRecord` in Java examples. ### Details In [Avro with Schema Registry](https://doc.akka.io/docs/alpakka-kafka/current/serialization.html#avro-with-schema-registry) the Scala example code does show the use with `SpecificRecord`, but the...