onyx-kafka

onyx-kafka copied to clipboard

Based on https://github.com/onyx-platform/onyx-kafka/blob/b092ad0e96bd52bb38e9b447834d78c072a0fb47/src/onyx/kafka/information_model.cljc , it should be valid to pass :kafka/commit-interval as a `kafka-opt` to the plugin. Actually passing this results in a Schema validation error (I don't recall the...

Quezion

This implements #60 I made the configs first-class keys, and not using kafka/consumer-opts. Consumer-opts feels more like "whatever this plugin did not consider".

danieroux

StringSerializer/StringDeserializer instead of ByteArraySerializer/ByteArrayDeserializer

1

I would really like `org.apache.kafka.common.serialization.StringDeserializer` for `key.deserializer` and `key.serializer`. My data is small

danieroux

Troubleshooting simple job not writing to a topic

1

Hey there, I'm playing with a recent [onyx kafka plugin](https://github.com/onyx-platform/onyx-kafka) ("0.10.0.0-SNAPSHOT"). For some reason, I can't get Onyx to write to an output kafka topic. Code is in this [git...

twashing

Not sure if a suggestion belongs here. But for us it would be nice when it would be possible to have autoscaling of the number of input peers based on...

eelkevanfoeken

I think we could do with a better error message here - users are going to think they just didn't require the plugin, even though they did.

lbradstreet

Checkpointing is somewhat described via the task-map opts, but the overall strategy could probably be described better

lbradstreet