Ashley Jeffs
Ashley Jeffs
Hey @sgammon, sounds great, one caveat here is that the current mqtt components use an old version of the plugin APIs which we're slowly moving away from. I'll eventually need...
Hey @sgammon, refactor work is done: https://github.com/benthosdev/benthos/commit/cab836b1cba20d576d1f4238a1a70f4b02cb71fa
Hey @MarcinGinszt it's because the messages from kafka have metadata values including the key, and the s3 output is attempting to add those metadata values to the object it uploads...
@youngjosh have you given https://docs.redpanda.com/redpanda-connect/components/caches/lru/ or https://docs.redpanda.com/redpanda-connect/components/caches/ttlru/ a try? I forgot to mention this earlier but it would be good to have a chart showing the differences between these caches.
Is there any intention to fix this? I can avoid using `99designs/keyring` myself, but every time a dependency makes the unfortunate decision to import this package it also becomes harmful...
For anyone stuck on this I've made a temporary fork: https://github.com/Jeffail/keyring, here's what the switch looks like (you add a replace directive and it nukes dbus functionality): https://github.com/benthosdev/benthos/commit/7453f87010cfc96d60cf0d484af33f1e0ac59abd
Hey @rcyrus, yeah this is annoying. I can probably update this to always exclude deprecated fields on normalize.
Hey @dudleycarr, yeah that's annoying, ideally we should have a background process that does occasional compactions. We currently document "The compaction interval determines how often the cache is cleared of...
Hey @danriedl, the bloblang internals are now broken out into https://github.com/redpanda-data/benthos, are you happy to move this PR over? The changes look good to me.