Ashley Jeffs

Results 229 comments of Ashley Jeffs

Hey @sgammon, sounds great, one caveat here is that the current mqtt components use an old version of the plugin APIs which we're slowly moving away from. I'll eventually need...

Hey @sgammon, refactor work is done: https://github.com/benthosdev/benthos/commit/cab836b1cba20d576d1f4238a1a70f4b02cb71fa

Hey @MarcinGinszt it's because the messages from kafka have metadata values including the key, and the s3 output is attempting to add those metadata values to the object it uploads...

@youngjosh have you given https://docs.redpanda.com/redpanda-connect/components/caches/lru/ or https://docs.redpanda.com/redpanda-connect/components/caches/ttlru/ a try? I forgot to mention this earlier but it would be good to have a chart showing the differences between these caches.

Is there any intention to fix this? I can avoid using `99designs/keyring` myself, but every time a dependency makes the unfortunate decision to import this package it also becomes harmful...

For anyone stuck on this I've made a temporary fork: https://github.com/Jeffail/keyring, here's what the switch looks like (you add a replace directive and it nukes dbus functionality): https://github.com/benthosdev/benthos/commit/7453f87010cfc96d60cf0d484af33f1e0ac59abd

Hey @rcyrus, yeah this is annoying. I can probably update this to always exclude deprecated fields on normalize.

Hey @dudleycarr, yeah that's annoying, ideally we should have a background process that does occasional compactions. We currently document "The compaction interval determines how often the cache is cleared of...

Hey @danriedl, the bloblang internals are now broken out into https://github.com/redpanda-data/benthos, are you happy to move this PR over? The changes look good to me.