self-hosted icon indicating copy to clipboard operation
self-hosted copied to clipboard

Support Kafka topic configuration migration/synchronization.

Open BYK opened this issue 4 years ago • 7 comments

There are several topic configurations that are required for efficient or correct message processing in certain circumstances:

  • log compaction settings for the commit log topic
  • timestamp type for topics that are consumed as ticks subscription data

Use https://segment.com/blog/easier-management-of-Kafka-topics-with-topicctl/

/cc @chadwhitacre @mattrobenolt @getsentry/sns

BYK avatar Feb 11 '21 19:02 BYK

We have plans to execute on work for this, we just haven't done it yet.

mattrobenolt avatar Feb 11 '21 19:02 mattrobenolt

Hence the "Status: Accepted" label :) Is this on @getsentry/single-tenant's roadmap or should I keep it on myself?

BYK avatar Feb 11 '21 19:02 BYK

I guess we don't have this in Asana, I'll figure out how to add this. We've talked about it very recently, I guess didn't track it anywhere, but I'd say yeah, this is our responsibility.

mattrobenolt avatar Feb 11 '21 19:02 mattrobenolt

I guess we don't have this in Asana, I'll figure out how to add this.

I just moved this from Asana (was tracked on an OSS Team board) for the sake of external visibility and our effort to use GitHub more. Up to you if you still want a copy there but they should be linked.

/cc @chadwhitacre

BYK avatar Feb 11 '21 19:02 BYK

That's fine, I dunno where we stand on the tools we use, but I know all of our stuff is in Asana these days. I don't make these decisions. I don't even know how to use the tools.

mattrobenolt avatar Feb 11 '21 19:02 mattrobenolt

Does this belong in onpremise or should we move to sentry? Where will the code live?

chadwhitacre avatar Feb 24 '21 15:02 chadwhitacre

I would assume the code to live here at the beginning until it is more broadly adopted (may move into its own repo or under getsentry/sentry).

BYK avatar Mar 03 '21 10:03 BYK