sentry icon indicating copy to clipboard operation
sentry copied to clipboard

Published 20 hours ago • verified publisher icon getsentry

Publish UserIP logs to kafka from REGION silos

Open corps opened this issue 3 years ago • 1 comments

Work in progress, want to finish testing and then write the consumer for CONTROL silos. Just getting some eyes on it so far.

corps avatar Sep 17 '22 00:09 corps

Ok, finished first pass of consumer, writing tests and making a few more adjustments.

corps avatar Sep 19 '22 23:09 corps

@markstory @RyanSkonnord

Recently updated, mind taking another pass?

  1. Simplified topics to just one broad region -> control topic which shares all messages. This is simplest given the 'weird' nature of this kafka topic (consumed by the control silo).
  2. Moved to using the 'new' kafka consumer approach via arroyo.

corps avatar Sep 22 '22 23:09 corps

Fixing tests in CI, I just needed to create a new job for the kafka consumer test.

corps avatar Sep 23 '22 18:09 corps

Remaining test failure seems to be related to performance flakey test. Final pass @markstory @RyanSkonnord ?

corps avatar Sep 23 '22 20:09 corps