apache
Exception during ingestion on kafka topic deletion for multi topic table
Justification --
The ensureAllPartitionsConsuming function validates and repairs LLC (Low-Level Consumer) realtime segments to ensure all stream partitions have active consuming segments. It's called by the RealtimeSegmentValidationManager periodic task to detect and fix stuck partitions.
Currently we have seen if a topic gets deleted for multi topic table, it causes ingestion stop for the all the topics of the table. This happens due to uncaught exception in code. Here we try to fetch partition count for deleted kafka topic, and hence it results in an exception.
Catching this exception would prevent complete degradation and hence this exception should be caught and emitted as an metric, based on it we can alert the end user.
