quickwit
quickwit copied to clipboard
Kafka source crashes when experiencing backpressure from indexer and waits for too long
Reported in #2080.
cc @guidao
The Kafka source now does a better job at logging the values (max poll interval and session timeout) that can lead to the consumer crashing when experiencing backpressure.
Downstream, the indexing pipeline has been improved to lead to less backpressure.