Will Lauer
Will Lauer
https://github.com/apache/druid/pull/11559 is a proposed solution for this problem. The code is currently undergoing testing in one of our clusters to ensure it adequately addresses the problem, and any additional fixes...
With the proposed fix, we now see file descriptor usage on our historical nodes increate by 4 over the course of a query and then return to its base state....
It looks like there are some large cases where this approach doesn't work. `SpillingGrouper` uses `CloseableIterators.mergeSorted()` to produce a sorted sequence in several cases. Unfortunately, this still requires opening all...
Do you have an example of a dataset that triggers this behavior for you that we can use for validation?