RAM usage is too high on indexers when ingesting at maximum throughput.

[fulmicoton]

Observed on fly. When starting ingestion, we receive a buffer worth of data all at once, and observe a temporary peak in RAM usage.

Generally speaking this probably happens whenever someone attempts to ingest at max throughput (until getting 429s). The most probable cause is the queue capacities we have in the different indexing pipelines. (1000s of indexing pipeline amounts to GBs)

[trinity-1686a]

might be related to #4629

[guilload]

Fixed via quickwit-oss/tantivy#2402