quickwit icon indicating copy to clipboard operation
quickwit copied to clipboard

A field_caps request on on 1000 indexes takes a huge amount of memory

Open fmassot opened this issue 1 year ago • 2 comments

The searcher gets OOMKilled each time I send a field_caps request. I'm not sure why we take a lot of memory. Each split has around 10 fields.

fmassot avatar Feb 27 '24 07:02 fmassot

Should be fixed with: https://github.com/quickwit-oss/quickwit/pull/4922

PSeitz avatar May 01 '24 13:05 PSeitz

Another improvement would be to store aggregations of field caps in the cache instead per split one entry

PSeitz avatar May 01 '24 13:05 PSeitz