Henning Baldersheim
Henning Baldersheim
I guess this happens during what we call lid space compaction. Internally in the back each document is assigned a **l**ocal **d**ocument **i**d when it is ingested. This lid is...
1 - Configuration control of lid-space compaction will come next week. 2 - Will know ETA next week for better handling of lid-space compaction.
PR for item 1 is in #27223
It will not increase the maximum memory usage. memory usage will stay at its peak. Let us say that you at some point in time have 20M docs on your...
Documentation added in https://github.com/vespa-engine/documentation/pull/2690
0.95 sounds high enough. It depends how much your corpus varies in size. If you use a generational approach and have 2 generations a value of 0.6 would be fine.
Your understanding is correct. If you have a huge variation in number of documents concurrently on a node you should set it higher.
I think we need to establish state first: 1 - Did you observe any difference at all when you turned off lid-space compaction ? 2 - In your last comment...
This sounds like a bug. Could you supply your schema definition ?
@bjorncs Was it so that we needed to change our code before upgrading this one ?