ann-benchmarks icon indicating copy to clipboard operation
ann-benchmarks copied to clipboard

Consistently prewarming database

Open wahajali opened this issue 11 months ago • 3 comments

pg_embedding client currently does pre-warming of database while the same is not happening in other databases, including pgvector. Does this effect the comparision in terms of QPS? And should this be standardized across the board?

wahajali avatar Mar 20 '24 05:03 wahajali

Hi @wahajali, for pgvector specifically, the data should already be in shared buffers, so prewarming shouldn't make a difference.

ankane avatar Mar 23 '24 02:03 ankane

Hi @ankane could you please elaborate why that is the case? Does the shared_buffer get populated on insertion?

wahajali avatar Mar 23 '24 04:03 wahajali

Yes, and when the index is created. You can run the benchmarks with and without pg_prewarm to compare.

ankane avatar Mar 23 '24 04:03 ankane