byaldi icon indicating copy to clipboard operation
byaldi copied to clipboard

How to make from_index() faster?

Open kubni opened this issue 1 year ago • 0 comments

Hello. I have the index saved to disk (4 json.gz files, and one embeddings_0.pt file). from_index() takes anywhere between 15-30 seconds, which seems like a long time, given that the index is saved to disk.

I have verbosity set to 1, and it seems to me that the Loading checkpoint shards part is taking majority of that time. What can be done to make it faster?

kubni avatar Oct 14 '24 08:10 kubni