byaldi
byaldi copied to clipboard
How to make from_index() faster?
Hello.
I have the index saved to disk (4 json.gz files, and one embeddings_0.pt file).
from_index() takes anywhere between 15-30 seconds, which seems like a long time, given that the index is saved to disk.
I have verbosity set to 1, and it seems to me that the Loading checkpoint shards part is taking majority of that time.
What can be done to make it faster?