autofaiss icon indicating copy to clipboard operation
autofaiss copied to clipboard

use embedding reader start:end feature to get a proper sampled training set

Open rom1504 opened this issue 2 years ago • 0 comments

same for the evaluation set

currently we use the first N vectors for both training and evaluation which is not ideal, especially if the embedding set is not randomly shuffled

rom1504 avatar Mar 06 '22 01:03 rom1504