hello-ltr icon indicating copy to clipboard operation
hello-ltr copied to clipboard

msmarco downloads could get duplicated between solr and elastic

Open nathancday opened this issue 4 years ago • 0 comments

Right now the downloads go to a data/ folder that is a child of the respective search engine. This could cause two copies of the same large data files to be downloaded if users are switching between engines.

Should we move the msmarco data storage location up higher so it could be easily shared? Or check multiple locations for existance before downloading?

nathancday avatar May 12 '20 20:05 nathancday