Jimmy Lin

Update, still having this issue: ``` % python -m unittest integrations.sparse.test_lucenesearcher_check_ltr_msmarco_document.TestLtrMsmarcoDocument ... recall@10:0.0 recall@20:0.0 recall@50:0.0 recall@100:0.0 recall@200:0.0 recall@500:0.0 recall@1000:0.0 recall@2000:0.0 recall@5000:0.0 recall@10000:0.0 Attempting to initialize pre-built index msmarco-doc-per-passage-ltr. /Users/jimmylin/.cache/pyserini/indexes/index-msmarco-doc-per-passage-ltr-20211031-33e4151.bd60e89041b4ebbabc4bf0cfac608a87 already...

Even with: ``` export LIBOMP_USE_HIDDEN_HELPER_TASK=0 export LIBOMP_NUM_HIDDEN_HELPER_THREADS=0 ``` Per https://github.com/microsoft/LightGBM/issues/4229#issuecomment-930614380 - didn't help.

Trying this again: ``` % brew info libomp ==> libomp: stable 14.0.6 (bottled) LLVM's OpenMP runtime library ``` Still getting same error.

Interestingly, on the M1 chip, `lightgbm` does work with the following install command: ``` conda install -c conda-forge lightgbm ```

Yes, please do. Only reason they're not in Pyserini is because we haven't had the needs until now...

Closing...

The way @MXueguang and I are thinking about it - and of course, open to suggestions - is that "encode" is generating the doc vectors, whereas "index" would be something...

yup, agreed. @crystina-z would you mind taking an initial stab at it?

hey @crystina-z I'll reorganize the docs better first via #1070 and then you can do clean-up?

Yes, odd that your results are different... please look into it and update?