knnlm
knnlm copied to clipboard
Hi! I am replicating kNN-LM and was wondering if it would be possible to share dict.txt or the link to the original dataset. As the original link has expired and...
Hello! I'm working with knn-lms and was interested in having a similar observation as you had in Appendix A from this repo's paper (i.e. the retrieved context and its probability)....
## 🐛 Bug The `int16` dtype (when `--dstore-fp16` is activated) will cause overflow issue since int16 cannot handle all integer ids in a large vocab like Wikitext-103. This will make...
Hi, thanks for open-sourcing the inspiring knn-LM model! I'm trying to reproduce your results on Book Corpus dataset, but I found there is no standard train/valid/test splits. Could you please...
I successfully replicated the instructions from the README, and am struggling to scale to larger data size. I was wondering whether you have access to the wiki 3B index (or...
Hi - I went through your whitepaper and really excited about the potential applications it can bring. I followed the readme up until building the index because I'm testing and...