kenlm
kenlm copied to clipboard
kpu
KenLM: Faster and Smaller Language Model Queries
Per actions/virtual-environments/issues/2667 There is certainly a more elegant way to do this, but environment variables in GitHub Actions are weird.
I've recently used kenlm to build a few language models, and suddenly I started to get this error. On multiple occasions when trying to build a trie, it seems to...
For ASR, we need access to the vocab in order to build a string trie and limit the beam search output. Can you expose the vocabulary in PythonAPI?
Hi, is there a function call to calculate entropy directly from KenLM? What is the maths formula of model.score ? Is it the log probability or probability? Is it true...
C++ 代码 lm::ngram::Config config; model = new lm::ngram::Model(language_model_path); 初始话C++ 版本的 kenlm 模型报错 相同代码时而能成功 ,但常时间下是报错的 Segmentation fault (core dumped) 段错误 可能是哪儿指针存在问题,求大神救救我
Hi, thank you for this nice tool and also thanks for providing a windows version. I have to work on a sever with Windows Server 8 R2 and I had...
Hi all, When I use multiprocess like this: ` class LM_Decode(object): def __init__(self, lm_path): self.lm_model = kenlm.LanguageModel(lm_path) def decode(self, sent): lm_prob = list(self.lm_model.full_score(sent)) return lm_prob[-1][0] lm_decoder = LM_Decode("lm_path.bin") pool =...
Hi! I wanted to prepare several models to test interpolation of them with different weights and found out that with non-zero `--prune` option `lmplz -o 4 --intermediate inter --prune 1...
I use commands: wget -O - https://kheafield.com/code/kenlm.tar.gz |tar xz mkdir kenlm/build cd kenlm/build cmake .. make -j2 after "cmake.." : CMake Error at /usr/share/cmake/Modules/FindPackageHandleStandardArgs.cmake:137 (message): Could NOT find Boost (missing:...
