renepickhardt
Implement Smoother: Kneser-Ney-Smoother
We have ModifiedKenserNey implemented. Do we still need normal KneserNey smoothing? What is a good paper that explain this?
I would like to have it in order to verify. Modified kneser ney was probosed by chen / goodman and their values cannot be reproduced and we don't know if their probabilities sum up to one. I want to double check what is the best method here. Implementation should be rather straight forward.
On Tue, Jan 6, 2015 at 3:21 PM, Lukas Schmelzeisen <[email protected]
wrote:
We have ModifiedKenserNey implemented. Do we still need normal KneserNey smoothing? What is a good paper that explain this?
— Reply to this email directly or view it on GitHub https://github.com/renepickhardt/generalized-language-modeling-toolkit/issues/49#issuecomment-68870399 .
www.rene-pickhardt.de http://www.beijing-china-blog.com/
Skype: rene.pickhardt
mobile: +49 (0)157 / 3730 2422 office: +49 (0) 261 / 287 2765 fax: +49 (0) 267 / 287 100 2765
china mobile: +86 186 2129 5033
