generalized-language-modeling-toolkit
generalized-language-modeling-toolkit copied to clipboard
FalseMaximumLikelihood should work for Marginal
You told me FalsemaximumLikelihood-estimation (namely doing c(a b c)/c(a b) instead of c(a b c)/c(a b _)) should work in the marginal case. It doesn't though. We should research why.
we should do a backoff if c(a b) was not seen (if we do proper backoffs this should add to one but it is not MLE)