Ilia Kurenkov

If you plan to support python 2.7 for a long time still, you can also use a cross-compatible syntax for type hints: https://mypy.readthedocs.io/en/latest/python2.html#type-checking-python-2-code

Just a quick chime-in, I'm still working out the LM vocabulary performance test. In the interest of reducing the number of tasks (and thus improving focus) you could probably remove...

I think the issue was closed before anyone had time to sit down and investigate. I'll reopen, but won't have time to investigate it until november most likely.

You may also want to consider unit tests for this. Stick with the ones that give you the biggest bang for the buck: simple to write and can cover more...

Hi all! I'm currently swamped, will respond to this in the course of this week. @mbauwens thanks for the detailed issue :pray:

I'm still a bit tight on time, but I can at least provide some leads. I can confirm Tom's hunch: the entropy/perplexity formula is taken verbatim from Jordan Boyd-Graber. He...

:+1: from me for your plan. Adding methods and docs is generally not bad imo, we should just make sure we take this opportunity to think about the relevant interfaces....

@mbauwens optional parameters should be ok as long as their default values result in existing behavior. The idea being that folks who aren't passing these parameters explicitly should not have...

could you outline the two alternatives a bit more? Just the level of method signatures should be enough to help us decide between the two.

That module has been superceded by [this one](http://www.nltk.org/api/nltk.lm.html#module-nltk.lm). No backoff models have been implemented yet, but you can try out the interpolated ones as a start. The module has also...