Jeremy Wohlwend

First of all, thank you for this amazing library. I was wondering if there was any plan to release the library on pypi? This would make it much easier and...

Is there a plan to have sent_tokenize in this library?

2

Thanks for the awesome work porting this in a separate library. Makes it a great choice for people looking at a light library for tokenization / detokenization. Was wondering if...

Sample new embedding from maximum likelihood estimate

2

This PR improves over the status quo of producing random embeddings for unknown tokens by learning a normal distribution over the provided embeddings.

Callback based Trainer

4

**Is your feature request related to a problem? Please describe.** Currently, customizing a model requires sometime overriding the Trainer. It would be best if the Trainer was an object that...