DeepPavlov
DeepPavlov copied to clipboard
How to include a sentence splitting method into the pipeline of config file ?
Want to contribute to DeepPavlov? Please read the contributing guideline first.
What problem are we trying to solve?:
Could it be possible to solve the problem of 512 tokens limit when we are working with BERT model ?
**Possible solution?
including a sentence splitting method into the pipeline of the config file