DeepPavlov icon indicating copy to clipboard operation
DeepPavlov copied to clipboard

How to include a sentence splitting method into the pipeline of config file ?

Open polodealvarado opened this issue 4 years ago • 0 comments

Want to contribute to DeepPavlov? Please read the contributing guideline first.

What problem are we trying to solve?:

Could it be possible to solve the problem of 512 tokens limit  when we are working with BERT model ?

**Possible solution?

including a sentence splitting method into the pipeline of the config file

polodealvarado avatar Oct 14 '20 11:10 polodealvarado