bert_document_classification icon indicating copy to clipboard operation
bert_document_classification copied to clipboard

Published 20 hours ago • verified publisher icon AndriyMulyar

How long is long?

Open gevezex opened this issue 3 years ago • 1 comments

Is there a max token length for this long document? I mean if a document has 10k words, would it still work?

gevezex avatar Sep 18 '20 11:09 gevezex

Yes - but it will of course use more memory. I'd suggest to try finetuning a pretrained longformer if your documents truly are that long.

AndriyMulyar avatar Sep 18 '20 18:09 AndriyMulyar