ctrl-sum icon indicating copy to clipboard operation
ctrl-sum copied to clipboard

What is the input sequence size ?

Open desis123 opened this issue 2 years ago • 1 comments

First of all thanks for this nice summary model. I like to what is input sequence size for this model ? and what is best procedure if I like to summary a long document or multi documents with length more than 6k tokens Thanks in advance.

desis123 avatar Nov 30 '22 15:11 desis123

Hi, the input sequence size is 1024 at max, normally people truncate the input document if it is too long. If you do want to summarize long documents, you can check works dedicated to long doc summarization like bigbird, long-doc summarization is beyond the scope of ctrlsum

jxhe avatar Dec 01 '22 02:12 jxhe