LiLT icon indicating copy to clipboard operation
LiLT copied to clipboard

Use LiLT / an alternative model with more than 512 tokens

Open coding-kt opened this issue 8 months ago • 0 comments

Hi,

LiLT processes a maximum of 512 tokens.

Is there a good option to get a comparable and commercial useable model that can process more tokens?

It is of course possible to split longer inputs into 512 token chunks. But this comes with some disadvantages / difficulties.

coding-kt avatar Oct 25 '23 12:10 coding-kt