LiLT icon indicating copy to clipboard operation
LiLT copied to clipboard

How to Pretrain on our own documents

Open vibeeshan025 opened this issue 2 years ago • 1 comments

Let's say I have 1000s of domain specific documents in English. How can I Pretrain them on top of roberta-en + Lilt Based existing checkpoint.

vibeeshan025 avatar Jun 19 '22 19:06 vibeeshan025

Hi, Maybe you can refer to Test-Time Adaptation for Visual Document Understanding.

jpWang avatar Jun 20 '22 01:06 jpWang