Pretraining-T5-PyTorch-Lightning icon indicating copy to clipboard operation
Pretraining-T5-PyTorch-Lightning copied to clipboard

verified publisher icon manueldeprada
→

Metadata

Collection of scripts to pretrain T5 in unsupervised text, using PyTorch Lightning. CORD-19 pretraining provided as example.

Results 3 Pretraining-T5-PyTorch-Lightning issues
Sort by recently updated
recently updated
newest added
trafficstars

Can I use this code fo pretraining other types of T5?

4 comment

Hi there! I have prepared a dataset using your code. But now I have a problem with training another t5 model (cointegrated/rut5-base-multitask). IndexError: index out of range in self. Where...

iamcrysun avatar iamcrysun

where i can download metadata.csv ？

1 comment

when i run eatract_cord19.py, it raise an ERROR "FileNotFoundError: [Errno 2] No such file or directory: 'metadata.csv'", so i want to ask where i can download metadata.csv file？

wxj630 avatar wxj630

Custom Dataset

3 comment

Hello, First of all, thank you for sharing your code, I'm new to NLP and I've been looking for a while to find a solution on how to train a...

adrian-jaques-b avatar adrian-jaques-b

← Metadata

25
Stars
7
Forks
Watchers

Owner

verified publisher icon manueldeprada

Metadata

Collection of scripts to pretrain T5 in unsupervised text, using PyTorch Lightning. CORD-19 pretraining provided as example.

Back