laion-prepro icon indicating copy to clipboard operation
laion-prepro copied to clipboard
verified publisher icon rom1504

make listing and download of csv files faster and cleaner

Open rom1504 opened this issue 4 years ago • 0 comments

it is done currently by bash + aria2c it takes about 30min Could easily take only 5min if done with the same techniques as img2dataset

rom1504 avatar Aug 23 '21 14:08 rom1504