open_clip icon indicating copy to clipboard operation
open_clip copied to clipboard
verified publisher icon mlfoundations

custom dataset

Open mayilin0714 opened this issue 2 years ago • 0 comments

Hello, I'd like to convert local data into the webdataset format for model training. My data consists of image files in jpg format and their corresponding image description txt files. Would it be sufficient to pack these files into tar archives for this purpose?

mayilin0714 avatar Jan 09 '24 07:01 mayilin0714