webdataset icon indicating copy to clipboard operation
webdataset copied to clipboard

load tensor type webdataset into multi GPUs

Open lyb369 opened this issue 1 year ago • 0 comments

I would like to seek help on how to load a WebDataset containing embeddings generated from prompts through a text_encoder for multi-GPU training. If anyone could help, I would be really appreciated!

lyb369 avatar Oct 29 '24 15:10 lyb369