webdataset
webdataset copied to clipboard
load tensor type webdataset into multi GPUs
I would like to seek help on how to load a WebDataset containing embeddings generated from prompts through a text_encoder for multi-GPU training. If anyone could help, I would be really appreciated!