Clay Mullis

The profiler feature would need a PR to implement; and all this deepspeed custom stuff is getting out of hand. They support json files; we should as well I think?...

I went ahead and made a PR which adds the `--flops_profiler` flag. It will run normally for 200 steps and then on the 200th step enable a very precise timer...

> This is really cool! Also the colab (see the WDS implementation, I tested it on your colab [#280 (comment)](https://github.com/lucidrains/DALLE-pytorch/pull/280#issuecomment-860207682)). > > But I think it might get a little...

> This is really cool! Also the colab (see the WDS implementation, I tested it on your colab [#280 (comment)](https://github.com/lucidrains/DALLE-pytorch/pull/280#issuecomment-860207682)). > > But I think it might get a little...

> > > This is really cool! Also the colab (see the WDS implementation, I tested it on your colab [#280 (comment)](https://github.com/lucidrains/DALLE-pytorch/pull/280#issuecomment-860207682)). > > > But I think it might...

> Why can't the most important tests be run on CPU ? > Even if it's takes 5min to do 3 steps of batch size 2 on cpu, it's good...

I'd love to use this so that people can contribute to and receive hosting on the free tier provided for open source teams by W&B This also allows for a...

https://github.com/lucidrains/DALLE-pytorch/pull/320

Thanks for the addition! We have a broader dicussion about datasets over in the `discussions` tab (bit hard to find if you haven't used it before). Are you familiar with...

> Maybe we should convert our datasets to tar.gz and work with WebDatasetloaders? This might be a faster approach than optimizing reading text and image folders, doesn't it? But cool...