Vahid Kazemi

icon indicating a website link https://twitter.com/VahidK icon indicating an email [email protected]

icon location California icon location PhD in Machine Learning. Member of Technical Staff @OpenAI. Ex. Google, Waymo, and Apple.

Results 1 comments of Vahid Kazemi

How to load data in multiple processes?

It's pretty straightforward when the index is available. You can just implement a new "RandomAccessMultiTFRecordDataset" class that inherits from torch.utils.data.Dataset and change the logic. PR are welcome.