Chinthaka
Chinthaka
I think what you mentioned is correct. We have Distributed data parallel implemented. Data loader is designed to shard the dataset to each process without any overlaps. After each training...
Multi GPU inference is not implemented yet. Only training is supported. Let’s hope we will see Tensor and Pipeline Parallel implementations for inference in near future 😁. Let’s stay updated...
Hi Kim, This dataset was from an internal project. We cannot share the dataset now. Only the models are available in github. Kind regards, Chinthaka On Fri, 17 Apr 2020,...