Slow loading of the dataset files

[ArashJavan]

Hello, thanks a lot for your great work! Currently, I am trying to integrate the "completion3d" dataset into torch-point3d. To load the point cloud "h5" files I just used the same code as presented in this repo.

def load_h5(path, key='data', dtype=None, device=None):
    f = h5py.File(path, 'r')
    data = torch.tensor(f[key], dtype=dtype, device=device)
    f.close()
    return data

The only thing is that it takes about 200 milliseconds to load one h5-file, which is really a lot of time for ~50KB data! My env: OS: Ubunut 20.04 RAM: 32GB Drive: SSD

Are you also observing the same effect? Do you plan to provide the dataset in other formats like plain text-file!

Thanks