optic-nerve-cnn icon indicating copy to clipboard operation
optic-nerve-cnn copied to clipboard

RIM_ONE_v3.hdf5 and all_data.hdf5 need how to generate it

Open LuShuaie opened this issue 7 years ago • 6 comments

RIM_ONE_v3.hdf5 and all_data.hdf5 need how to generate it, what are the requirements?

LuShuaie avatar Jan 02 '18 06:01 LuShuaie

@2017john, HDF5 datasets can be recreated with scripts/Organize datasets.ipynb notebook.

Nevertheless, I have uploaded all the datasets here.

seva100 avatar Jan 02 '18 13:01 seva100

@seva100 Thank you.

LuShuaie avatar Jan 03 '18 15:01 LuShuaie

Hey @seva100 I am facing a similar issue in this particular line h5f = h5py.File("../data/hdf5_datasets/all_data.hdf5", "r+") I cant find this particular dataset at all. not even in the folder you mentioned.

Geeks-Sid avatar Feb 01 '18 16:02 Geeks-Sid

@Geeks-Sid all_data.hdf5 is just a union of all data sets from the folder I mentioned. For example, if you need DRIONS-DB data, you can just replace it with DRIONS-DB.hdf5

seva100 avatar Feb 03 '18 16:02 seva100

@seva100 Hey, Can you explain how to create a union of all the datasets?

Geeks-Sid avatar Feb 27 '18 17:02 Geeks-Sid

@Geeks-Sid you can just copy items from all the datasets by something like this:

import h5py

h5f_in = h5py.File("DRIONS-DB.hdf5", "r")
h5f_out = h5py.File("all_data.hdf5", "w")
h5f_out['DRIONS-DB/orig/images'] = h5f_in['DRIONS-DB/orig/images']
... # copy all other items
h5f_in.close()
h5f_out.close()

Or you can recreate it with scripts/Organize datasets.ipynb notebook. But I think you won't really need a union of all the datasets for the sake of replication.

seva100 avatar Mar 03 '18 11:03 seva100