[IO] support external data in dictdump ">" links

[woutdenolf]

Currently we only support internal and external links:

https://github.com/silx-kit/silx/blob/d8a666dcfab4f071f38615ac495937cf85e97f95/src/silx/io/dictdump.py#L445

A use case has come up (Bliss NeXus writer) where an EDF should be linked.

[t20100]

Do you mean supporting external datasets?

h5py.Group.create_dataset:

• external – Store the dataset in one or more external, non-HDF5 files. This should be an iterable (such as a list) of tuples of (name, offset, size) to store data from offset to offset + size in the named file. Each name must be a str, bytes, or os.PathLike; each offset and size, an integer. The last file in the sequence may have size h5py.h5f.UNLIMITED to let it grow as needed. If only a name is given instead of an iterable of tuples, it is equivalent to [(name, 0, h5py.h5f.UNLIMITED)].

[payno]

I don't know by if it can be of any help please be aware that we did some proto for tomography:

• in edfconvert - see around lines ~1135
• for tiff: https://gitlab.esrf.fr/tomotools/scripts/-/blob/master/create_vds_from_tiff.py?ref_type=heads

[woutdenolf]

Do you mean supporting external datasets?

Yes