h5pyd
h5pyd copied to clipboard
HDFGroup
h5py distributed - Python client library for HDF Rest API
As noted in HDFGroup#105, this PR will remove the trailing slash from the endpoint parameter if it exists. This will prevent the exception from being thrown if the slash exists....
Check chunkinfo_arr size and chunk anon_dset if needed (chunk_size limit is a kwarg and is defaulted to 1mb) If anon_dset is chunked, load chunkinfo_arr in said chunks
Hi, I am using h5pyd in a higher-level program. The logic implemented in the so called apps is interesting. I think they would be useful as functions that take parameters...
First item of the issue #90: stateless: init cfg structure in the main function and put it as a parameter to the functions
When writing an HDF5 file to the HSDS with H5PYD, it appears that although chunks are being created in the final output file, the initial writing of the data seems...
I'm creating a backend to use transparently pytables, h5py and h5pyd. I ran my test suite on h5pyd and am confronted with the issue of the variable length array. In...
After using h5pyd for a while, I'd like to propose a few new functions and changes to the Folder object. I believe these changes allow for more fluid file management...
There is an inconsistency in the shape of the returned array when querying slice of numpy ndarray from an HDF5 file using h5py and h5pyd. Imagine 3D numpy ndarray my_ary...
In this notebook https://gist.github.com/rsignell-usgs/07143a5ab54afb8ad6eb1af255d025c9 we use `xarray` to open a local netcdf4 file and then the same dataset that was 'hsload'ed to `hsds`. `xarray` automatically recognized the CF-compliant time units...
As requested here by @mrocklin: https://github.com/pangeo-data/pangeo/issues/75#issuecomment-357734564 - [ ] Try XArray + Dask locally on the HSDS data to verify that it can be accessed concurrently from multiple threads -...