hdf5r icon indicating copy to clipboard operation
hdf5r copied to clipboard

Add support for BLOSC

Open hhoeflin opened this issue 7 years ago • 3 comments

hhoeflin avatar Oct 27 '17 04:10 hhoeflin

That sounds really interesting!!! Would like to contribute to that one!

Am 27.10.2017 um 05:56 schrieb hhoeflin [email protected]:

— You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHub, or mute the thread.

mannau avatar Oct 27 '17 07:10 mannau

Excellent! Main tasks are to

  • Compile BLOSC and make it available in the package
  • Make Blosc available through the property lists
  • Update the options in the create_dataset dialogs
  • Speed comparisons :)
  • Examples and additional section in the vignette

hhoeflin avatar Oct 27 '17 12:10 hhoeflin

Just to add to this, R blosc support is the main reason I'm stuck with releasing gzip/deflate HDF files (asking people to compile the plugin themselves doesn't end well), so this would be awesome. Here is the blosc HDF plugin filter that allows the HDF library to transparently handle blosc: https://github.com/Blosc/hdf5-blosc and here are some pointers as to how pytables handles compiling the blosc filter: https://github.com/PyTables/PyTables/blob/2eb4cce9ed18f88a026886dc5e6b0fe728c96f80/setup.py#L801

makmanalp avatar Mar 23 '18 18:03 makmanalp