Mads R. B. Kristensen

Results 162 comments of Mads R. B. Kristensen

Yes, that is correct. See https://github.com/NVIDIA/MagnumIO and https://developer.nvidia.com/magnum-io

No, GDS isn't supported by AWS or any other cloud service provider (AFAIK) :/

I think this is a good idea but since it is possible to change the `task_size` (aka slice size) [between IO calls](https://github.com/rapidsai/kvikio/blob/branch-22.08/cpp/include/kvikio/file_handle.hpp#L380), [`AllocRetain`](https://github.com/rapidsai/kvikio/blob/branch-22.08/cpp/include/kvikio/posix_io.hpp#L40) will have to support reuse of different...

HDF5 comes with [Gzip](http://www.gzip.org/) and [Szip](https://www.hdfgroup.org/doc_resource/SZIP/) support, which we would properly have to handle on the CPU. However, HDF5 supports third-party compression thus it might be possible to use nvCOMP...

I think this would be great!

It is something we would like to look at but there is no timeline :/ Since [nvCOMP](https://github.com/NVIDIA/nvcomp) support Gzip, I don't think it is too much work.

cuFile should write a `cufile.log` file in the current directory, which hopefully contains more info. Also, to rule out bugs in KvikIO, try running `KVIKIO_COMPAT_MODE=ON python single-node-io.py`, which is running...

Please re-open if this is still an issue

> @madsbk - One more change was necessary to get the CPU-only build of legate.io working: > > ```diff > diff --git a/cpp/include/kvikio/shim/cufile_h_wrapper.hpp b/cpp/include/kvikio/shim/cufile_h_wrapper.hpp > index 72131de..d73f04b 100644 > ---...