Mads R. B. Kristensen

I am not able to reproduce, the conda environment works fine for me :/ I have asked the cuFile team for input.

I am running on a full GPU. https://github.com/rapidsai/kvikio/pull/514 implements Python bindings to `cufileDriverOpen()` and `cufileDriverClose()`. The hope is that we can prevent this issue in Python by calling `cufileDriverClose()` and...

Originally by @EricKern in https://github.com/rapidsai/kvikio/pull/514#issuecomment-2439958534: > I've built and reran my small segfault reproducer script without explicitly opening and closing the driver. This still causes the segfault [when I set...

Sorry, I am still not able to reproduce :/ Can you try setting `allow_compat_mode=false` in the config `cufile.json`? This will force cuFile to use GDS or fail. Also try setting...

> [@kingcrimsontianyu](https://github.com/kingcrimsontianyu) Thank you for this! I have a question: what’s the rationale behind KVIKIO’s use of dynamic loading? We want to support setups that doesn't have cuFile/gds installed. cuFile...

I think it could be a good idea, but it will require some smart chunking under the hood. This is because all of our reads and writes (incl. all of...

Sorry, yes that would work. I was more thinking of using it together with https://github.com/rapidsai/kvikio/issues/577 where stream read and write would not use GDS or parallel IO if we don't...

The problem is that the presigned URLs doesn't support `HEAD` thus KvikIO fails when trying to get the file size. It should work when setting the file size manually: ```python...

Sure @yiheng-wang-nv, that would be great!

I think it would be helpful with some docstrings. At least, I find it hard to follow the intention without any help :)