Nicolas Patry
Nicolas Patry
Because issues that do not receive attention need to be removed from visible list. It's always easy to resurect them, comment on them, like you are doing so we know...
I wasn't aware at all of `zarr`'s existence when creating this format. HDF5 was getting deprecated in TF/Keras at the time of writing this lib, which means building upon it...
Unfortunately, this space is limited in memory, we cannot convert huge files. You have to convert manually.
Hey I took a part of this PR (you are co-author) and merged it. I took only the dep + removing the cuda graph. If some other changes are important,...
Closing tentatively feel free to reopen.
Thanks a lot of the PR! This was indeed an oversight from me, thanks for catching it.
Is this fixed ? It seems the wheels aren't yet uploaded no ? https://flashinfer.ai/whl/cu124/
IT's merged from an updated PR I prepared for CI (https://github.com/huggingface/text-generation-inference/pull/2665) (only minor fixes have been updated in the control flow and adding a few comments).
This is hard to say without being able to reproduce anything. This sounds like a GIL issue although it's hard to prove or assert. Rust needs to own the GIL...