OpenNMT
Update to CUDA 12.8
Update Windows and Linux from CUDA 12.4 to CUDA 12.8 Upgraded manylinux2014 to manylinux_2_28
Completely forgot, the PR includes https://github.com/OpenNMT/CTranslate2/pull/1920 , I think, merge his PR first to keep attribution.
Thanks. Have you tried the new wheels under Linux and Windows on a machine with a CUDA GPU? Github runners do not have GPUs.
Have you tried the new wheels under Linux and Windows on a machine with a CUDA GPU?
Yes, on both, Linux and Windows with the CUDA GPUs.
Glad to see that this repository is finally be working on and this "Systran" company has given authority to modify to people who actually care about the repo!
Completely forgot, the PR includes #1920 , I think, merge his PR first to keep attribution.
There is still an unresolved comment on #1920, but this PR has already integrated the changes from #1920. I suggest removing that change so this PR can be released independently.
Hello. I was going to merge this PR but when testing this wheel:
ctranslate2-4.6.1-cp313-cp313-manylinux_2_27_x86_64.manylinux_2_28_x86_64.whl
I get this error when I use CUDA:
Could not load symbol cudnnGetLibConfig. Error: /lib/x86_64-linux-gnu/libcudnn_graph.so.9: undefined symbol: cudnnGetLibConfig
Previous CTranslate2 works well in this machine. I had no time to investigate this further but I decided not to merge this PR in version 4.6.2 to have more time to investigate what happens. Definitely we should merge this PR.
For next version I want to look at https://github.com/OpenNMT/CTranslate2/issues/1934 and this probably will be solve if we remove this dependency.
I get this error when I use CUDA:
Could not load symbol cudnnGetLibConfig. Error: /lib/x86_64-linux-gnu/libcudnn_graph.so.9: undefined symbol: cudnnGetLibConfig
Check your Nvidia driver, CUDA/CUDA toolkit versions. Maybe needs to be updated.