voice-changer icon indicating copy to clipboard operation
voice-changer copied to clipboard

[REQUEST]: Support for Blackwell GPU (50xx)

Open samw1tch opened this issue 1 year ago • 12 comments

In a few words, describe your idea

Please make a version with support for pytorch 12.8

More information

Recently got a 50xx series card and we have no support for it. I'm too much of a skiddy to update the install myself. Help would be appreciated!

Image

samw1tch avatar Feb 23 '25 23:02 samw1tch

That's weird. Could you specify the specs of your computer, os, and RVC version?

Kuuko-fokkusugaru avatar Feb 23 '25 23:02 Kuuko-fokkusugaru

Ah, sure. I have a 7800x3d, 5070ti, and the newest version of drivers etc. I'm running on win11, and I'm also having this issue with the latest version of the CUDA windows release. I'd venv and fix it, but again, very low level of knowledge when it comes to python, haha.

Image

Image

samw1tch avatar Feb 23 '25 23:02 samw1tch

of course, the solution is to just pip install torch 128 nightly into the location, but a prebuilt installer would be better for those like myself to one click go.

Image

samw1tch avatar Feb 24 '25 01:02 samw1tch

Out of curiosity, I guess this issue also affects v1? v1 for many, if not all, performs better in terms of quality. Except for a few users, everyone always ends up going back to v1 for that very reason.

Kuuko-fokkusugaru avatar Feb 24 '25 02:02 Kuuko-fokkusugaru

Yup, and the problem is that we don't have a version of torch that's an official release, and other AI related apps had to have theirs built beforehand. I expect this to be eventually resolved in like, two months.

samw1tch avatar Feb 26 '25 02:02 samw1tch

would that manual fix for v2 work for v1 too? I feel it may be quite important for many to be able to fix v1 while it outperforms v2

Kuuko-fokkusugaru avatar Feb 26 '25 03:02 Kuuko-fokkusugaru

Not yet. I've officially tried everything including building my own version of torchaudio for 12.8, but as of 2/25, there's still no version of torchaudio specifically that will work with cuda 12.8. someone is gonna have to build it themself, and unfortunately I am not nearly as skilled enough to do so,

samw1tch avatar Feb 26 '25 05:02 samw1tch

Image

amrizal25az avatar Mar 15 '25 06:03 amrizal25az

Hi Folks, I'm running into the same issue here, I need to upgrade to the nightly to use sm_120 , wondering

has anyone successfully got blackwell working with this?

If so, kindly list step to do so?

thanks!

dirtmonster1337 avatar Mar 15 '25 14:03 dirtmonster1337

of course, the solution is to just pip install torch 128 nightly into the location, but a prebuilt installer would be better for those like myself to one click go.

Image

pip install --pre --upgrade --no-user torch torchaudio --index-url https://download.pytorch.org/whl/nightly/cu128 --target "C:\wherever_you_extracted_it\vcclient_win_cuda_2.0.76-beta\dist\main\_internal"

jtbwatson avatar Apr 14 '25 02:04 jtbwatson

thanks, what about for the MMVCServerSIO ?

dirtmonster1337 avatar Apr 14 '25 17:04 dirtmonster1337

that command yields Errno 1101) getaddrinfor failed, could not find a version that satisfies the requirement torch, no matching distribution found for torch

dirtmonster1337 avatar Apr 14 '25 17:04 dirtmonster1337