ai-toolkit icon indicating copy to clipboard operation
ai-toolkit copied to clipboard

Nvidia RTX 5090 compatability

Open Frisby572 opened this issue 1 week ago • 1 comments

Describe the bug

Bug in setup instructions, i.e. lack of sufficient information to enable installation and use on Linux Mint (22.2 Cinnamon) laptop with Nvidia RTX 5090 (24 GB VRAM) graphics card. Somebody needs to cut-through the complexity of PyTorch, Cuda, Nvidia, and Python3, configuration options and spell it out as one, two, three, …

The 5090 card has been available for over a year, and by now the various niceties and compatibilities ought to have been sifted by developers. The card is becoming mainstream for 'local use' devices, and it's no longer a novelty.

Frisby572 avatar Dec 09 '25 16:12 Frisby572

sm120 error is cuda error , install https://pytorch.org/get-started/locally/ 12.8 and after ai-toolkit\venv\Scripts>python.exe -m pip install torchaudio As it doesn't come with torchaudio then install requirements.txt

siraxe avatar Dec 09 '25 20:12 siraxe

https://github.com/omgitsgb/ostris-ai-toolkit-50gpu-installer

One click installer I made if you are having trouble.

omgitsgb avatar Dec 12 '25 20:12 omgitsgb