RandoInternetPreson

Ooh yes please I'd like to try your updates out 😁

Here is the solution: https://www.reddit.com/r/Oobabooga/comments/17vg2ot/multigpu_psa_how_to_disable_persistent_balanced/ Don't set the last slider to zero, set it to like 1 or 5 gigs, but if you have enough space on the first GPU...

I think so too, or have a option to send sequential or balanced.

I have another tip! If you are like me and want to load other models (which default load on gpu 0) you want to reverse the order the gpus are...

@JustDoIt65 I just installed the latest version of oobabooga and the two files I usually edit are still there. modeling_utils.py can be found here: text-generation-webui-main\installer_files\env\Lib\site-packages\transformers Using the info at this...

I don't know if you are still experiencing issues, but I've found that different browsers behave very differently. I have found Opera to work best on mobile devices, perhaps trying...

Worked for me too! Thanks!

I don't really know what is happening, but I have tried reverting back to gradio==4.23.* and now I don't get the error, instead the audio will be transcribed once. Upon...

@divine-taco Same here, repeats gibberish using transformers 8-bit and 4-bit, I have tried a lot of different settings and parameter changes. I can load it via transformers, but it will...

Hmm, I guess the fix was just for the 35b version not the plus version? I grabbed the dev version and tried it out without any change to the output...