ZQ

Same problem here. Using Ubuntu via WSL2, CUDA 11.7, RTX 2080Ti, Python 3.10.

@WoosukKwon I just got it working, maybe my solution will help the others @ElizabethCappon @sharlec @bashirsouid. My problem was specific to WSL. Turns out I did not have a *full*...

+1 for the offline functionality @elsell is requesting.

If you have less than the default number of GPUs (8), you have to specify how many when you load the model. Try: `model = gal.load_model(name = 'base', num_gpus =...

> > If you have less than the default number of GPUs (8) > > Who has a default number of 8 GPUs? people that work at Meta AI, probably...

I had the same issue. The quickstart seems to install the cpu only version of pytorch by default. You need the cuda-enabled version of pytorch. Use pip/conda to uninstall the...

> > I had the same issue. The quickstart seems to install the cpu only version of pytorch by default. You need the cuda-enabled version of pytorch. Use pip/conda to...

> Quick final follow up... Any chance you could hang some instructions somewhere to help others replicate the process? I'm trying to follow along but have run into some issues....

I'm running into the same issue. I'm on Ubuntu WSL2, CUDA 11.8, and RTX 2080Ti, which should easily be able to accommodate opt-125m. I've tried other small models, such as...

I'm seeing the same as @SunixLiu. Nothing else is happening on my GPU. Running the code at the top of this issue spikes the GPU and then crashes.