Don Beckham

If you don't know what 300 GB of VRAM is, you have a lot to learn before trying to run this model. You need 8 of these.... https://www.amazon.com/NVIDIA-Ampere-Passive-Double-Height/dp/B09N95N3PW

Verify you have the cuda version of pytorch installed by running the following commands at a python prompt, You should get a response TRUE. If you get FALSE you don't...