Henrique Dias
Results
2
comments of
Henrique Dias
Hi @StellaAthena , I'm trynig to run inference and finetunning using 20B with 8 x NVIDIA A10G 23GB VRAM and still got the > RuntimeError: CUDA out of memory. Tried...
I was able tu run using HF version https://github.com/mallorbc/GPTNeoX20B_HuggingFace