Henrique Dias

Results 2 comments of Henrique Dias

Hi @StellaAthena , I'm trynig to run inference and finetunning using 20B with 8 x NVIDIA A10G 23GB VRAM and still got the > RuntimeError: CUDA out of memory. Tried...

I was able tu run using HF version https://github.com/mallorbc/GPTNeoX20B_HuggingFace