Seyyed Ali Ayati

ERROR:torch.distributed.elastic.multiprocessing.api:failed (exitcode: -9) local_rank: 0

27

I am trying to re-train alpaca on the following machine:  ```bash +-----------------------------------------------------------------------------+ | NVIDIA-SMI 525.105.17 Driver Version: 525.105.17 CUDA Version: 12.0 | |-------------------------------+----------------------+----------------------+ | GPU Name Persistence-M| Bus-Id Disp.A...

torch.cuda.OutOfMemoryError: CUDA out of memory When Trying to Save the Model

9

Howdy! I am using the `finetune/finetune.py` script. It trains on NVIDIA A40, and at the end when it tries to save the model/checkpoints it raises the `torch.cuda.OutOfMemoryError: CUDA out of...

Support for bigcode/starcoder

7

Hi! I saw the example for the `bigcode/gpt_bigcode-santacoder` model. I am wondering how I can run the `bigcode/starcoder` model on CPU with a similar approach. When I run the following...

I quote from your paper: > "Our second dataset comprises 54 real-world exploits collected from postmortems and bugfix reviews of real-world exploits from January 2022 to June 2022." How can...