starcoder issues

Finetune.py OOM when saving checkpoint if trained on 24GB 3090

11

I am attempting to finetune the model using the command provided in the README. I am getting CUDA OutOfMemoryError: ``` OutOfMemoryError: CUDA out of memory. Tried to allocate 144.00 MiB...

binaryninja

Hardware requirements for inference and fine tuning.

1

Hey, I am finishing a project on evaluating code language models on "creative" programming (shadercode). Just yesterday I finished fine-tuning sanatacoder on three different datasets to evaluate on my metric....

Vipitis

Project Uses Code Under Non-Permissive License to train AI models in violation of these licenses.

10

People had their work added to the training set without their explicit opt in permission and without their consent. This means that this entire project stack, as it's called, is...

duaneking

error

4

(venv) PS D:\Python project\venv> python starcoder.py Traceback (most recent call last): File "C:\WINDOWS\system32\venv\Lib\site-packages\huggingface_hub\utils\_errors.py", line 259, in hf_raise_for_status response.raise_for_status() File "C:\WINDOWS\system32\venv\Lib\site-packages\requests\models.py", line 1021, in raise_for_status raise HTTPError(http_error_msg, response=self) requests.exceptions.HTTPError: 401 Client...

Eddisont12

VS Code plugin is breaking the completion

1

Hello! Thank you for your work. I've encountered a strange behavior using a VS Code plugin (HF autocompletion). Sometimes it breaks the completion and adding it from the middle, like...

averkij