starcoder

starcoder copied to clipboard

Deprecated warning during inference with starcoder fp16

1

I installed all the dependencies by following the instructions from the repo. Following that, I am running the following code: ``` import torch from transformers import AutoModelForCausalLM, AutoTokenizer checkpoint =...

code2graph

Issue with running Starcoder Model on Mac M2 with Transformers library in CPU environment

1

I'm attempting to run the Starcoder model on a Mac M2 with 32GB of memory using the Transformers library in a CPU environment. Despite setting load_in_8bit=True, I'm encountering an error...

code2graph

Why utilizing the 'question' column of the 'ArmelR/stack-exchange-instruction' dataset for gradient backpropagation?

1

Thank you for your valuable open-source contribution! In instruction tuning stage, it seems that only the answer aligned with the instruction participates in the backpropagation process. And [this code](https://github.com/bigcode-project/starcoder/blob/main/finetune/finetune.py#L190) seems...

HIT-cwh

While performing inference with starcoder, I encountered the following errors: ``` bin [ANONYMIZED_PATH]/miniconda3/envs/starcoder/lib/python3.10/site-packages/bitsandbytes/libbitsandbytes_cpu.so [ANONYMIZED_PATH]/miniconda3/envs/starcoder/lib/python3.10/site-packages/bitsandbytes/cextension.py:34: UserWarning: The installed version of bitsandbytes was compiled without GPU support. 8-bit optimizers, 8-bit multiplication, and...

nashid

fix mask_user_labels

3

Dear authors of Starcoder, while using the framework, I noticed that mask_user_labels sometimes does not function properly. Upon investigation, I found that there might be an issue with the function...

DoffeBupt

I'm interested in running StarCoder for inference on my macOS machine, but I have some questions. **Questions:** **Library Recommendations:** I've come across OpenLLM. Should I be considering OpenLLM for this,...

code2graph

chat/dialogues.py mask_user_labels is bug?

1

```python def mask_user_labels(tokenizer, dialogue_template, labels): """Masks the user turns of a dialogue from the loss""" user_token_id = tokenizer.convert_tokens_to_ids(dialogue_template.user_token) assistant_token_id = tokenizer.convert_tokens_to_ids(dialogue_template.assistant_token) for idx, label_id in enumerate(labels): ``` The labels parameter...

wanglongxingtianxia

How to fine-tune Starchat-beta on my question-answer dataset?

2

I have a dataset that has two columns called: Question Answer Questions like: "Write a python code to reverse a list". Answer: code for that question. I have looked at...

AIAnytime

How to save and load custom finetune

3

I am trying to further finetune `Starchat-Beta`, save my progress, load my progress, and continue training. But whatever I do, it doesn't come together. Whenever I load my progress and...

CrackedBeefcake

some concern in "mask_user_labels"?

1

1. file chat/dialogues.py:239 should while labels[current_idx] != assistant_token_id and current_idx < len(labels): be while current_idx < len(labels) and labels[current_idx] != assistant_token_id: ? 2. chat/train.py:204 should mask_user_labels(tokenizer, dialogue_template, labels) be: for...

DoffeBupt