stanford_alpaca

stanford_alpaca copied to clipboard

Ccdzjf

Different format for inference ？

2

PansaLegrand

Weights released + frontend, you can try Alpaca 7B here

1

https://github.com/pointnetwork/point-alpaca

sergevar

A brief summary of the potential issues during the replication and corresponding solutons

2

## 1. module transformers has no attribute LLaMATokenizer or 'missing key 'llama'. First, install the SentencePiece then install transformers from huggingface git repo. i.e., pip install sentencepiece, pip install git+https://github.com/huggingface/transformers.git...

puyuanliu

Solve BUG:AttributeError: module transformers has no attribute LLaMATokenizer

12

I wang to follow the guide below. > Given Hugging Face hasn't officially supported the LLaMA models, we fine-tuned LLaMA with Hugging Face's transformers library by installing it from a...

XuyaoWang

This minor PR is to add a notes to address training slowdown issue mentioned in https://github.com/tatsu-lab/stanford_alpaca/issues/32

helloeve

Why does the blog mention the PR https://github.com/huggingface/transformers/pull/21955 when it says its merged

2

A [member](https://github.com/huggingface/transformers/pull/21955#issuecomment-1471973195) of this PR claims that the PR is merged but GitHub is showing wrong status for the merge, But the blog says that a specific commit was used...

nithinhrao

I fixed three spelling mistakes in the prompt.

RikVN

Questions about installing Transformer, and the versions of each environment

1

Is the following installation method correct? pip install git+https://github.com/zphang/transformers.git@llama_push Each version is as follows： numpy==1.24.2 rouge-score==0.1.2 fire==0.5.0 openai==0.27.2 sentencepiece==0.1.97 wandb==0.14.0

447428054

finetuning on 3090, is it possible?

2

Is it possible to finetune the 7B model using 8*3090? I had set: --per_device_train_batch_size 1 \ --per_device_eval_batch_size 1 \ but still got OOM: torch.cuda.OutOfMemoryError: CUDA out of memory. Tried to...

yfliao