stanford_alpaca
stanford_alpaca copied to clipboard
tatsu-lab
Code and documentation to train Stanford's Alpaca models, and generate the data.
Are we still doing next token prediction just on this specific dataset or more general seq2seq training where we map arbitrary length input sequences to arbitrary length output sequences? For...
so is it possible to like import it and use it as a function for one of my project? if not is there a rest Api that I can use...
a bug ``` blacklist = [ "image", "images", "graph", "graphs", "picture", "pictures", "file", "files", "map", "maps", "draw", "plot", "go to", "video", "audio", "music", "flowchart", "diagram", ] `` should not filter...
When attempting to do fine tuning, I'm getting the following error in the output: `RuntimeError: Distributed package doesn't have NCCL built in` Searching here indicates this is related to CUDA...
Dear stanford team, you did a great job on this project! I want to use this model for a specific task. My question is general, but I will provide you...
I use A100 40GB, load llama 7B model, run command below: ``` torchrun --nproc_per_node=8 --master_port=25001 train.py \ --model_name_or_path /home/model_zoo/llama/7B/hugging_face_format/ \ --data_path /home/Repository/LLM/stanford_alpaca/alpaca_data.json \ --bf16 True \ --output_dir /home/Repository/LLM/stanford_alpaca/output/alpaca/sft_7b \ --num_train_epochs...
Thanks for your valuable work! I have a question: during generating new instructions by using text-davinci-003, if I want to use my openai API key, should I change the following...
We fine-tuned Alpaca on one single node with torchrun, and on multiple nodes with DeepSpeed. I am following the "demo" parameters > temperature=0.7 top_p=0.9 do_sample=True num_beams=1 max_new_tokens=600 We evaluate the...
When I use four GPU to train the model, I meet this error, can anybody help me slove this error? Thank you very much. ``` WARNING:__main__: ***************************************** Setting OMP_NUM_THREADS environment...
