llama-recipes

llama-recipes copied to clipboard

# What does this PR do? Fixes # (issue) ## Feature/Issue validation/testing Please describe the tests that you ran to verify your changes and relevant result summary. Provide instructions so...

jeffxtang

prefix-tuning RuntimeError: Trying to backward through the graph a second time (or directly access saved tensors after they have already been freed).

2

### System Info PyTorch version: 2.0.1+cu117 Is debug build: False CUDA used to build PyTorch: 11.7 ROCM used to build PyTorch: N/A OS: Ubuntu 20.04.4 LTS (x86_64) GCC version: (Ubuntu...

hhh12hhh

HamidShojanazeri

Updating notebooks to llama 3 when possible. Removing the AWS specific notebook on prompting Llama 2, moving to the quick started guide and leaving it as the only prompt eng...

albertodepaola

# What does this PR do? Fixes # (issue) ## Feature/Issue validation/testing Please describe the tests that you ran to verify your changes and relevant result summary. Provide instructions so...

subramen

Updating notebook to reflect Llama 2 or 3 usage by removing the llama version ## Feature/Issue validation/testing Not tested on Azure yet. Based on how Azure works, it should work...

albertodepaola

Final OctoAI notebook updates in the recipes. ## Feature/Issue validation/testing Tested running the notebooks and verified they work as expected. ## Before submitting - [ ] This PR fixes a...

albertodepaola

FSDP Finetuned Model-optimizer and tokenizer

3

Thanks for the tutorials! I have several small questions about the model ft and usage. When doing Full parameter finetune using FSDP only, **Q1: should we use `save_optimizer` to True...

waterluck

# What does this PR do? Fixes # (issue) ## Feature/Issue validation/testing Please describe the tests that you ran to verify your changes and relevant result summary. Provide instructions so...

KeitaW

# What does this PR do? Fixes # (issue) ## Feature/Issue validation/testing Please describe the tests that you ran to verify your changes and relevant result summary. Provide instructions so...

reabdi