llama-recipes

llama-recipes copied to clipboard

fix that help reaching 50% over binary classification of toxic chat

1

Initial fix for # https://github.com/meta-llama/llama-recipes/issues/633

sheli-kohan

The EOS and BOS token setting when contine pretraining Llama3.1

3

Hello, Thank you for providing these valuable recipes. I appreciate your work. I'm interested in **further pre-training the Llama3.1-8B-base model rather than using the instruct version**. To ensure I prepare...

ShomyLiu

upgrade typing_extensions version

1

### System Info PyTorch: 2.3 Cuda: 12.1 ### Information - [ ] The official example scripts - [ ] My own modified scripts ### 🐛 Describe the bug I got...

lxning

### 🚀 The feature, motivation and pitch Hey folks, big fan of your work, especially all the details provided around evaluations! I am trying to reproduce results for [MultiPL-E](https://github.com/meta-llama/llama-models/blob/main/models/llama3_1/eval_details.md#multipl-e-humaneval-and-multipl-e-mbpp) without...

devanshrj

### 🚀 The feature, motivation and pitch It’s time to design a logo ### Alternatives more ### Additional context _No response_

LIHUA919

Improve model checkpoint saving logic

1

Improve model checkpoint saving logic to always save model checkpoint when validation is not run # What does this PR do? This PR enhances the model checkpoint saving logic to...

lucas-ventura

# What does this PR do? availble -> available ## Feature/Issue validation/testing Please describe the tests that you ran to verify your changes and relevant result summary. Provide instructions so...

eltociear

Llama 3.2 training scripts?

2

### System Info N/A ### Information - [X] The official example scripts - [ ] My own modified scripts ### 🐛 Describe the bug The llama.com website states: > The...

victorb

Tool Calling Tutorial and Example

1

Add Tool Calling 101 and 201 examples

init27

FSDP2 support for training

1

### 🚀 The feature, motivation and pitch Is there any plan to add [FSDP2](https://github.com/pytorch/torchtitan/blob/main/docs/fsdp.md) for training? ### Alternatives _No response_ ### Additional context _No response_

cailun01