llama-recipes

llama-recipes copied to clipboard

fix llama3 cookbook with llamaindex and groq

1

# What does this PR do? Fixes # (issue) ## Feature/Issue validation/testing Please describe the tests that you ran to verify your changes and relevant result summary. Provide instructions so...

dloman118

Update hello_llama_cloud.ipynb

3

Fix: LangChai->LangChain # What does this PR do? Fixes # (issue) ## Feature/Issue validation/testing Please describe the tests that you ran to verify your changes and relevant result summary. Provide...

MrDlt

rameerez

Prompt template for agents with multiple tools and states + Positioning of info in prompts

3

There seems to be ample prompt resources for niche applications(interview helper, essay writing) but there seems to be almost nothing for general-purpose agents with multpiple tools, states and specific output...

DevMandal-Sarvam

Multi-GPU training fails under collective operation timeout

2

### System Info ml.g5.12xlarge instance from AWS, with pyTorch 2.3.1, 4x A10G, CUDA 12.1 Modified dataset since I already pre-tokenized everything to avoid using time on GPU instances to reduce...

BaiqingL

# What does this PR do? I added the capability to fine-tune an LLM using RAFT, a technique designed to create a dataset that helps the model better distinguish important...

efenocchi

Add in the use of iterable datasets when fine tuning

1

### 🚀 The feature, motivation and pitch Some datasets may be too large to fit into memory directly, would be nice to provide the option to create an iterable dataset...

BaiqingL

# What does this PR do? Adding Torchtune recipe for fine-tuning so that the users can now use torchtune to fine-tune Llama models ## Feature/Issue validation/testing - [x] Followed this...

wukaixingxp

Cache mechanism would result in Error while training?

3

I encountered a problem when fine-tuning the model. I believe the issue lies in the cache mechanism of the class Attention(nn.Module). During the previous forward pass, the cache for k...

HeguangtongchenWZQ

# What does this PR do? Fixes # (issue) ## Feature/Issue validation/testing Please describe the tests that you ran to verify your changes and relevant result summary. Provide instructions so...

Clown4730