Blake

Can't build docker image

2

### System Info Ryzen 5950x, Ubuntu 22.04, 2 RTX 3090s, main branch ### Who can help? @byshiue @sch ### Information - [X] The official example scripts - [ ] My...

Accelerate 0.30.0 Breaks FSDP QLora

7

### System Info ```Shell See below a pip list output that does not work: Package Version ------------------------ --------------- accelerate 0.30.0 aiohttp 3.9.5 aiosignal 1.3.1 annotated-types 0.6.0 async-timeout 4.0.3 attrs 23.2.0...

LLama 3/3.1 70B Outputting "!!!!!!"; Shorter Context

5

### System Info text-generation-launcher --env 2024-07-26T03:39:42.960734Z INFO text_generation_launcher: Runtime environment: Target: x86_64-unknown-linux-gnu Cargo version: 1.79.0 Commit sha: 3905f854ed49b0bc50e6c983d3e6b254fcf02288 Docker label: sha-3905f85 nvidia-smi: Fri Jul 26 03:39:42 2024 +---------------------------------------------------------------------------------------+ | NVIDIA-SMI...