Christopher Cruttenden

Hanging with FSDP but not DS

3

### System Info ```Shell - `Accelerate` version: 0.26.1 - Platform: Linux-5.15.0-91-generic-x86_64-with-glibc2.35 - Python version: 3.11.5 - Numpy version: 1.26.3 - PyTorch version (GPU?): 2.1.2 (True) - PyTorch XPU available: False...

Fine-tuning only doesn't work with "basic" distributed settings

1

### System Info ```Shell - `Accelerate` version: 0.25.0 - Platform: Linux-6.5.0-18-generic-x86_64-with-glibc2.35 - Python version: 3.11.5 - Numpy version: 1.26.3 - PyTorch version (GPU?): 2.1.2 (True) - PyTorch XPU available: False...

(Fixable?) 400 Error with vLLM API - extra input

2

Howdy. It seems when running a vLLM server and then attempting to interact with it via `HFClientVLLM`, I get an error message. Here is how to reproduce: ```bash # Computer...