m-harmonic

Deepspeed Stage 3 crashes Lightning trainer

2

### Bug description We are using the deepspeed_stage_3 strategy with default deepspeed settings, via the following code: ``` trainer = lightning.Trainer( strategy = "deepspeed_stage_3", precision = "bf16-mixed", devices = 8,...

Allow Stream's `repeat` option to cycle through entire dataset before repeating, when `shuffle=True`

5

## 🚀 Feature Request I am using the repeat option when creating a stream, i.e. `Stream(repeat=2)` in addition to random shuffle, i.e. `StreamingDataset(shuffle=True)`. It appears that there is no constraint...

[Bug]: VLLM crashes when prefix caching is enabled

2

### Your current environment ```text PyTorch version: 2.3.0+cu121 Is debug build: False CUDA used to build PyTorch: 12.1 ROCM used to build PyTorch: N/A OS: Ubuntu 22.04.4 LTS (x86_64) GCC...