Oleg Sinavski

Hello, Thank you very much for the bindings, great stuff! It seems that I found a bug in serialization of simple structures. According to the test below (which fails for...

"backward pass is invalid for module in evaluation mode" with deepspeed stage 3

6

### Bug description Hello, After 2.2 Lightning upgrade and only with deepspeed stage 3, we experience a crash `backward pass is invalid for module in evaluation mode`. Most likely is...

`batch_sampler.batch_size` is None with deepspeed and `DataLoader(batch_size=None)`

4

### Bug description Hello, After Lightning 2.2.0 upgrade we experience a crash when using `deepspeed` with `DataLoader(batch_size=None, ...)`: ``` File ".../pip-ai-experimental_pytorch_lightning/site-packages/pytorch_lightning/trainer/trainer.py", line 579, in _fit_impl self._run(model, ckpt_path=ckpt_path) File ".../pip-ai-experimental_pytorch_lightning/site-packages/pytorch_lightning/trainer/trainer.py", line...

### Bug description When parsing the following: ```python from typing import Any, Mapping, Optional, Tuple, Callable import torch import torch.optim from pytorch_lightning import LightningModule class TransformersModule(LightningModule): def __init__( self, model_factory:...

Dataloader is slow with iterdatapipes and shuffle that has large in-memory fields (because traverse_dps is slow)

3

### 🐛 Describe the bug Hello, I found that a standard DataLoader takes unreasonably long to construct itself and to load the first batch if there is a filed in...

Loading List of List of Strings leads to nans

6

**Describe the issue**: Hello, I have a peculiar field type in my parquet file: List of Lists of strings. For example: 0 [] 1 [["hello"]] 2 [["hello", "bye"]] 3 [["hello"],...

NCCL timeout (or GPU OOMs) when using Wandb + configure_model with passing a factory + save_hyperparameters + large models

3

### Bug description Hello! I found this weird interaction that took me a while to debug, so hopefully someone finds it useful or it's possible to fix something in Lightning....