thomas chaton

Hey @sanyalsunny111. Can you make a PR with the fix ?

Hey @senarvi, Would you mind making a PR to add a note in the README about this ? Additionally, we could consider adding placeholder to tell LitData to not de-composed...

Hey @senarvi, I was thinking something like this. ```python from litdata.types import List, Dict def fn(...): return {"list": List([...])} ``` This way, the pytree won't be decomposed and the list...

Yes, we could have something smart for it if we want to. Would you be interested into contributing such feature ?

Hey @senarvi. Thanks for trying LitData, let me know how it goes ;) Use the latest version too. I will make a new release tomorrow.

Hey @samsja, feel free to contribute fsspec support

From the logs, it seems 4 processes are downloading the chunks but one deletes it before the other are finished with it. ```python DOWNLOADING /cache/chunks/2539bee168b4ea4262fd6320b47c8288/chunk-24-0.bin DOWNLOADING /cache/chunks/2539bee168b4ea4262fd6320b47c8288/chunk-19-17.bin DOWNLOADING /cache/chunks/2539bee168b4ea4262fd6320b47c8288/chunk-32-4.bin DOWNLOADING...

Hey @rakro101 do you think you could contribute an example with PyTorch Lightning to the repo ?

Yes, it is normal. All good @taemincho

Hey @JacobARose Do you have a Studio that you could share with us ?