thomas chaton

Hey @fdalvi. Outside of Studios, it means we won't clean up the cache. So it might lead to un-excepted behaviour. Another option is to change the cache path to `~/.lightning/cache`

Hey @hubertsiuzdak @fdalvi, This should be fixed with this PR: https://github.com/Lightning-AI/litdata/pull/166/files. You can check by trying out master. ```python import os import uuid from glob import glob import litdata import...

Hey @ouj. Yes, 1D data is handled differently to handle tokens for training LLMs. This isn't a nice behaviour and I meant to provide a better mechanism but I never...

Hey @shaibagon, feel free to make a PR.

Dear @z-a-f, Lightning executes the callbacks in the order there were provided. If you provide them in the same way on reload, the behaviour should be deterministic. However, we are...

Hey @kandluis, (1): The workers / nodes doesn't have an impact on the Trainer arguments (very unlikely at least for most users). (2): Lightning won't re-order the callbacks. This would...

Any progress ?

Hey @adamjstewart. This would be great if you decide to go with Lightning Studios ! On a side note, I know some users enjoy Litdata: https://github.com/Lightning-AI/litdata to faciliate usage of...

Hey [cgebbe](https://github.com/cgebbe), Do you think you could provide an example with a dummy model & synthetic data ? The model doesn't have to train at all. Also, you should try...

Hey @cgebbe. Sounds great. Let me know. We can do a pair debugging session too if you are open to it if you can't create a reproducible script for me...