Joe Cummings
Joe Cummings
@ebsmothers is this completed?
> Torchvision has a CI job that runs daily and tries to download the datasets that torchvision exposes. If there's a failure, the job would open an issue like [these...
Are these in docs?
Hey @cuichenx - glad you found the tutorials useful! Currently, multi-GPU FSDP + QLoRA is *not* supported in torchtune, but this is something we are actively working on. Turns out...
WRT your second point, `alpaca_dataset` is a builder function, not a module, therefore it cannot be imported the way you're doing it. ``` >>> import torchtune.datasets.alpaca_dataset Traceback (most recent call...
To add on to this, we have stronger testing for PyTorch-native checkpoints, therefore we usually prefer downloading those. And to preserve space on your machine, we don't want to download...
Any update here? I want to train on https://huggingface.co/datasets/allenai/dolma soon.
I am also finding this logging output cumbersome!
@ScottHoang This was enabled in #975 - check it out!
Actually approved now. Thanks @pbontrager