train-with-fsdp
train-with-fsdp copied to clipboard
abacaj
Results
2
train-with-fsdp issues
Sort by
recently updated
recently updated
newest added
Hi! Really cool project - wanted to suggest a slightly more fleshed out ReadMe to help new users and bump that SEO too ;) let me know if it's useful!...
What's the benefit of using FSDP? Why don't you just use transformers trainer module? Why not using LORA? And how much vram needed to train mistral 7B?
