tarnimat-hatem issues

Repositories
Issues
Comments

Results 1 issues of


                                            tarnimat-hatem

[BUG] Incompatibility Between DeepSpeed AutoTP and BLOOM in Training of Hugging Face models

I’ve encountered an issue while attempting to train BLOOM-1.7B using DeepSpeed’s AutoTP training of huggingface models functionality. The same setup works for LLaMA 2, but fails for BLOOM due to...

bug

training