sharlynxy comments

Repositories
Issues
Comments

Results 2 comments of


                                            sharlynxy

double free or corruption (!prev)

I met this problem too. Did you find out any solution? I am trying with model llama2-70b-lora on 8*h100. ```text nb-e3p9s3o28rnk-0:21619:22709 [7] NCCL INFO comm 0x25b97d10 rank 7 nranks 8...

Fix: try aligning dtype of matrixes when training with deepspeed and mixed-precision is set to bf16 or fp16

> My questions are of the requirements. Where was deepspeed coming from before? Is updating to 2.6.0 and having diffusers automatically update it a good idea with various different ways...