Shadi Hamdan comments

Repositories
Issues
Comments

Results 2 comments of


                                            Shadi Hamdan

CRITICAL BUG: Multi GPU training possibly not implemented correctly, resulting models potentially under-trained

Hello, I will be able to test it in a couple days, but one thing I notice is that there is no where that the self.epoch value is updated. Typically,...

[Bug] Qwen2.5-VL-7B + Unsloth + Accelerate DDP: Model Loading Delays and 'find_unused_parameters' RuntimeError

Any updates on this? Were you able to find any workaround?