StormMelody

Results 2 comments of


                                            StormMelody

Confused error message when ti.init() is not called

Is your problem solved? I meet the same problem, too.

[QUESTION] How to enable ZeRO 2/3 stages ?

Can Megatron's TP and FSDP be enabled simultaneously now?