symhsym

Results 2 comments of symhsym

[DDP] 并行训练问题/Multi-head shared-backbone model triggers “Expected to mark a variable ready only once” — how to parallelize training?

求解！！

[DDP] 并行训练问题/Multi-head shared-backbone model triggers “Expected to mark a variable ready only once” — how to parallelize training?

Thank you very much for your reply—this will be very helpful. Additionally, have you considered packing the fine-tuning data to further reduce the fine-tuning time? If possible, please provide some...