swift icon indicating copy to clipboard operation
swift copied to clipboard

Published 20 hours ago • verified publisher icon modelscope

DDP `include_num_input_tokens_seen` fine-tuning hangs (nccl)

Open Jintao-Huang opened this issue 2 months ago • 1 comments

Jintao-Huang avatar Apr 29 '24 05:04 Jintao-Huang

https://github.com/huggingface/transformers/issues/28791

Upgrade transformers to version 4.40 or higher.

Jintao-Huang avatar Apr 29 '24 05:04 Jintao-Huang