FastChat icon indicating copy to clipboard operation
FastChat copied to clipboard

Single machine single card fine-tuning problem

Open zlht812 opened this issue 1 year ago • 0 comments

When running fine-tuning command on a single machine with a single network adapter, init_process_group is called and there is no response for a long time, which seems to be hanged. The parameter configuration is as follows: backend=gloo, local_rank=0, world_size=1. Can anyone advise on this?

zlht812 avatar May 04 '23 03:05 zlht812