flycser comments

Repositories
Issues
Comments

Results 2 comments of


                                            flycser

Hydra can not recognize "--local_rank=0" argument

> @Dawn-970 Hi, I have met with same issue, can it be solved? use pytorch -m torch.distributed.lauch --use_env and set cfg.distributed_training.device_id by os.environ['LOCAL_RANK']

fp16 bug about grad_norm computation (resulting in min loss scale reached)

> Hi, I have the same problem, what should I do to fix this bug, thanks! Just have a look at the fp16 optimizer in version 0.8. Call the multiply_grads...