Zach Mueller comments

Results 368 comments of


                                            Zach Mueller

If I am optimizing more than one model, do I need to write "with accelerator.accumulate(model1) and accelerator.accumulate(model2)"?

Duplicate of https://github.com/huggingface/accelerate/issues/1414

ValueError, doesn't have any device set.

cc @sgugger

dispatch_model with inferred device map fails multi-gpu execution with native torch function

cc @sgugger

accelerator.end_training() is generating exception when wandb is being used as tracker

@somepago any chance you could give some more information on your setup or script? I haven't been able to recreate this quite yet. Are we launching it from Jupyter or...

accelerator.end_training() is generating exception when wandb is being used as tracker

We've reached out to the W&B folks, we should have a solution soon!

accelerator.end_training() is generating exception when wandb is being used as tracker

@nabarunbaruaAIML thanks for the pointer! Will pass along to the W&B team. They should have a fix by the next release as they've identified the problem as well. The workaround...

accelerator.end_training() is generating exception when wandb is being used as tracker

The fix for this *should* be out now, let us know if you all are still seeing this issue

InitProcessGroupKwargs(timeout=timedelta(seconds=3600)) not work !!!!!

Please give us the output of `accelerate env` and how you are creating your DataLoaders and Dataset (rough code will work)

InitProcessGroupKwargs(timeout=timedelta(seconds=3600)) not work !!!!!

@bestpredicts please run `accelerate env` in your CLI and give us your output to help us further with debugging, so we can reproduce your entire setup including configuration.

InitProcessGroupKwargs(timeout=timedelta(seconds=3600)) not work !!!!!

How are you creating your `Accelerator` object and the `Dataset`? Is it an `IterableDataset`?