Zach Mueller comments

Results 488 comments of


                                            Zach Mueller

Correct zero division error in inverse sqrt scheduler

cc @Sangh0

Correct zero division error in inverse sqrt scheduler

Agree with Amy here!

Correct zero division error in inverse sqrt scheduler

@DavidAfonsoValente can you rebase from main and push with `-f` (to not have the git commit history/diff all crazy) so we can double check tests are green? 🤗 Thanks!

Introduce configured_state arg for accelerator_config

cc @amyeroberts

Introduce configured_state arg for accelerator_config

@amyeroberts requesting a rereview after having to gut much of it on further testing 😅

schedulefree optimizers

FYI this will need https://github.com/huggingface/accelerate/pull/2631 as we need to upstream accelerate's ability to call train/eval on a wrapped optimizer

schedulefree optimizers

We've merged the accelerate portion in, so if anyone is trying this out in distributed fashions, you can do `pip install git+https://github.com/huggingface/accelerate` :)

enable Pipeline to get device from model

@faaany are we sure that `model.device` *is a thing* across all these frameworks? At most I see `ModuleUtilsMixin` has `device` which is PyTorch specific (it gets added to `AutoModel`, but...

use_reentrant=False can't be set properly

I couldn't recreate this warning. Can you try either: 1. Using the dev version of transformers `pip install git+https://github.com/huggingface/transformers` 2. Upgrading your PyTorch version `pip install torch -U` And let...

Crash when trying to import pipeline when using TPUv2 in GoogleColab

Hi all, after talking with the torch-xla team tensorflow is the issue here. You can try doing the following: ```bash pip uninstall tensorflow pip install tensorflow-cpu ```