Zach Mueller

Do you mean for training and using some of the model on CPU and some of the model on GPU? Or can you describe a bit more with the ideal...

This is something we're mildly looking into (the ability to train using the same methodology as big model inference), if this is accurate to what you are thinking.

Hi @rishabbala, if you'd like to contribute or see what you can get to, that'd be great! I'll be looking into this soon-ish but there's other pressing matters I need...

`prepare` will only move the model, dataloaders, scheduler, and optimizer. it doesn't work for individual tensor inputs. Please create a dataloader and prepare this, or do `x = x.to(accelerator.device)`

I don't particularly see anything wrong here, it stated that Accelerate was properly installed, so whatever you're doing with tensorflow/tensorRT is a separate issue than Accelerate, as do note that...

@sayakpaul can you tell us what `accelerate env` is too? Thanks :D

Ah sorry, what `default_config.yml` contains :)

@sayakpaul what specific CPU do you guys use for this if you know? I have a hunch the PR that broke it was this one https://github.com/huggingface/accelerate/pull/1118

Can reproduce, it does indeed stem from #1118, for now please build off pypi while we investigate

@abhilash1910 this also is another issue like it, that has a clear repr you can see: https://github.com/huggingface/diffusers/issues/3411