[MPS] Add support for autocast in MPS

[kulinseth]

Fixes https://github.com/pytorch/pytorch/issues/88415

cc @mcarilli @ptrblck @leslie-fang-intel @jgong5

[pytorch-bot[bot]]

:link: Helpful Links

:test_tube: See artifacts and rendered test results at hud.pytorch.org/pr/99272

• :page_facing_up: Preview Python docs built from this PR
• :page_facing_up: Preview C++ docs built from this PR
• :question: Need help or want to give feedback on the CI? Visit the bot commands wiki or our office hours

Note: Links to docs will display an error until the docs builds have been completed.

:white_check_mark: No Failures

As of commit c5aec3133d70d1a5d50fd33f99adc1c18ca1676c with merge base 71383dd3dae22b00161a9acb4f351e25b7e54ee8 (): :green_heart: Looks good so far! There are no failures yet. :green_heart:

This comment was automatically generated by Dr. CI and updates every 15 minutes.

[johnrichardrinehart]

@kulinseth It seems there is still some work to be done, here. What's your plan to address some of these comments?

[albanD]

Any update on this @kulinseth ?

[kulinseth]

Any update on this @kulinseth ?

Yes, I need to rebase and update here. I will do it this week.

[johnrichardrinehart]

@kulinseth Still in progress? Looks so based on #104191 .

[djollieb]

@kulinseth Is there any update on this please? This change would fix so many issues. Thank you

[kulinseth]

@kulinseth Is there any update on this please? This change would fix so many issues. Thank you

Yes , I will cleanup and rebase again . Will have something by early next week to try

[johnrichardrinehart]

@kulinseth Is there any update on this please? This change would fix so many issues. Thank you

Yes , I will cleanup and rebase again . Will have something by early next week to try

Any updates @kulinseth ?

[diffractometer]

@kulinseth I'll buy you a coffee!

[john1089]

Any updates @kulinseth ?

[PhilippeFerreiraDeSousa]

@kulinseth Can we do something to help?

[larsrnielsen]

@kulinseth any chance it will be this year?

[fakerybakery]

Any updates @kulinseth it'd be really great to see this PR merged and would greatly improve so many upstream projects!

[Abdullah-R]

Any updates @kulinseth? Have been eagerly awaiting this merge, would be super useful for various projects!

[larsrnielsen]

@kulinseth as you have stopped to work on it (according to your activity), is there someone else that can get it done?

[kulinseth]

@kulinseth as you have stopped to work on it (according to your activity), is there someone else that can get it done?

I am enlisting help from others (cc @malfet ) on this if we I can’t get to it in next 2 weeks .

[rajdtta]

@kulinseth just wanted to follow up on the progress of this.

Appreciate the work you're doing :)

[john1089]

So when this pr will be merged?

[larsrnielsen]

@kulinseth as you have stopped to work on it (according to your activity), is there someone else that can get it done?

I am enlisting help from others (cc @malfet ) on this if we I can’t get to it in next 2 weeks .

any updates?

[piotrpersona]

any updates on this?

[helsenIgnace]

When do you think this pr could be merged?

[Abdullah-R]

Is progress being made or has this PR been abandoned?

[petros94]

An update pls? 🙂

[galenmarchetti]

also pinging for updates, would love to see this

[bastienjalbert]

Will this PR merged one day ? Need help ?

[bghira]

@albanD please re-review

[bghira]

@kulinseth a gentle ping since pytorch 2.3 has bf16 on mps now

[arodri48]

@kulinseth I am interested in trying out AMP on my M3 Pro. Are there any updates regarding this PR?

[janboeye]

hi, @kulinseth I rebase your patch on latest main branch, could you help to review it ?

Thanks

[skotapati]

@pytorchbot rebase