tutorials icon indicating copy to clipboard operation
tutorials copied to clipboard

Expand AOTI tutorial to cover AMP

Open bhack opened this issue 1 year ago • 4 comments

📚 The doc issue

I think it would useful to expand AOTI tutorial to cover AMP trained models.

https://pytorch.org/tutorials/recipes/torch_export_aoti_python.html

Suggest a potential alternative/fix

No response

cc @svekars @brycebortree @sekyondaMeta @ezyang @chauhang @penguinwu @avikchaudhuri @gmagogsfm @zhxchen17 @tugsbayasgalan @angelayi @suo @ydwu4 @desertfire @chenyang78

bhack avatar Nov 06 '24 21:11 bhack

/cc @agunapal @angelayi @svekars

bhack avatar Nov 06 '24 21:11 bhack

@bhack Thanks for the suggestion. Will check

agunapal avatar Nov 06 '24 21:11 agunapal

Let's move this to the tutorials repo.

svekars avatar Nov 08 '24 20:11 svekars

What is the status of this with 2.6.0 ?

bhack avatar Jan 31 '25 14:01 bhack

@bhack what sort of model are you looking at? Could you provide a pointer? I would think that an AMP trained model behaves the same as just any model that you pass to export?

angelayi avatar Apr 16 '25 21:04 angelayi

Nothing specific just a general guide how to export/aoti compile an amp model. Mainly not only specifically amp trained but also the case when we want to use amp at inference.

E.g. do we need to amp wrap the model before export/compile? Etc..

bhack avatar Apr 16 '25 21:04 bhack