metaflow icon indicating copy to clipboard operation
metaflow copied to clipboard
verified publisher icon Netflix

Support for AWS Inferentia instances on batch

Open DanCorvesor opened this issue 3 years ago • 5 comments

As per this documentation explaining how to set up Inferentia ECS instances, this PR adds support and specifically a new batch inferentia parameter to do this Working with inference workloads on Amazon ECS - Amazon Elastic Container Service.

Further details about this in Slack thread https://outerbounds-community.slack.com/archives/C020U025QJK/p1647436142654879.

DanCorvesor avatar Apr 04 '22 15:04 DanCorvesor

@DanCorvesor Have you tested this on Step Functions?

savingoyal avatar Apr 13 '22 15:04 savingoyal

f-strings are not supported in Python 3.5 causing the tests to fail.

savingoyal avatar Apr 13 '22 15:04 savingoyal

@DanCorvesor Have you tested this on Step Functions?

No, we don't use Step Functions at all hence why I haven't - are you able to test this for me?

DanCorvesor avatar Apr 22 '22 16:04 DanCorvesor

Any update on this PR being merged ?

mattmcclean avatar May 15 '22 16:05 mattmcclean

Any update on this PR being merged ?

I am going to chase this today

DanCorvesor avatar May 23 '22 08:05 DanCorvesor

Testing[295] @ ef4bb023980683a98ba3a89472fc99d2ba63289c

nflx-mf-bot avatar Nov 30 '22 19:11 nflx-mf-bot

Testing[295] @ ef4bb023980683a98ba3a89472fc99d2ba63289c PASSED

nflx-mf-bot avatar Nov 30 '22 21:11 nflx-mf-bot