terraform-aws-metaflow icon indicating copy to clipboard operation
terraform-aws-metaflow copied to clipboard
verified publisher icon outerbounds

Adding support for spot instances

Open wrbooth opened this issue 3 years ago • 1 comments

Changed the following to allow for spot instance support:

  • added ec2_spot and fargate_spot to batch_type variable
  • added a splotfleet iam role (generated when a spot batch_type is selected)
  • refactored compute environment type selection

Tested on my own environment via ec2_spot. I did not test fargate_spot.

Testing Screenshots

Functioning compute environment

Screen Shot 2023-03-21 at 8 56 10 PM

Successful Metaflow run on spot ec2 instances

Screen Shot 2023-03-21 at 8 57 07 PM

wrbooth avatar Mar 22 '23 04:03 wrbooth

Hi there, what's the status of this PR? I'm also looking for spot instances support (fargate_spot in my case). Is there anything I can do to speed this up?

dkarlo2 avatar Aug 30 '23 19:08 dkarlo2