terraform-provider-iterative icon indicating copy to clipboard operation
terraform-provider-iterative copied to clipboard

πŸ“š Epic: TPI hot instance or pool of instances for a single user

Open dmpetrov opened this issue 2 years ago β€’ 3 comments

The same as https://github.com/iterative/terraform-provider-iterative/issues/208 but a single instance is instantiating in the beginning and reusable in multiple runs.

New steps:

  • a user run instances (or a single one) before submitting a training job
  • when the user kicks off a train it runs on one of free instances

Details:

  • user is responsible for creating and terminating instances
  • consider using k8s or Nomad as an orchestrator while keeping the experience dead simple for users
  • this scenario does not include multiple users use cease

dmpetrov avatar Sep 13 '21 06:09 dmpetrov

Very interesting use case! This reminds me of course a CI runner.

Just curiosity, has been this feature requested by the companies that you talk to? I think that this feature is useful for very fast experimenting.

DavidGOrtega avatar Sep 13 '21 07:09 DavidGOrtega

Sounds like Kubernetes ☸️

0x2b3bfa0 avatar Feb 11 '22 11:02 0x2b3bfa0

Sounds like Kubernetes ☸️

To me sounds more like a task orchestrator

DavidGOrtega avatar Feb 14 '22 15:02 DavidGOrtega