Would it be possible to generalize this tool?

[nfaggian]

So that you could spin up a cluster on digital ocean, vultr or linode?

[danielfrg]

It should be relatively easy to do that. All the EC2/AWS code is in dask_ec2/ec2.py (https://github.com/dask/dask-ec2/blob/master/dask_ec2/ec2.py) after that the provisioning code just needs a list of IP addresses to boostrap whats needed.

One easy way to creating nodes in other cloud providers is to use apache-libcloud which works to some degree but since it tries to be generic to a bunch of cloud providers it can be quite annoying to do some configuration of the instances (if even possible). I have used it in the past same as boto3 (that this lib uses) and decided to use boto3 because it makes it easier to do some configuration (VPC, sec groups, keypair) and its more up to date with AWS APIs.