amuse icon indicating copy to clipboard operation
amuse copied to clipboard

Containerized workers

Open ipelupessy opened this issue 6 years ago • 1 comments

Is your feature request related to a problem? Please describe. basically its a solution to the "you need to be able to compile and have all the prerequisites" for code packages

Describe the solution you'd like it would be good to have the build system for community codes have the option to generate the worker inside a container (docker/ singularity/ ..). This would allow a package install w/o compile, pulling instead a containerized executable from an online repository (most container frameworks have such repos)..

Note that the changes in the framework to start an wrapped executable are limited, since the docker images can be made executable with proper forwarding of command line flags..

Note that this probably works best with socket channel..MPI is something to be researched..

Describe alternatives you've considered

this is somewhat related to #215 - however this wraps the whole AMUSE installation in a container..

Additional context

HyMUSE has the option to use BMI wrapped codes natively or through a docker container. Note that a major difference with the wrapped BMI is the fact that these are supposed to conform to the same interface...

ipelupessy avatar Jan 16 '20 13:01 ipelupessy

It sounds like it would be a useful feature, but I don't see this working with MPI tbh. If that could work, I would be more interested in adding this.

rieder avatar Feb 04 '20 15:02 rieder