clustershell
clustershell copied to clipboard
cea-hpc
Scalable cluster administration Python framework — Manage node sets, node groups and execute commands on cluster nodes in parallel.
I agree with this statement: "I think default verbosity should be set to warning or error. And we should consider using syslog instead of flat file by default."
In order to improve API and Task code, it could be nice to have support for multiple handlers per workers. This could be simply done using an event handler list...
In 1.8, the `NodeSet` class does only recognize the "," separator for node/nodeset that also implictly means "union set". We should probably support other separators for convenience, like space, tab...
``` [routes] sh-hn01: @service @sherlock:1&@service: @sherlock:1&@compute @sherlock:2&@service: @sherlock:2&@compute ``` results in: ``` clush: Unknown group source: "service" ``` Quotes don't help: ``` [routes] "sh-hn01": "@service" "@sherlock:1&@service": "@sherlock:1&@compute" "@sherlock:2&@service": "@sherlock:2&@compute" ```...
Currently, there is a mismatch between the API (eg. local/distant worker selection) and the options offered by clush. It's not great. The API could be improved for a better worker...
support password-based authentication for initial connection to nodes
It could be useful to support different connection options for GWs than for end points. Example: large clusters with GWs, where the hierarchical setup is beneficial, but where one does...
clustershell is great!!! thanks for sharing such good project. I have a calculation task, which only read data from file, calculate, then dump out calculate result into output file. multi-threading...
It will be very interesting to set environment variables which could be set by task or worker. ``` python # Set environment variable vars = { 'PATH': "...", 'LD_LIBRARY_PATH': "..."...
Hi. I found idea in this blog post may be useful in clush: https://rachelbythebay.com/w/2020/10/26/num/ Would you be open to a pull request that adds a configurable confirmation like described in...
