clustershell
clustershell copied to clipboard
real-time interaction mess up?
clustershell is great!!! thanks for sharing such good project.
I have a calculation task, which only read data from file, calculate, then dump out calculate result into output file.
multi-threading failed to speed up, because some cache miss problems( i am not sure now, but it's complex)
I use clustershell to speed up.
I have three machine, so I assign tasks into three part.
clush -a -b -v "./run run_config.cfg"; // run the c++ binary
clush -rc run_result/ --dest my_dir // collect calculate result back
I have two questions:
- my
./run
will print some message during the running progress. it use some flush method, but after typingclush
, it mess up(not flush my screen, just print lines one by one), can i get same result??? - i need to seperate
run_config.cfg
into three part manually, is there any better command i can use??
- if you remove the -b clush will not aggregate output (you can also try -bL for "live gathering")
- You can use the remote hostname within the command, e.g. clush -a './run config_$HOSTNAME.cfg' will run a different config for each node