clustershell icon indicating copy to clipboard operation
clustershell copied to clipboard

real-time interaction mess up?

Open nickhuangxinyu opened this issue 2 years ago • 1 comments

clustershell is great!!! thanks for sharing such good project.

I have a calculation task, which only read data from file, calculate, then dump out calculate result into output file.

multi-threading failed to speed up, because some cache miss problems( i am not sure now, but it's complex)

I use clustershell to speed up.

I have three machine, so I assign tasks into three part.

clush -a -b -v "./run run_config.cfg"; // run the c++ binary
clush -rc  run_result/ --dest my_dir // collect calculate result back

I have two questions:

  1. my ./run will print some message during the running progress. it use some flush method, but after typing clush, it mess up(not flush my screen, just print lines one by one), can i get same result???
  2. i need to seperaterun_config.cfginto three part manually, is there any better command i can use??

nickhuangxinyu avatar Dec 31 '21 07:12 nickhuangxinyu

  1. if you remove the -b clush will not aggregate output (you can also try -bL for "live gathering")
  2. You can use the remote hostname within the command, e.g. clush -a './run config_$HOSTNAME.cfg' will run a different config for each node

martinetd avatar Jan 01 '22 23:01 martinetd