plotng icon indicating copy to clipboard operation
plotng copied to clipboard

madmax don't wait for copy before continuing?

Open markkundinger opened this issue 3 years ago • 11 comments

madmax has the option -w, --waitforcopy

I don't see a way to pass that option in plotng?

Right now in the madmax windows port it looks like it's waiting for the copy to finish before starting again. and that is effectively a penalty of 10 or 20 minutes in my case when copying across network.

markkundinger avatar Jul 09 '21 22:07 markkundinger

unfortunately, that option is only for when using madmax in standalone mode to generate multiple plots

maded2 avatar Jul 10 '21 00:07 maded2

so is there any way to implement this copying thing ? because right now its not starting new plot until the existing plot is copied. It should behave as default madmax which keeps plotting and copying simultaneously

sochkumar avatar Jul 11 '21 14:07 sochkumar

I personally uses a local disk for staging the finished plots and then a script rsync it to the farmer. In your case you can do the same to your NAS. This means that the madmax plotter will not need to do wait.

maded2 avatar Jul 12 '21 05:07 maded2

That's unfortunate. In my case it's a 70 minute plot and a 15 minute copy. That's a signicant slowdown on a percentage basis and I'd rather just run madmax naked.

In theory maybe I could set my destination drive to the same as my temp for instant copy (?) But I'm not smart enough to script a copy to my nas.

Plotng works by triggering one madmax plot at a time right? That could be tricky to refactor...

What is there was an option to tweak when plotng thinks max is "done"? Instead of waiting till the copy is finished, wait until all passes are complete, let max begin the copy, and then launch a new instance. So they'd technically be running in parallel but only until the copy is done. ?

markkundinger avatar Jul 12 '21 17:07 markkundinger

In this pull request, I added an option that allows you to start the next plot without waiting for the previous one.

graid2030 avatar Jul 13 '21 21:07 graid2030

In this pull request, I added an option that allows you to start the next plot without waiting for the previous one.

have you implemented tmp2 directory thing for madmax like in actual plotng ? can't see that in your config

sochkumar avatar Jul 14 '21 02:07 sochkumar

In this pull request, I added an option that allows you to start the next plot without waiting for the previous one.

have you implemented tmp2 directory thing for madmax like in actual plotng ? can't see that in your config

tmp2 support is already in the PlotNG. But currently it only support single tmp2 directory. I am assuming not many people have the ram to have 2 of them.

maded2 avatar Jul 14 '21 03:07 maded2

yes but AsyncCopy which the other user (graid2030) did in his PR is not there in main branch. Is it possible to merge into main or have this option incorporated ? background copying while starting new plot is very important or else its really waste of time to wait for the copy to finish and start new plot after that

sochkumar avatar Jul 14 '21 03:07 sochkumar

Anyone on this ?

sochkumar avatar Jul 15 '21 14:07 sochkumar

will try to reviews the changes this weekend

maded2 avatar Jul 15 '21 16:07 maded2

Thanks

sochkumar avatar Jul 15 '21 19:07 sochkumar