plotman icon indicating copy to clipboard operation
plotman copied to clipboard

adjust 'free space' thresholds on dst and archives.

Open syadnom opened this issue 3 years ago • 4 comments

I'm seeing some contention with multiple plotters and shared storage.

I would like to be able to set an amount of free space to leave on a given destination or archive location.

Ie, dst: - /path keepfree:375G

dst AND archive please :)

syadnom avatar May 22 '21 02:05 syadnom

I second this, especially when not using archiving.

Gu1Ka avatar May 24 '21 15:05 Gu1Ka

There are a few pieces here. I don't mind leaving this as-is if we can get some code in mainline to have tmp and dst the same (ie, no extra copy) and then I'll using archive to move it to local folders. That's fine w/ me

syadnom avatar May 24 '21 16:05 syadnom

There are a few pieces here. I don't mind leaving this as-is if we can get some code in mainline to have tmp and dst the same (ie, no extra copy) and then I'll using archive to move it to local folders. That's fine w/ me

If dst is the same as tmp, there is no extra copy. It is a rename: https://github.com/Chia-Network/chiapos/blob/632c9d70e865f2fdb92c47e4ed3380b5bf92947e/src/plotter_disk.hpp#L373

Now, with plotman there is an issue if you have multiple tmp. There is a PR (not sure if merged into development yet) where you just don't specify dst to ensure the final plot never moves out of tmp. Maybe this was the scenario you were referring to?

randellhodges avatar May 24 '21 18:05 randellhodges

yes, exactly. I want to keep the dst on the same drive it was plotted on and then move it off via archive. for example.

I'm working around this with aufs. I'm using create=mfs ie new files to the device with the most free space. I put all my destination directories in this aufs mount and it handles distributing the files evenly. Then I'm putting just that one aufs mount as dst in plotman. Works great actually. I can also update the mount point via script so if I add a drive I put a folder on it calls 'plots' and my script runs in cron every minute searching the mountpoints for 'plots' and if it finds one it updates aufs.

Downside is I don't see what's happening in plotman interactive.. oh well.

syadnom avatar May 24 '21 21:05 syadnom