Tony Hutter

zed: Fix config_sync autoexpand flood

1

### Motivation and Context Fixes: #7132 #7366 ### Description Users were seeing floods of `config_sync` events when autoexpand was enabled. This happened because all "disk status change" udev events invoke...

Design: Use busybox as the UnifyFS shell

4

In light of the https://github.com/LLNL/UnifyFS/pull/425, I wanted to offer an alternative idea for a UnifyFS shell. I'd like to propose building busybox (https://en.wikipedia.org/wiki/BusyBox) against UnifyFS and using that as our...

### System information Type | Version/Name --- | --- Operating System | TOSS (RHEL 7) OS Version | 7.5 Architecture | x86_64 UnifyFS Version | dev ### Describe the problem...

Design: should fflush() sync extents (it currently doesn't)

2

### System information Type | Version/Name --- | --- Operating System | all OS Version | all Architecture | all UnifyFS Version | all ### Describe the problem you're observing...

Design: Lamination while file is being written

11

### Describe the problem you're observing Lets you have two nodes writing 100MB to a file at non-overlapping offsets. Node 1 finishes writing and does a laminate while node 2...

Design: Should laminating a file sync its extents?

2

Currently, UnifyFS requires you to fsync() your extents before laminating the file: ``` fp = fopen("checkpoint1.chk") write(fp, ) … fsync(fp) fclose(fp) chmod("checkpoint1.chk", 0444) /* laminate */ ``` Should a laminate...

### System information Type | Version/Name --- | --- Operating System | Fedora OS Version | 30 Architecture | x86-64 UnifyCR Version | dev ### Describe the problem you're observing...

Additional testing using pthreads and BBAPI

46

@kathrynmohror and @adammoody have identified some additional things we should test/verify with SCR: - Test using AXL with pthreads to transfer checkpoints. Does it work correctly? Do we need to...

SCR compression

1

We should consider adding compression in SCR. We mention wanting to do it in https://computing.llnl.gov/projects/scalable-checkpoint-restart-for-mpi and in src/scr_io.c: ```C /* TODO: could perhaps use O_DIRECT here as an optimization */...

Optimization: starting a BB API checkpoint copy at the end of an allocation

1

Just wanted to capture something discussed in the SCR meeting today: @adammoody mentioned that it would be nice if we could begin copying a checkpoint at the end of a...