ffs
ffs copied to clipboard
mgree
the file filesystem: mount semi-structured data (like JSON) as a Unix filesystem
$> touch x.json $> ffs x.son thread 'main' panicked at 'JSON: Error("EOF while parsing a value", line: 1, column: 0)', src/format.rs:187:53 note: run with `RUST_BACKTRACE=1` environment variable to display a...
An idea from @angelhof: notice directories where every file has numerical name suffixes (e.g., `role0`, `role1`, or simpliciter `0`, `1`, `2`, ...) and automatically treat them as lists. The best...
https://twitter.com/laurencetratt/status/1451198313085030407 seems to indicate a way forward. OO!
On a malformed JSON file: ``` : mgree@rocinante:~/talks/20211025plos [master] ; ~/ffs/target/release/ffs -i demo.json thread 'main' panicked at 'JSON: Error("expected value", line: 7, column: 12)', src/format.rs:322:45 note: run with `RUST_BACKTRACE=1` environment...
For example [i3blocks] supports multiple signals which you can trigger using `pkill -SIGRTMIN+10 i3blocks`, which then causes an action. Could you add atleast two signals, one for re-reading INPUT file...
Just load/unload data directly on the filesystem. Progress indicator. https://docs.rs/indicatif/0.16.2/indicatif/ Multithreading? (Is that ever a performance win?) # Pack BFS? # Unpack Flag to follow symlinks, possibly even out of...
Timing: use https://crates.io/crates/tracing-timing? Microbenchmarks - read - write Macrobenchmarks - tasks? Compare against - FS (various hdd configs) as baseline - ramdisk as memory FS baseline - jq - js...
We have a lot of `sleep` calls that could be faster. Write a tool to detect when a mount is ready. (Current benchmarks do this by busy looping on `umount`.)...
When running on the [citylots JSON file](https://github.com/zemirco/sf-city-lots-json/), parsing takes a long, long time. Way longer than I expected---since I was told to ["expect in the ballpark of 500 to 1000...
~Lazy loading (scan but don't parse into structures until demanded).~ #50 Ahead-of-time mappings (literally build/unbuild FS). Use 9p, per [Jay McCarthy](http://www.weaselhat.com/2021/06/29/processing-semi-structured-data-in-the-unix-shell/#comment-187595). Or use the Bento FS thing?