Jack Kelly

Ideas from Jon Gjenset's talk "Towards Impeccable Rust" at Rust Nation UK 2024 on Wednesday 27th March 2024: > Know thyself > Benchmarks should capture the entire performance profile That...

Allow users to use LSIO with cloud storage buckets. ## Related - #10

Python API: Get numpy array back to Python (after passing filename to Rust)

1

Xref: #3, #4

Use GitHub actions to automatically create & publish to PyPI

2

https://github.com/PyO3/maturin-action

The [manual for `read`](https://man7.org/linux/man-pages/man2/read.2.html) says: > On success, the number of bytes read is returned (zero indicates end of file), and the file position is advanced by this number. It...

On Linux, `read` will transfer at most 2,147,479,552 bytes (even on 64-bit systems). See [the manual for read](https://man7.org/linux/man-pages/man2/read.2.html). LSIO should automatically split large reads into multiple smaller reads. ## Related...

Performance tracking issue (reading from a local SSD)

6

Ultimate aim: perform at least as well as `fio` when reading from a local SSD :slightly_smiling_face:. ## Tools - [Criterion.rs](https://bheisler.github.io/criterion.rs/book/criterion_rs.html): "a statistics-driven micro-benchmarking tool". Of relevance for light-speed-io, Criterion can...

- [ ] #41 - [ ] Submit "get filesize" & "open" entries in parallel - [ ] When "get filesize" CQE arrives, allocate buffer, and check for FD. If...

Follows on from #51

Register buffers

1

In summary: io_uring allows users to register buffers. The max size per buffer is 1 GiB. Read operations can read into _part_ of a large buffer. So I think that,...