hyperqueue
hyperqueue copied to clipboard
Create overhead benchmark
Benchmark HyperQueue and other related tools with a simple benchmark that measures the overhead of the system.
The benchmark should run 10k, 100k, 1 million tasks that "do nothing" (sleep 0, echo, hostname) etc. on an HPC cluster. The benchmark should not output any stdout/stderr files if possible.
Tools to benchmark:
- [ ] HyperQueue
- [ ] #105
- [ ] #106
The experiment can be performed on Barbora or Karolina.
Measure overhead of HQ so far:
- Barbora/Karolina - 1ms
- Notebook - 0.1ms
Overhead on IT4I clusters is caused by old GLIBC and slow fork (https://github.com/rust-lang/rust/issues/87764).