hyperqueue icon indicating copy to clipboard operation
hyperqueue copied to clipboard

Create overhead benchmark

Open Kobzol opened this issue 4 years ago • 1 comments

Benchmark HyperQueue and other related tools with a simple benchmark that measures the overhead of the system. The benchmark should run 10k, 100k, 1 million tasks that "do nothing" (sleep 0, echo, hostname) etc. on an HPC cluster. The benchmark should not output any stdout/stderr files if possible.

Tools to benchmark:

  • [ ] HyperQueue
  • [ ] #105
  • [ ] #106

The experiment can be performed on Barbora or Karolina.

Kobzol avatar Aug 03 '21 11:08 Kobzol

Measure overhead of HQ so far:

  • Barbora/Karolina - 1ms
  • Notebook - 0.1ms

Overhead on IT4I clusters is caused by old GLIBC and slow fork (https://github.com/rust-lang/rust/issues/87764).

Kobzol avatar Aug 03 '21 11:08 Kobzol