Adrian Schuepbach

IOPS improvements

1

This PR contains changes to improve the number of IOPS: - Adapt to new DaRPC API - Additional Crail benchmark to measure IOPS with multiple namenodes - Additional HDFS benchmark...

CrailBenchmark and HdfsIOBenchmark should calculate the execution time on nanoseconds instead of milliseconds (see PR 35). Example: [...] long end = System.currentTimeMillis(); double executionTime = ((double) (end - start)); double...

CrailBenchmark and HdfsIOBenchmark should use a map from testnames (command line) to test case functions (see PR 35). Example: [...] int locationClass = 0; boolean useBuffered = true; String benchmarkTypes...

Add memory pool and register memory regions only once.

2

This pull request contains changes to improve the number of IOPS: - Register memory regions only once with the RDMA NIC (save resources and time on the hardware) - Add...

Adapt code and dependencies to Spark 3.0.1

1

Adapt the plugin tp Spark 3.0. The version for Spark 2.2.0 is under a new branch spark_2_2_0 so that we can keep the newest version for the newrest Spark version...