Imran Rashid

nothing major here. just some suggestions, you don't need to like them all :). I broke it up into a few commits, might be easier to look at one commit...

add util to print benchmark runs to tsv file

1

I love how complete the analysis of Distribution is, but sometimes I just want to export the runtimes to pull into an external tool, eg. for making a boxplot with...

Utility function to get a setup & cleanup function for mapping each partition

17

Often when mapping some RDD, you want to do a bit of setup before processing each partition, followed by cleanup at the end of the partition; this adds utility functions...

Regularly poll executors to track their utilization

8

This isn't ready to be merged yet (needs tests & docs), but wanted to get some feedback. The point of this PR is to provide a really high-level metric on...