pangeo-example-notebooks icon indicating copy to clipboard operation
pangeo-example-notebooks copied to clipboard

Published 20 hours ago • verified publisher icon pangeo-data

Add adaptive example of a Monte Carlo estimate

Open willirath opened this issue 6 years ago • 2 comments

This adds a notebook with a Monte-Carlo estimate of the number pi. It also shows how to tune Adaptive to smoothly auto-scale the cluster to approximately match a given execution time of 20 seconds over a huge range of precisions.

willirath avatar Oct 12 '18 17:10 willirath

Counting pods from the list of pods is not what we want. I'll switch to len() of the list of workers instead. Or is there any public API call for: "How not is the cluster atm?"

willirath avatar Oct 30 '18 17:10 willirath

Thanks @guillaumeeb for this review!

I just committed a more verbose version that now (briefly) outlines the method and has more details on why it matters that we can scale the cluster to meet a desired target duration over a wide range of problem sizes.

willirath avatar Nov 05 '18 09:11 willirath