Leveraging the full power of Lambda with Parallel execution - Pywren post

[DavidWells]

Post is WIP. Contributions welcome!

Eric Jonas creator of pywren talks about how they use Lambda for parallel processing data science jobs (one of the most interesting use cases IMO)

Video: https://youtu.be/OskQytBBdJU?t=13m11s

Resources

https://blog.sungardas.com/CTOLabs/2016/02/aws-lambda-invasion-in-big-data/ http://tothestars.io/blog/2016/11/2/serverless-mapreduce https://blog.seanssmith.com/posts/pywren-web-scraping.html https://twitter.com/seanwssmith/status/851134826354802694