Tom White

> I've filed Dask issues for some of these errors: [dask/dask#8667](https://github.com/dask/dask/issues/8667), [dask/dask#8668](https://github.com/dask/dask/issues/8668), [dask/dask#8669](https://github.com/dask/dask/issues/8669), [dask/dask#8670](https://github.com/dask/dask/issues/8670). With these fixes the number of unexpected failures is now down to 11: https://github.com/tomwhite/dask/runs/5142135752?check_suite_focus=true. Most of...

Thanks @honno and @jakirkham!

I've opened https://github.com/dask/dask/pull/8750 to provide the Dask implementation. Comments very welcome.

Thanks @GenevieveBuckley. Having a list of released versions that are blessed by virtue of seeming to be fairly stable only partly solves the problem. Ideally there would be a stable...

> So, can we have a policy of "don't make non-blessed releases in the same month as a blessed release" and solve everyones problems? You can't declare a release blessed...

There are a couple of options: 1. Set dfs.permissions.enabled to false, so that permission checking is disabled. 2. Enable the LinuxContainerExecutor so that containers run as the user that submitted...

I think this is ready to review. @laserson can you have a look please? I have run this successfully locally, and on EC2 I generated flat data after using the...

Thanks for the pointer Frank. I tried it, but it doesn't start the Hadoop cluster daemons correctly, so I need to debug a bit more.

I didn't have much luck with the MR2 installation on EC2, as it's using an old version. I'm looking into https://github.com/bigdatagenomics/eggo/issues/44 to improve the cluster experience, so I won't commit...

This looks good to me. It might be helpful to add a file in test/registry to make it easy to try out on a single file from CGHub.