smcmullan-ncirl

> It seems to be a small probability event I'm finding the issue to be quite easy to reproduce. I have a 2 node Spark cluster with 3 executors per...

> > > It seems to be a small probability event > > @smcmullan-ncirl I wonder if there will be such a high frequency of failures when using Scala 2.12?...

Thanks for all the analysis and effort. I think what @JoshRosen is describing in the last paragraph of his analysis is exactly what my application is doing. I have a...

Hi, yes and no. I produced this toy example of what I thought my production code is doing: https://github.com/smcmullan-ncirl/RateSourceSparkStreamTest However it seems to work fine and has not reproduced the...

Hi, so I was able to reproduce the issue with the example application below. It shows an custom ForEach sink which updates a set of Accumulators. The Map containing the...

@LuciferYang - does the above make any sense? Do you need any more information from me?