incubator-uniffle icon indicating copy to clipboard operation
incubator-uniffle copied to clipboard

[Improvement] Add a integration test case for Spark with MiniYarnCluster

Open jerqi opened this issue 3 years ago • 2 comments

We use Spark local mode to write integration test, but we can't cover some cases, such as https://github.com/Tencent/Firestorm/pull/187, so we should add a integration test case for Spark with MiniYarnCluster

jerqi avatar Aug 06 '22 03:08 jerqi

Oh, the bug of https://github.com/Tencent/Firestorm/pull/187 is caused by me.

Maybe I can take this ticket, could u help assign this to me?

zuston avatar Aug 07 '22 02:08 zuston

Thanks.

jerqi avatar Aug 07 '22 03:08 jerqi

Hello, can I have a try on this issue?

selectbook avatar Oct 22 '22 14:10 selectbook

Feel free to take it. Assign to you.

zuston avatar Oct 22 '22 14:10 zuston

@selectbook You can imitate https://github.com/apache/incubator-uniffle/blob/master/integration-test/mr/src/test/java/org/apache/uniffle/test/MRIntegrationTestBase.java, it's enough to run a WordCount test.

jerqi avatar Oct 27 '22 08:10 jerqi

thanks, I will try to finish it in these days

selectbook avatar Oct 28 '22 02:10 selectbook