incubator-gluten icon indicating copy to clipboard operation
incubator-gluten copied to clipboard

[Gluten-Core] Migrate some Spark Unit Test Cases into Gluten

Open zzcclp opened this issue 2 years ago • 0 comments

Is your feature request related to a problem or challenge? Please describe what you are trying to do.

Migrate some Spark Unit Test Cases into Gluten, please refer to the detail info

  • [x] Set up Gluten-UT module to support migrating some Spark Unit Test Cases: PR #373
  • [x] Manage not supported test case in a centralized way: PR #415

Expression Test Cases:

First Phase:

  • [ ] (24) GlutenArithmeticExpressionSuite:testing + - * / ; @baibaichen
  • [ ] (5) GlutenBitwiseExpressionsSuite: testing BitwiseNOT, BitwiseAnd, BitwiseOr, BitwiseXor, BitGet, needed by join ; @baibaichen
  • [ ] (41) GlutenStringExpressionsSuite: testing string expression, Substring, concat and so on; @baibaichen
  • [ ] (67) GlutenCastSuite: testing cast; @baibaichen
  • [ ] (8) GlutenConditionalExpressionSuite: testing If, case when;
  • [ ] (58) GlutenDateExpressionsSuite: testing Date, Timestamp, Year, Month and so on; @zhouyuan
  • [ ] (4) GlutenDecimalExpressionSuite: testing decimal; @zhouyuan
  • [ ] (20) GlutenIntervalExpressionsSuite: testing interval expression; @zhouyuan
  • [ ] (33) GlutenLiteralExpressionSuite: testing Literal; @zhouyuan
  • [ ] (43) GlutenMathExpressionsSuite: testing conv, pi, cos and so on; @zhouyuan
  • [ ] (11) GlutenNullExpressionsSuite: testing isnull, isnotnull, nanvl and so on; @zhouyuan
  • [ ] (33) GlutenPredicateSuite: testing IN, INSET, BinaryComparison and so on; @zhouyuan
  • [ ] (14) GlutenRegexpExpressionsSuite: testing like, rlike, likeall, RegexReplace and so on; @zhouyuan

Second Phase:

  • [ ] (1) GlutenSortOrderExpressionsSuite: testing SortPrefix;
  • [ ] (278) GlutenAnsiCastSuite: testing ansi cast;
  • [ ] (47) GlutenCollectionExpressionsSuite: testing ArrayType, MapType and so on;
  • [ ] (19) GlutenComplexTypeSuite: testing GetArrayItem, GetStructField, GetArrayStructFields;
  • [ ] (31) GlutenHashExpressionsSuite: testing md5, sha1, sha2;
  • [ ] (3) GlutenMiscExpressionsSuite: testing uuid, PrintToStderr;
  • [ ] (3) GlutenNondeterministicSuite: testing SPARK_PARTITION_ID;
  • [ ] (3) GlutenRandomSuite: testing random;

DataFrameXXXSuite Test Cases:

First Phase:

  • [ ] #450
  • [ ] (19) GlutenDataFrameJoinSuite: testing join; @binmahone
  • [ ] (144) GlutenColumnExpressionSuite: testing column expression;
  • [ ] (105) GlutenDataFrameFunctionsSuite: testing functions; @binmahone
  • [ ] (19) GlutenDataFrameSelfJoinSuite: testing self join; @binmahone
  • [ ] (27) GlutenDataFrameNaFunctionsSuite: testing na function;
  • [ ] (190) GlutenDataFrameSuite: testing DataFrame;
  • [ ] (41) GlutenDateFunctionsSuite: testing date function;
  • [ ] (1) GlutenIntervalFunctionsSuite: testing extract;
  • [ ] (32) GlutenDynamicPartitionPruningV1SuiteAEOff: testing DPP with non-AQE DS V1; @zzcclp
  • [ ] (34) GlutenDynamicPartitionPruningV1SuiteAEOn: testing DPP with AQE and DS V1; @zzcclp
  • [ ] (31) GlutenDynamicPartitionPruningV2SuiteAEOff: testing DPP with non-AQE and DS V2; @zzcclp
  • [ ] (31) GlutenDynamicPartitionPruningV2SuiteAEOn: testing DPP with AQE and DS V2; @zzcclp
  • [ ] (35) GlutenJoinSuite: testing join;
  • [ ] (47) GlutenMathFunctionsSuite: testing math functions;
  • [ ] (35) GlutenStringFunctionsSuite: testing concat, concat_ws, elt and so on;
  • [ ] (79) GlutenSubquerySuite: testing subquery;

Second Phase:

  • [ ] (21) GlutenDataFrameWindowFramesSuite: testing lead, lag and so on;
  • [ ] (38) GlutenDataFrameWindowFunctionsSuite: testing rank, corr and so on;
  • [ ] (6) GlutenDataFrameTungstenSuite;
  • [ ] (31) GlutenDataFramePivotSuite: testing pivot;
  • [ ] (35) GlutenDataFrameSetOperationsSuite: testing except;
  • [ ] (22) GlutenDataFrameStatSuite: testing sample, stat;
  • [ ] (5) GlutenComplexTypesSuite: testing complex type;
  • [ ] (7) GlutenDataFrameComplexTypeSuite: testing UDF with complex type;
  • [ ] (16) GlutenApproximatePercentileQuerySuite: testing percentile;
  • [ ] (6) GlutenDataFrameImplicitsSuite: testing SerializeFromObject;
  • [ ] (8) GlutenDataFrameRangeSuite: testing range;
  • [ ] (17) GlutenDataFrameSessionWindowingSuite: testing session window;
  • [ ] (20) GlutenDataFrameTimeWindowingSuite: testing time window;
  • [ ] (28) GlutenGeneratorFunctionSuite: testing stack, explode and so on;

Describe the solution you'd like A clear and concise description of what you want to happen.

Describe alternatives you've considered A clear and concise description of any alternative solutions or features you've considered.

Additional context Add any other context or screenshots about the feature request here.

zzcclp avatar Sep 15 '22 03:09 zzcclp