incubator-gluten
incubator-gluten copied to clipboard
[Gluten-Core] Migrate some Spark Unit Test Cases into Gluten
Is your feature request related to a problem or challenge? Please describe what you are trying to do.
Migrate some Spark Unit Test Cases into Gluten, please refer to the detail info
- [x] Set up Gluten-UT module to support migrating some Spark Unit Test Cases: PR #373
- [x] Manage not supported test case in a centralized way: PR #415
Expression Test Cases:
First Phase:
- [ ] (24) GlutenArithmeticExpressionSuite:testing
+ - * /
; @baibaichen - [ ] (5) GlutenBitwiseExpressionsSuite: testing BitwiseNOT, BitwiseAnd, BitwiseOr, BitwiseXor, BitGet, needed by join ; @baibaichen
- [ ] (41) GlutenStringExpressionsSuite: testing string expression, Substring, concat and so on; @baibaichen
- [ ] (67) GlutenCastSuite: testing cast; @baibaichen
- [ ] (8) GlutenConditionalExpressionSuite: testing If, case when;
- [ ] (58) GlutenDateExpressionsSuite: testing Date, Timestamp, Year, Month and so on; @zhouyuan
- [ ] (4) GlutenDecimalExpressionSuite: testing decimal; @zhouyuan
- [ ] (20) GlutenIntervalExpressionsSuite: testing interval expression; @zhouyuan
- [ ] (33) GlutenLiteralExpressionSuite: testing Literal; @zhouyuan
- [ ] (43) GlutenMathExpressionsSuite: testing conv, pi, cos and so on; @zhouyuan
- [ ] (11) GlutenNullExpressionsSuite: testing isnull, isnotnull, nanvl and so on; @zhouyuan
- [ ] (33) GlutenPredicateSuite: testing IN, INSET, BinaryComparison and so on; @zhouyuan
- [ ] (14) GlutenRegexpExpressionsSuite: testing like, rlike, likeall, RegexReplace and so on; @zhouyuan
Second Phase:
- [ ] (1) GlutenSortOrderExpressionsSuite: testing SortPrefix;
- [ ] (278) GlutenAnsiCastSuite: testing ansi cast;
- [ ] (47) GlutenCollectionExpressionsSuite: testing ArrayType, MapType and so on;
- [ ] (19) GlutenComplexTypeSuite: testing GetArrayItem, GetStructField, GetArrayStructFields;
- [ ] (31) GlutenHashExpressionsSuite: testing md5, sha1, sha2;
- [ ] (3) GlutenMiscExpressionsSuite: testing uuid, PrintToStderr;
- [ ] (3) GlutenNondeterministicSuite: testing SPARK_PARTITION_ID;
- [ ] (3) GlutenRandomSuite: testing random;
DataFrameXXXSuite Test Cases:
First Phase:
- [ ] #450
- [ ] (19) GlutenDataFrameJoinSuite: testing join; @binmahone
- [ ] (144) GlutenColumnExpressionSuite: testing column expression;
- [ ] (105) GlutenDataFrameFunctionsSuite: testing functions; @binmahone
- [ ] (19) GlutenDataFrameSelfJoinSuite: testing self join; @binmahone
- [ ] (27) GlutenDataFrameNaFunctionsSuite: testing na function;
- [ ] (190) GlutenDataFrameSuite: testing DataFrame;
- [ ] (41) GlutenDateFunctionsSuite: testing date function;
- [ ] (1) GlutenIntervalFunctionsSuite: testing extract;
- [ ] (32) GlutenDynamicPartitionPruningV1SuiteAEOff: testing DPP with non-AQE DS V1; @zzcclp
- [ ] (34) GlutenDynamicPartitionPruningV1SuiteAEOn: testing DPP with AQE and DS V1; @zzcclp
- [ ] (31) GlutenDynamicPartitionPruningV2SuiteAEOff: testing DPP with non-AQE and DS V2; @zzcclp
- [ ] (31) GlutenDynamicPartitionPruningV2SuiteAEOn: testing DPP with AQE and DS V2; @zzcclp
- [ ] (35) GlutenJoinSuite: testing join;
- [ ] (47) GlutenMathFunctionsSuite: testing math functions;
- [ ] (35) GlutenStringFunctionsSuite: testing concat, concat_ws, elt and so on;
- [ ] (79) GlutenSubquerySuite: testing subquery;
Second Phase:
- [ ] (21) GlutenDataFrameWindowFramesSuite: testing lead, lag and so on;
- [ ] (38) GlutenDataFrameWindowFunctionsSuite: testing rank, corr and so on;
- [ ] (6) GlutenDataFrameTungstenSuite;
- [ ] (31) GlutenDataFramePivotSuite: testing pivot;
- [ ] (35) GlutenDataFrameSetOperationsSuite: testing except;
- [ ] (22) GlutenDataFrameStatSuite: testing sample, stat;
- [ ] (5) GlutenComplexTypesSuite: testing complex type;
- [ ] (7) GlutenDataFrameComplexTypeSuite: testing UDF with complex type;
- [ ] (16) GlutenApproximatePercentileQuerySuite: testing percentile;
- [ ] (6) GlutenDataFrameImplicitsSuite: testing SerializeFromObject;
- [ ] (8) GlutenDataFrameRangeSuite: testing range;
- [ ] (17) GlutenDataFrameSessionWindowingSuite: testing session window;
- [ ] (20) GlutenDataFrameTimeWindowingSuite: testing time window;
- [ ] (28) GlutenGeneratorFunctionSuite: testing stack, explode and so on;
Describe the solution you'd like A clear and concise description of what you want to happen.
Describe alternatives you've considered A clear and concise description of any alternative solutions or features you've considered.
Additional context Add any other context or screenshots about the feature request here.