[CARBONDATA-3193] Added support to compile carbon CDH spark distribution

[ravipesala]

Please use spark-2.2-cdh profile to compile cdh.

example:

mvn  -DskipTests -Pspark-2.2-cdh package

CDH uses twitter parquet instead of Apache Parquet so packages of the classes are different. Carbon uses parquet Dictionary interface in Spark 2.2 and below version vector integratiion with Spark. To make work for both Apache and CDH distribution , using reflection to invoke the respective packages. Note that there is no changes required for Spark 2.3 and above as Spark has opened its own interfaces for Vector and Dictionary instead of depending on Parquet.

Be sure to do all of the following checklist to help us incorporate your contribution quickly and easily:

• [ ] Any interfaces changed?

• [ ] Any backward compatibility impacted?

• [ ] Document update required?

• [ ] Testing done Please provide details on - Whether new unit test cases have been added or why no new tests are required? - How it is tested? Please attach test report. - Is it a performance related change? Please attach the performance test report. - Any additional information to help reviewers in testing this change.

• [ ] For large changes, please consider breaking it into sub-tasks under an umbrella JIRA.

[CarbonDataQA]

Build Failed with Spark 2.1.0, Please check CI http://136.243.101.176:8080/job/ApacheCarbonPRBuilder2.1/1947/

[CarbonDataQA]

Build Failed with Spark 2.3.2, Please check CI http://136.243.101.176:8080/job/carbondataprbuilder2.3/10200/

[CarbonDataQA]

Build Success with Spark 2.2.1, Please check CI http://95.216.28.178:8080/job/ApacheCarbonPRBuilder1/2156/

[CarbonDataQA]

Build Failed with Spark 2.1.0, Please check CI http://136.243.101.176:8080/job/ApacheCarbonPRBuilder2.1/1948/

[qiuchenjian]

Does carbon not support Cdh using -Pspark-2.2 ? Does CDH change the spark interface ,so that carbon can't run succesfully ?

[CarbonDataQA]

Build Failed with Spark 2.3.2, Please check CI http://136.243.101.176:8080/job/carbondataprbuilder2.3/10201/

[ravipesala]

@qiuchenjian Please check the PR description for why carbon need changes for Spark 2.2 CDH

[qiuchenjian]

@ravipesala sorry,i didn't notice it, now i know the purpose

[CarbonDataQA]

Build Success with Spark 2.2.1, Please check CI http://95.216.28.178:8080/job/ApacheCarbonPRBuilder1/2224/

[CarbonDataQA]

Build Success with Spark 2.1.0, Please check CI http://136.243.101.176:8080/job/ApacheCarbonPRBuilder2.1/2050/

[CarbonDataQA]

Build Success with Spark 2.3.2, Please check CI http://136.243.101.176:8080/job/carbondataprbuilder2.3/10302/

[CarbonDataQA]

Build Success with Spark 2.1.0, Please check CI http://136.243.101.176:8080/job/ApacheCarbonPRBuilder2.1/2139/

[CarbonDataQA]

Build Failed with Spark 2.3.2, Please check CI http://136.243.101.176:8080/job/carbondataprbuilder2.3/10393/

[CarbonDataQA]

Build Failed with Spark 2.2.1, Please check CI http://95.216.28.178:8080/job/ApacheCarbonPRBuilder1/2345/

[CarbonDataQA]

Build Success with Spark 2.2.1, Please check CI http://95.216.28.178:8080/job/ApacheCarbonPRBuilder1/2365/

[CarbonDataQA]

Build Success with Spark 2.1.0, Please check CI http://136.243.101.176:8080/job/ApacheCarbonPRBuilder2.1/2151/

[CarbonDataQA]

Build Success with Spark 2.3.2, Please check CI http://136.243.101.176:8080/job/carbondataprbuilder2.3/10406/

[CarbonDataQA]

Build Failed with Spark 2.1.0, Please check CI http://121.244.95.60:12545/job/ApacheCarbonPRBuilder2.1/38/

[CarbonDataQA]

Build Failed with Spark 2.3.2, Please check CI http://121.244.95.60:12545/job/ApacheCarbonPRBuilder2.3/37/

[CarbonDataQA2]

Build Failed with Spark 2.4.5, Please check CI http://121.244.95.60:12602/job/ApacheCarbon_PR_Builder_2.4.5/4283/

[CarbonDataQA2]

Build Failed with Spark 2.3.4, Please check CI http://121.244.95.60:12602/job/ApacheCarbonPRBuilder2.3/6028/

[CarbonDataQA2]

Build Failed with Spark 2.4.5, Please check CI http://121.244.95.60:12602/job/ApacheCarbon_PR_Builder_2.4.5/4286/