carbondata icon indicating copy to clipboard operation
carbondata copied to clipboard

[CARBONDATA-4176] Fail to achive AK/SK when create table on S3/OBS

Open marchpure opened this issue 3 years ago • 3 comments

Why is this PR needed?

Due to the failure to obtain aksk, create table operation failed.

What changes were proposed in this PR?

Change "session.sparkContext.hadoopConfiguration" to "session.sessionState.newHadoopConf()"

Does this PR introduce any user interface change?

  • No

Is any new testcase added?

  • No

marchpure avatar Apr 28 '21 07:04 marchpure

Build Success with Spark 2.4.5, Please check CI http://121.244.95.60:12602/job/ApacheCarbon_PR_Builder_2.4.5/3538/

CarbonDataQA2 avatar Apr 28 '21 08:04 CarbonDataQA2

Build Success with Spark 2.3.4, Please check CI http://121.244.95.60:12602/job/ApacheCarbonPRBuilder2.3/5283/

CarbonDataQA2 avatar Apr 28 '21 08:04 CarbonDataQA2

@marchpure : changes looks ok, but can you describe more about the issue? many users are already creating table in S3/OBS successfully but we didn't faced this problem. How AK SK is working for them ?

ajantha-bhat avatar Apr 29 '21 10:04 ajantha-bhat