datasophon icon indicating copy to clipboard operation
datasophon copied to clipboard

The current permissions of hive cause problems: No space available in any of the local directories

Open simao-k opened this issue 1 year ago • 2 comments

Search before asking

  • [X] I had searched in the feature and found no similar feature requirement.

Description

mapreduce.cluster.local.dir --/data/mapred/local

这个目录可以改成普通用户所属吗?每次重启完就变成root用户,导致hive走mr写入时,就报目录问题,写不了。 Error while processing statement: FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.mr.MapRedTask. No space available in any of the local directories. (state=08S01,code=1

ERROR Task:1247 - Job Submission failed with exception 'org.apache.hadoop.util.DiskChecker$DiskErrorException(No space available in any of the local directories.)' org.apache.hadoop.util.DiskChecker$DiskErrorException: No space available in any of the local directories.

每次手动chown、chmod很不友好

Usage Scenario

No response

Related issues

No response

Are you willing to submit a PR?

  • [X] Yes I am willing to submit a PR!

Code of Conduct

simao-k avatar Aug 21 '23 11:08 simao-k

Search before asking

  • [X] I had searched in the feature and found no similar feature requirement.

Description

mapreduce.cluster.local.dir --/data/mapred/local

Can this directory be changed to belong to ordinary users? After each restart, it becomes the root user, causing hive to go to mr to write, it will report a directory problem and cannot write. Error while processing statement: FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.mr.MapRedTask. No space available in any of the local directories. (state=08S01,code=1

ERROR Task:1247 - Job Submission failed with exception 'org.apache.hadoop.util.DiskChecker$DiskErrorException(No space available in any of the local directories.)' org.apache.hadoop.util.DiskChecker$DiskErrorException: No space available in any of the local directories.

Every manual chown, chmod is very unfriendly

Usage Scenario

No response

Related issues

No response

Are you willing to submit a PR?

  • [X] Yes I am willing to submit a PR!

Code of Conduct

github-actions[bot] avatar Aug 21 '23 11:08 github-actions[bot]

Are you willing to contribute this PR? I will tell you how to do it

datasophon avatar Aug 22 '23 15:08 datasophon