datasophon
datasophon copied to clipboard
The current permissions of hive cause problems: No space available in any of the local directories
Search before asking
- [X] I had searched in the feature and found no similar feature requirement.
Description
mapreduce.cluster.local.dir --/data/mapred/local
这个目录可以改成普通用户所属吗?每次重启完就变成root用户,导致hive走mr写入时,就报目录问题,写不了。 Error while processing statement: FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.mr.MapRedTask. No space available in any of the local directories. (state=08S01,code=1
ERROR Task:1247 - Job Submission failed with exception 'org.apache.hadoop.util.DiskChecker$DiskErrorException(No space available in any of the local directories.)' org.apache.hadoop.util.DiskChecker$DiskErrorException: No space available in any of the local directories.
每次手动chown、chmod很不友好
Usage Scenario
No response
Related issues
No response
Are you willing to submit a PR?
- [X] Yes I am willing to submit a PR!
Code of Conduct
- [X] I agree to follow this project's Code of Conduct
Search before asking
- [X] I had searched in the feature and found no similar feature requirement.
Description
mapreduce.cluster.local.dir --/data/mapred/local
Can this directory be changed to belong to ordinary users? After each restart, it becomes the root user, causing hive to go to mr to write, it will report a directory problem and cannot write. Error while processing statement: FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.mr.MapRedTask. No space available in any of the local directories. (state=08S01,code=1
ERROR Task:1247 - Job Submission failed with exception 'org.apache.hadoop.util.DiskChecker$DiskErrorException(No space available in any of the local directories.)' org.apache.hadoop.util.DiskChecker$DiskErrorException: No space available in any of the local directories.
Every manual chown, chmod is very unfriendly
Usage Scenario
No response
Related issues
No response
Are you willing to submit a PR?
- [X] Yes I am willing to submit a PR!
Code of Conduct
- [X] I agree to follow this project's Code of Conduct
Are you willing to contribute this PR? I will tell you how to do it