Created on 09-05-2014 12:10 PM - edited 09-16-2022 02:06 AM
I were tying to follow the example (http://blog.cloudera.com/blog/2012/09/automating-your-cluster-with-cloudera-manager-api/) to create and start MR service.
The task tracker can be started, the job tracker can't be started due to the following file permission reason.
My HDFS serivce use 'simple' permission. who can tell me if i need further configuration to grant user=mapred to write the folder Using CM API?? Thanks a lo!
2014-09-05 12:04:44,161 WARN org.apache.hadoop.mapred.JobTracker: Failed to operate on mapred.system.dir (hdfs://dhcp-corp-233.sc-cig-eng.tst:8020/tmp/mapred/system) because of permissions. 2014-09-05 12:04:44,162 WARN org.apache.hadoop.mapred.JobTracker: This directory should be owned by the user 'mapred (auth:SIMPLE)' 2014-09-05 12:04:44,163 WARN org.apache.hadoop.mapred.JobTracker: Bailing out ... org.apache.hadoop.security.AccessControlException: Permission denied: user=mapred, access=WRITE, inode="/":hdfs:supergroup:drwxr-xr-x
Created 09-05-2014 02:01 PM
I tested and worked! Thanks a lot!
What i used is the function below:
reate_hdfs_tmp(self) | source code |
Create the /tmp directory in HDFS with appropriate ownership and permissions.
Returns: Reference to the submitted command
Since: API v2
Created 09-05-2014 01:04 PM
Created 09-05-2014 01:39 PM
do you know how to use API to run the command?
I was trying to use API to automate cdh installation. what's the best way to do that? thanks a million!
Created 09-05-2014 01:41 PM
Created 09-05-2014 01:50 PM
which function for this API? sorry, i couldn't find the right one.
Created 09-05-2014 01:51 PM
probably this is the answer. i will check this...
create_hdfs_tmp
Created 09-05-2014 02:01 PM
I tested and worked! Thanks a lot!
What i used is the function below:
reate_hdfs_tmp(self) | source code |
Create the /tmp directory in HDFS with appropriate ownership and permissions.
Returns: Reference to the submitted command
Since: API v2