Our Community is getting an upgrade! To get everything ready for the relaunch, we’ll be placing the site in read-only mode starting September 21st.
We really appreciate your understanding while we get things set up behind the scenes. Catch up on all the exciting details about the move here.
Need help or have questions? Drop us a line at [email protected]
Created 06-26-2018 09:51 PM
I am running a simple sqoop import command which in turn runs a map reduce.
I am testing this after standing up the cluster...I see this error from the logs :
[2018-06-26 21:02:59,672] {bash_operator.py:76} INFO - main : requested yarn user is ods_archive
[2018-06-26 21:02:59,673] {bash_operator.py:76} INFO - Path /disk1/hadoop/yarn/local/usercache/ods_archive/appcache/application_1530031055103_0009 has permission 700 but needs permission 750.
[2018-06-26 21:02:59,673] {bash_operator.py:76} INFO - Path /disk2/hadoop/yarn/local/usercache/ods_archive/appcache/application_1530031055103_0009 has permission 700 but needs permission 750.
[2018-06-26 21:02:59,673] {bash_operator.py:76} INFO - Path /disk3/hadoop/yarn/local/usercache/ods_archive/appcache/application_1530031055103_0009 has permission 700 but needs permission 750.
[2018-06-26 21:02:59,674] {bash_operator.py:76} INFO - Path /disk4/hadoop/yarn/local/usercache/ods_archive/appcache/application_1530031055103_0009 has permission 700 but needs permission 750.
[2018-06-26 21:02:59,674] {bash_operator.py:76} INFO - Path /disk5/hadoop/yarn/local/usercache/ods_
archive/appcache/application_1530031055103_0009 has permission 700 but needs permission 750.
[2018-06-26 21:02:59,674] {bash_operator.py:76} INFO - Path /disk6/hadoop/yarn/local/usercache/ods_archive/appcache/application_1530031055103_0009 has permission 700 but needs permission 750.
After checking the file system I see the directories do not have execute permissions :
[[email protected] appcache]# pwd
/disk1/hadoop/yarn/local/usercache/ods_archive/appcache
drwx--S--- 4 ods_archive hadoop 4096 Jun 26 19:20 application_1530031055103_0005
drwx--S--- 4 ods_archive hadoop 4096 Jun 26 19:26 application_1530031055103_0006
drwx--S--- 4 ods_archive hadoop 4096 Jun 26 19:38 application_1530031055103_0008
drwx--S--- 4 ods_archive hadoop 4096 Jun 26 21:04 application_1530031055103_0009
drwx--S--- 4 ods_archive hadoop 4096 Jun 26 21:10 application_1530031055103_0010
drwx--S--- 4 ods_archive hadoop 4096 Jun 26 21:16 application_1530031055103_0011
drwx--S--- 4 ods_archive hadoop 4096 Jun 26 21:23 application_1530031055103_0012
Am I missing somewhere to set the permissions ?
Created 06-26-2018 11:35 PM
@Kumar Veerappan, is umask set properly in your cluster ? Refer to below article for details.
Created 06-26-2018 11:35 PM
@Kumar Veerappan, is umask set properly in your cluster ? Refer to below article for details.