Created 06-26-2018 09:51 PM
I am running a simple sqoop import command which in turn runs a map reduce.
I am testing this after standing up the cluster...I see this error from the logs :
[2018-06-26 21:02:59,672] {bash_operator.py:76} INFO - main : requested yarn user is ods_archive [2018-06-26 21:02:59,673] {bash_operator.py:76} INFO - Path /disk1/hadoop/yarn/local/usercache/ods_archive/appcache/application_1530031055103_0009 has permission 700 but needs permission 750. [2018-06-26 21:02:59,673] {bash_operator.py:76} INFO - Path /disk2/hadoop/yarn/local/usercache/ods_archive/appcache/application_1530031055103_0009 has permission 700 but needs permission 750. [2018-06-26 21:02:59,673] {bash_operator.py:76} INFO - Path /disk3/hadoop/yarn/local/usercache/ods_archive/appcache/application_1530031055103_0009 has permission 700 but needs permission 750. [2018-06-26 21:02:59,674] {bash_operator.py:76} INFO - Path /disk4/hadoop/yarn/local/usercache/ods_archive/appcache/application_1530031055103_0009 has permission 700 but needs permission 750. [2018-06-26 21:02:59,674] {bash_operator.py:76} INFO - Path /disk5/hadoop/yarn/local/usercache/ods_ archive/appcache/application_1530031055103_0009 has permission 700 but needs permission 750. [2018-06-26 21:02:59,674] {bash_operator.py:76} INFO - Path /disk6/hadoop/yarn/local/usercache/ods_archive/appcache/application_1530031055103_0009 has permission 700 but needs permission 750. After checking the file system I see the directories do not have execute permissions : [root@node3.dev appcache]# pwd /disk1/hadoop/yarn/local/usercache/ods_archive/appcache drwx--S--- 4 ods_archive hadoop 4096 Jun 26 19:20 application_1530031055103_0005 drwx--S--- 4 ods_archive hadoop 4096 Jun 26 19:26 application_1530031055103_0006 drwx--S--- 4 ods_archive hadoop 4096 Jun 26 19:38 application_1530031055103_0008 drwx--S--- 4 ods_archive hadoop 4096 Jun 26 21:04 application_1530031055103_0009 drwx--S--- 4 ods_archive hadoop 4096 Jun 26 21:10 application_1530031055103_0010 drwx--S--- 4 ods_archive hadoop 4096 Jun 26 21:16 application_1530031055103_0011 drwx--S--- 4 ods_archive hadoop 4096 Jun 26 21:23 application_1530031055103_0012 Am I missing somewhere to set the permissions ?
Created 06-26-2018 11:35 PM
@Kumar Veerappan, is umask set properly in your cluster ? Refer to below article for details.
Created 06-26-2018 11:35 PM
@Kumar Veerappan, is umask set properly in your cluster ? Refer to below article for details.