https://community.cloudera.com/t5/Archives-of-Support-Questions/yarn-cache-files-does-not-have-execute-permissions/m-p/233381#M79941 <P>I am running a simple sqoop import command which in turn runs a map reduce.</P><P>I am testing this after standing up the cluster...I see this error from the logs :</P><PRE>[2018-06-26 21:02:59,672] {bash_operator.py:76} INFO - main : requested yarn user is ods_archive [2018-06-26 21:02:59,673] {bash_operator.py:76} INFO - Path /disk1/hadoop/yarn/local/usercache/ods_archive/appcache/application_1530031055103_0009 has permission 700 but needs permission 750. [2018-06-26 21:02:59,673] {bash_operator.py:76} INFO - Path /disk2/hadoop/yarn/local/usercache/ods_archive/appcache/application_1530031055103_0009 has permission 700 but needs permission 750. [2018-06-26 21:02:59,673] {bash_operator.py:76} INFO - Path /disk3/hadoop/yarn/local/usercache/ods_archive/appcache/application_1530031055103_0009 has permission 700 but needs permission 750. [2018-06-26 21:02:59,674] {bash_operator.py:76} INFO - Path /disk4/hadoop/yarn/local/usercache/ods_archive/appcache/application_1530031055103_0009 has permission 700 but needs permission 750. [2018-06-26 21:02:59,674] {bash_operator.py:76} INFO - Path /disk5/hadoop/yarn/local/usercache/ods_ archive/appcache/application_1530031055103_0009 has permission 700 but needs permission 750. [2018-06-26 21:02:59,674] {bash_operator.py:76} INFO - Path /disk6/hadoop/yarn/local/usercache/ods_archive/appcache/application_1530031055103_0009 has permission 700 but needs permission 750. After checking the file system I see the directories do not have execute permissions : [root@node3.dev appcache]# pwd /disk1/hadoop/yarn/local/usercache/ods_archive/appcache drwx--S--- 4 ods_archive hadoop 4096 Jun 26 19:20 application_1530031055103_0005 drwx--S--- 4 ods_archive hadoop 4096 Jun 26 19:26 application_1530031055103_0006 drwx--S--- 4 ods_archive hadoop 4096 Jun 26 19:38 application_1530031055103_0008 drwx--S--- 4 ods_archive hadoop 4096 Jun 26 21:04 application_1530031055103_0009 drwx--S--- 4 ods_archive hadoop 4096 Jun 26 21:10 application_1530031055103_0010 drwx--S--- 4 ods_archive hadoop 4096 Jun 26 21:16 application_1530031055103_0011 drwx--S--- 4 ods_archive hadoop 4096 Jun 26 21:23 application_1530031055103_0012 Am I missing somewhere to set the permissions ? </PRE> Wed, 27 Jun 2018 04:51:02 GMT kums 2018-06-27T04:51:02Z https://community.cloudera.com/t5/Archives-of-Support-Questions/yarn-cache-files-does-not-have-execute-permissions/m-p/233381#M79941 <P>I am running a simple sqoop import command which in turn runs a map reduce.</P><P>I am testing this after standing up the cluster...I see this error from the logs :</P><PRE>[2018-06-26 21:02:59,672] {bash_operator.py:76} INFO - main : requested yarn user is ods_archive [2018-06-26 21:02:59,673] {bash_operator.py:76} INFO - Path /disk1/hadoop/yarn/local/usercache/ods_archive/appcache/application_1530031055103_0009 has permission 700 but needs permission 750. [2018-06-26 21:02:59,673] {bash_operator.py:76} INFO - Path /disk2/hadoop/yarn/local/usercache/ods_archive/appcache/application_1530031055103_0009 has permission 700 but needs permission 750. [2018-06-26 21:02:59,673] {bash_operator.py:76} INFO - Path /disk3/hadoop/yarn/local/usercache/ods_archive/appcache/application_1530031055103_0009 has permission 700 but needs permission 750. [2018-06-26 21:02:59,674] {bash_operator.py:76} INFO - Path /disk4/hadoop/yarn/local/usercache/ods_archive/appcache/application_1530031055103_0009 has permission 700 but needs permission 750. [2018-06-26 21:02:59,674] {bash_operator.py:76} INFO - Path /disk5/hadoop/yarn/local/usercache/ods_ archive/appcache/application_1530031055103_0009 has permission 700 but needs permission 750. [2018-06-26 21:02:59,674] {bash_operator.py:76} INFO - Path /disk6/hadoop/yarn/local/usercache/ods_archive/appcache/application_1530031055103_0009 has permission 700 but needs permission 750. After checking the file system I see the directories do not have execute permissions : [root@node3.dev appcache]# pwd /disk1/hadoop/yarn/local/usercache/ods_archive/appcache drwx--S--- 4 ods_archive hadoop 4096 Jun 26 19:20 application_1530031055103_0005 drwx--S--- 4 ods_archive hadoop 4096 Jun 26 19:26 application_1530031055103_0006 drwx--S--- 4 ods_archive hadoop 4096 Jun 26 19:38 application_1530031055103_0008 drwx--S--- 4 ods_archive hadoop 4096 Jun 26 21:04 application_1530031055103_0009 drwx--S--- 4 ods_archive hadoop 4096 Jun 26 21:10 application_1530031055103_0010 drwx--S--- 4 ods_archive hadoop 4096 Jun 26 21:16 application_1530031055103_0011 drwx--S--- 4 ods_archive hadoop 4096 Jun 26 21:23 application_1530031055103_0012 Am I missing somewhere to set the permissions ? </PRE> Wed, 27 Jun 2018 04:51:02 GMT https://community.cloudera.com/t5/Archives-of-Support-Questions/yarn-cache-files-does-not-have-execute-permissions/m-p/233381#M79941 kums 2018-06-27T04:51:02Z https://community.cloudera.com/t5/Archives-of-Support-Questions/yarn-cache-files-does-not-have-execute-permissions/m-p/233382#M79942 <P><A rel="user" href="https://community.cloudera.com/users/11304/kumarveerappan.html" nodeid="11304">@Kumar Veerappan</A>, is umask set properly in your cluster ? Refer to below article for details.</P><P><A href="https://community.hortonworks.com/content/supportkb/150234/error-path-disk3hadoopyarnlocalusercachesomeuserap.html">https://community.hortonworks.com/content/supportkb/150234/error-path-disk3hadoopyarnlocalusercachesomeuserap.html</A></P> Wed, 27 Jun 2018 06:35:47 GMT https://community.cloudera.com/t5/Archives-of-Support-Questions/yarn-cache-files-does-not-have-execute-permissions/m-p/233382#M79942 yvora 2018-06-27T06:35:47Z