Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Oozie workflow script not found but I have put it to hdfs in proper directory

Oozie workflow script not found but I have put it to hdfs in proper directory

New Contributor

14468-errorlogfile.png

Here is the part of the workflow which is not working

<!-- Clean up edge node files older than 5 days -->
<action name="sshCleanUpEdgeNode">
<shell xmlns="uri:oozie:shell-action:0.3">
<exec>cleanUpEdgeNodeBXDB.sh</exec>
 <argument>${keyTabName}</argument>
     <argument>${keyTabUsername}</argument>
     <argument>${edge_server}</argument>
<argument> /PathToEdgeNodeDir </argument>
<file>${nameNode}/${keyTabLocation}/${keyTabName}</file>
<capture-output />
</shell>
<ok to="end"/>
<error to="sendEmailError"/>
</action>

I had the entire project to hdfs in the required locations but it doesn't seem to be able to find the script. I had fixed this error before but then I modified the workflow and this error came back of not being able to find the file . Which is really weird because I verified that it exists on edgenode and in hdfs .As well here is a script for a impala refresh and it works fine and they both have the same file permissions.

<!-- Impala invalidate/refresh metadata -->
<action name="impala-refresh-iis">
<shell xmlns="uri:oozie:shell-action:0.3">
<exec>impala-command.sh</exec>
<argument>${keyTabName}</argument>
<argument>${keyTabUsername}</argument>
<argument>${impala_server}</argument>
<argument>A.B</argument>
<file>${nameNode}/${keyTabLocation}/${keyTabName}</file>
</shell>
<ok to="sshCleanUpEdgeNode"/>
<error to="fail"/>
</action> 

As well this had worked fine in terms of finding the file in the past as well. Note I have renamed and pushed the file since then I just wanted to show that at one point it was working

<!-- Clean up edge node files older than 5 days -->
<action name="sshCleanUpEdgeNode">
<shell xmlns="uri:oozie:shell-action:0.3">
<exec>cleanUpEdgeNode.sh</exec>
<argument> EdgeNodeDir </argument>
<file>${nameNode}/${keyTabLocation}/${keyTabName}</file>
<capture-output />
</shell>
<ok to="end"/>
<error to="sendEmailError"/>
</action>
1 REPLY 1

Re: Oozie workflow script not found but I have put it to hdfs in proper directory

New Contributor

It ended up being a formatting error in my script because I wrote in on windows yup that was the problem and then it was transferred through winscp always do a cat -A on file

Don't have an account?
Coming from Hortonworks? Activate your account here