Created on 06-04-2018 11:20 AM - edited 08-17-2019 09:28 PM
I am trying to execute a python script every minute.
I navigate to workflow manager -> create -> coordinator
The workflow path is the python file, the frequency is minutes 1.
I then choose to validate, and I have to put in the coordinator path.
What is the coordinator path in this case ? And are these the correct steps to execute a python file every minute ?
Created 06-04-2018 02:52 PM
Workflow path should point to the actual workflow.xml that contains the list of actions you are performing. In your case this workflow.xml should contain a bash action to call the python script.
Coordinator path is the path to the coordinator.xml that contains the information related to the frequency of execution and reference to the workflow.xml
I recommend you take time to go over this HC article that guides you step by step on how to use the workflow view:
HTH
*** If you found this answer addressed your question, please take a moment to login and click the "accept" link on the answer.
Created 06-05-2018 02:15 PM
@Victor Did the above helped you with the issue. Keep me posted! Thanks
Created on 06-08-2018 09:21 AM - edited 08-17-2019 09:27 PM
Hi @Felix Albani . It does not work, here is a visit of the steps.
I created a new folder on HDFS and added the python file in there. The location is
user -> admin -> v5_script -> scripting.py
1) Create Workflow -> Shell - > scripting.py (exec) and the location, below attached screen.
Then I validated my workflow as follows
Then I submit the workflow
My python file head is
The errors are as following "error=2, No such file or directory"
2018-06-08 09:19:07,998 WARN ShellActionExecutor:523 - SERVER[sandbox-hdp.hortonworks.com] USER[admin] GROUP[-] TOKEN[] APP[v5_workflow] JOB[0000869-180604152743470-oozie-oozi-W] ACTION[0000869-180604152743470-oozie-oozi-W@shell_1] Launcher ERROR, reason: Main class [org.apache.oozie.action.hadoop.ShellMain], main() threw exception, Cannot run program "scripting.py" (in directory "/hadoop/yarn/local/usercache/admin/appcache/application_1528126107293_0867/container_1528126107293_0867_01_000002"): error=2, No such file or directory 2018-06-08 09:19:08,006 WARN ShellActionExecutor:523 - SERVER[sandbox-hdp.hortonworks.com] USER[admin] GROUP[-] TOKEN[] APP[v5_workflow] JOB[0000869-180604152743470-oozie-oozi-W] ACTION[0000869-180604152743470-oozie-oozi-W@shell_1] Launcher exception: Cannot run program "scripting.py" (in directory "/hadoop/yarn/local/usercache/admin/appcache/application_1528126107293_0867/container_1528126107293_0867_01_000002"): error=2, No such file or directory java.io.IOException: Cannot run program "scripting.py" (in directory "/hadoop/yarn/local/usercache/admin/appcache/application_1528126107293_0867/container_1528126107293_0867_01_000002"): error=2, No such file or directory
Created on 06-08-2018 09:24 AM - edited 08-17-2019 09:27 PM
Created on 06-08-2018 09:26 AM - edited 08-17-2019 09:27 PM
The permission of the files are as follows @Felix Albani