Support Questions

Find answers, ask questions, and share your expertise
Announcements
Celebrating as our community reaches 100,000 members! Thank you!

oozie shell action

avatar
Rising Star

I created a similar job as in : https://community.hortonworks.com/content/supportkb/48985/how-to-setup-oozie-shell-action.html

On execution the yarn log shows as success.

But I can't see the /tmp/output file being created anywhere. I checked on the local linux host as well as hdfs.

One question I have is in job.properties -

oozie.coord.application.path=${nameNode}/user/root/apps/shell


Should the configuration files (job.properties, coordinator.xml etc) reside in the above directory? I have them there.

Not sure what is happening.

Appreciate the insights.

1 ACCEPTED SOLUTION

avatar
Master Guru
hide-solution

This problem has been solved!

Want to get a detailed solution you have to login/registered on the community

Register/Login
12 REPLIES 12

avatar
Rising Star

In the yarn log for the job I can see :


=================================================================

>>> Invoking Shell command line now >>

Exit code of the Shell command 0
<<< Invocation of Shell command completed <<<


<<< Invocation of Main class completed <<<


Oozie Launcher, capturing output data:
=======================

avatar
Master Guru

Hi @n c

Can you please check on the node manager where this launcher was run, ideally this file should be created locally on the node manager where your shell script was run.

Please do let me know if you need any further help.

avatar
Rising Star

@Kuldeep Kulkarni , any insights pls? Appreciate the help.

avatar
Rising Star

>this file should be created locally on the node manager where your shell script was run

I have the file locally on a node. It is on this node that I execute the oozie command.

Are you saying that the shell script should be in hdfs? And that yarn will execute this shell script on the node manager on which this job was run? Rather than on the host from which I run the oozie command?

Appreciate the feedback.

avatar
Rising Star

yes, I checked the nodes and found the output in one of them. I reran to make sure.

So the script is not really needed on the Linux box? all of them - job.properties, the shellscript, workflow.xml, coordinator.xml? They need to be only in hdfs?

Also next, how to execute a python code from oozie? Also I want it to run daily.

Appreciate the insights.


avatar
Rising Star

@Kuldeep Kulkarni, I created python action based on https://community.hortonworks.com/content/supportkb/151119/how-to-run-a-python-script-using-oozie-sh...

But how do I integrate coordinator.xml with that?

I tried creating the file but it is not executing as per that.

Is there somewhere in job.properties or workflow.xml that you mention coordinator.xml?

Appreciate the feedback.

avatar
Master Guru
hide-solution

This problem has been solved!

Want to get a detailed solution you have to login/registered on the community

Register/Login

avatar
Rising Star

Hi Kuldeep, thanks so much for the clarification.

I will try to do as per your instructions and let you know how it went.

Thanks again.

avatar
Rising Star

BTW now I use cloudera. So I guess it has to be manual. Thanks.