Support Questions
Find answers, ask questions, and share your expertise

How can I find the logs for the stdout and stderr of Ooozie Shell Actions in Quickstart 5.4.x

How can I find the logs for the stdout and stderr of Ooozie Shell Actions in Quickstart 5.4.x

Contributor

We want to develop an oozie custom action (based on the shell action).  As a first step, i have written a shell actiion and have tried adding logger -s statements (to write to stderr and the system logs) and shell echo statements.  The scripts fail when ussing logger statements in Oozie (don't know why) so echo it is.  Howveer I'm not seeing any logs from the job when I run it.

 

In particular when I try to look it up and follow the external job id in Hue, I see the workflow succeeded, but the logs aren't availbe, instead I see the following.  Why doi I get this?

 

  Logs not available for attempt_1432085930328_0016_m_000000_0. Aggregation may not be complete, Check back later or try the nodemanager at quickstart.cloudera:8041 

 

1 REPLY 1

Re: How can I find the logs for the stdout and stderr of Ooozie Shell Actions in Quickstart 5.4.x

Super Collaborator

I can not say why the logger does not work for you.

The logs however should be available for you to check. That specific message can be shown under a number of circumstances:

- aggregation is off

- job ran as a different user than the one trying to get the logs

- permissions issues on HDFS

- job histroy server is not running

 

Can you check if you can see tyhe logs from Cloudera Manager via the Cluster -> YARN Applications menu drop down.

 

Wilfred