Support Questions

Find answers, ask questions, and share your expertise

Availability of logs on Hue Web UI or YARN RM after Jobs finished

avatar
Rising Star

Hi all,

I've run few oozie workflow through Hue. 

But once the jobs finished, I cannot see the logs anymore.

 

I'm wondering whether this is normal behaviour or I can config something on yarn to make the logs available even after job finishes. 

 

yarn.log-aggregation-enable is set to enable on the cluster

 

Using this command is fine. yarn logs -applicationId <Application ID>. Only cannot see in the hue web ui after the job finished

 

job.JPG

 

Thanks

1 ACCEPTED SOLUTION

avatar
Rising Star

I've resolved this. Turn out my permission on the logs folder is messed up.

 

Changed the /tmp/logs folder to be owned by mapred solved this.

View solution in original post

1 REPLY 1

avatar
Rising Star

I've resolved this. Turn out my permission on the logs folder is messed up.

 

Changed the /tmp/logs folder to be owned by mapred solved this.