Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

How to get logs of shell scripts in oozie

Solved Go to solution
Highlighted

Re: How to get logs of shell scripts in oozie

Explorer
I mean how can we check the folders on datanodes. I don't know how to do it
Highlighted

Re: How to get logs of shell scripts in oozie

Super Collaborator

Well, one way to do it would be to connect yourself in SSH to the datanodes.

For exemple, using putty or winscp.

 

 

Highlighted

Re: How to get logs of shell scripts in oozie

Explorer

@mathieu.d Here I am creating files in /tmp folder on datanodes right.

 

Can I do hdfs dfs -put /tmp/$USER/...success.log /user/$USER/logs/...success.log

 

Will this work ? 

Re: How to get logs of shell scripts in oozie

Explorer

@mathieu.d @mbigelow Thank you both of you I was able to achieve the desired result.

 

First stored the logs in local and then uploaded them to HDFS

Highlighted

Re: How to get logs of shell scripts in oozie

New Contributor

how did you stored logs in local? can you please provide me the way you did it.

Don't have an account?
Coming from Hortonworks? Activate your account here