Reply
Explorer
Posts: 33
Registered: ‎01-30-2017

Re: How to get logs of shell scripts in oozie

I mean how can we check the folders on datanodes. I don't know how to do it
Posts: 176
Topics: 8
Kudos: 21
Solutions: 19
Registered: ‎07-16-2015

Re: How to get logs of shell scripts in oozie

Well, one way to do it would be to connect yourself in SSH to the datanodes.

For exemple, using putty or winscp.

 

 

Explorer
Posts: 33
Registered: ‎01-30-2017

Re: How to get logs of shell scripts in oozie

@mathieu.d Here I am creating files in /tmp folder on datanodes right.

 

Can I do hdfs dfs -put /tmp/$USER/...success.log /user/$USER/logs/...success.log

 

Will this work ? 

Highlighted
Explorer
Posts: 33
Registered: ‎01-30-2017

Re: How to get logs of shell scripts in oozie

@mathieu.d @mbigelow Thank you both of you I was able to achieve the desired result.

 

First stored the logs in local and then uploaded them to HDFS

Announcements