Member since
12-15-2015
6
Posts
0
Kudos Received
0
Solutions
05-03-2016
06:04 PM
Well @drussell... I figured as much, but thought I would double check. Thanks for the reply!
... View more
05-03-2016
03:55 PM
Thanks Benjamin! The script definitely works locally, and I should have mentioned that. This effort is really just to get the thing fully automated and running without a man in the loop. As for the logs, you are absolutely right... I was able to figure out how to cross reference the Oozie web ui "logs" with the actually Yarn logs via the map ID. Digging into these and talking to some folks, I was able to figure out how to get the curl to run as shell action in hdfs and write out to hdfs. Thanks for the assist! -Kevin
... View more