I'm quite new to HDP, and still I'm learning about this platform.
I'm following the SensorData tutorial and I wanted to know if it's possible to see the logs for the Map Reduce executions associated with particular Hive Query.
SELECT truckid, avg(mpg) avgmpg FROM truck_mileage GROUP BY truckid;
I'm running the above query, and I'm trying to see all the underlying MapReduce jobs.
How to get this info?
Thanks for the prompt reply. I checked that but the only content I found in that file was
WARNING: Use "yarn jar" to launch YARN applications.
When going through this tutorial, I found that by setting execution.engine to mr, you can get all the logs for a MR job, which is what I was looking for. Thanks for the help.
There is a simple way to do this. Go to yarn through ambari. Click on yarn then click on quick links, then resource manager UI. then click on job name. and you have full access to all logs.