About jaadds

jaadds · ‎09-04-2016

Thanks!!. That was what I was looking for.

jaadds · ‎09-01-2016

I was able to successfully setup Hive 1.2.1 with Hadoop 2.7.1, using yarn as the mapreduce framework. For debugging certain queries (am trying to attach a debugger and go through the operators), now I'm trying to use the local mode. i.e. After switching to the local mode, I could see queries running, but I can't locate the logs for those jobs. Checked in the log folder but can't find any folder (I was looking for a syslog put inside a folder specific to a particular job), or a log starting with job id. How can I get those logs? These are all the properties I have in mapred-site.xml <property> <name>mapreduce.framework.name</name> <value>local</value> </property> <property> <name>mapred.child.java.opts</name> <value>-Xmx512m</value> </property> <property> <name>mapred.job.tracker</name> <value>local</value> </property>

jaadds · ‎08-04-2016

@mqureshi Thanks for the prompt reply. I checked that but the only content I found in that file was WARNING: Use "yarn jar" to launch YARN applications. When going through this tutorial, I found that by setting execution.engine to mr, you can get all the logs for a MR job, which is what I was looking for. Thanks for the help.

jaadds · ‎08-04-2016

I'm quite new to HDP, and still I'm learning about this platform. I'm following the SensorData tutorial and I wanted to know if it's possible to see the logs for the Map Reduce executions associated with particular Hive Query. SELECT truckid, avg(mpg) avgmpg FROM truck_mileage GROUP BY truckid; I'm running the above query, and I'm trying to see all the underlying MapReduce jobs. How to get this info?

Online	Offline
Last Visited	‎09-04-2016 12:55 PM

Date Registered	‎08-04-2016 01:41 AM
Last Visited	‎09-04-2016 12:55 PM
Total Messages Posted	4
Total Kudos Received	1

Re: How to locate logs for local jobs

How to locate logs for local jobs

Re: Viewing logs for Hive query Executions

Viewing logs for Hive query Executions