Support Questions
Find answers, ask questions, and share your expertise

How to hide/remove yarn logs in Hive CLI

How to hide/remove yarn logs in Hive CLI

New Contributor

the hive cli will print hadoop logs when run a query, is there a way to remove these logs(only show the job process, i.e. map/reduce process in each task)? the lines below which starts with a date is the log I want to remove

Launching Job 1 out of 5
Number of reduce tasks is set to 0 since there's no reduce operator
17/10/17 17:53:49 INFO client.RMProxy: Connecting to ResourceManager at 10.90.33.172:8032
17/10/17 17:53:50 INFO client.RMProxy: Connecting to ResourceManager at 10.90.33.172:8032
17/10/17 17:53:50 WARN mapreduce.JobSubmitter: Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this.
17/10/17 17:53:51 INFO input.FileInputFormat: Total input paths to process : 1
17/10/17 17:53:51 INFO mapreduce.JobSubmitter: number of splits:0
17/10/17 17:53:51 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_1504162679223_3992220
17/10/17 17:53:51 INFO impl.YarnClientImpl: Submitted application application_1504162679223_3992220 to ResourceManager at 10.90.33.172:8032
17/10/17 17:53:51 INFO mapreduce.Job: The url to track the job
2 REPLIES 2

Re: How to hide/remove yarn logs in Hive CLI

Expert Contributor

Hi, this is coming from HIve logger.

You can set that to ERROR by Hive config in Ambari directly, visible at bottom in settings tab.

screen-shot-2017-10-17-at-80254-pm.png

Or change hive.log.level in configurations.

Re: How to hide/remove yarn logs in Hive CLI

New Contributor

thank you for your reply, but it doesn't work, you can find that the log I showed is logged by hadoop code not hive, I don't know why hadoop log is printed on console