Support Questions

Find answers, ask questions, and share your expertise

How to hide/remove yarn logs in Hive CLI

New Contributor

the hive cli will print hadoop logs when run a query, is there a way to remove these logs(only show the job process, i.e. map/reduce process in each task)? the lines below which starts with a date is the log I want to remove

Launching Job 1 out of 5
Number of reduce tasks is set to 0 since there's no reduce operator
17/10/17 17:53:49 INFO client.RMProxy: Connecting to ResourceManager at 10.90.33.172:8032
17/10/17 17:53:50 INFO client.RMProxy: Connecting to ResourceManager at 10.90.33.172:8032
17/10/17 17:53:50 WARN mapreduce.JobSubmitter: Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this.
17/10/17 17:53:51 INFO input.FileInputFormat: Total input paths to process : 1
17/10/17 17:53:51 INFO mapreduce.JobSubmitter: number of splits:0
17/10/17 17:53:51 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_1504162679223_3992220
17/10/17 17:53:51 INFO impl.YarnClientImpl: Submitted application application_1504162679223_3992220 to ResourceManager at 10.90.33.172:8032
17/10/17 17:53:51 INFO mapreduce.Job: The url to track the job
2 REPLIES 2

Expert Contributor

Hi, this is coming from HIve logger.

You can set that to ERROR by Hive config in Ambari directly, visible at bottom in settings tab.

screen-shot-2017-10-17-at-80254-pm.png

Or change hive.log.level in configurations.

New Contributor

thank you for your reply, but it doesn't work, you can find that the log I showed is logged by hadoop code not hive, I don't know why hadoop log is printed on console

Take a Tour of the Community
Don't have an account?
Your experience may be limited. Sign in to explore more.