question Where are tez logs? in Archives of Support Questions (Read Only)

Where are tez logs?

ed_day — Wed, 29 Nov 2017 17:45:37 GMT

My Hive query fails:

java.sql.SQLException: Error while processing statement: FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.tez.TezTask

I cannot see any logs in the tez view. It looks like the parse stage is hiding to the right but I cannot access it? How do I look at it and where are the logs?

TIA!!

For some reason I cannot upload a jpg so there is a png here.

Re: Where are tez logs?

jsensharma — Wed, 29 Nov 2017 17:59:53 GMT

@ed day
Do you see any Tez View logs here?

# less /var/log/ambari-server/tez-view/tez-view.log

To get more details on the tez view you can also try to enable the DEBUG on tez view logs as following:

Step1. Change the Tez View logging level to DEBUG (default is INFO)

# grep 'INFO' /var/lib/ambari-server/resources/views/work/TEZ\{0.7.0.2.6.0.3-8\}/view.log4j.properties 
log4j.logger.org.apache.ambari.view.tez=INFO,tezView

Edit the above file and change the INFO to DEBUG as following:

log4j.logger.org.apache.ambari.view.tez=DEBUG,tezView

NOTE: Similarly for the Hive View you can enable the DEBUG logging inside the following files:

# grep 'INFO' /var/lib/ambari-server/resources/views/work/HIVE\{2.0.0\}/view.log4j.properties 
log4j.logger.org.apache.ambari.view.hive20=INFO,hive20


# grep 'INFO' /var/lib/ambari-server/resources/views/work/HIVE\{1.5.0\}/view.log4j.properties 
log4j.logger.org.apache.ambari.view.hive2=INFO,hiveNextView

.
Step2. Now restart Ambari Server and the access Tez View

# ambari-server restart

Step3. Check the Tez Logs.

# tail -300f /var/log/ambari-server/tez-view/tez-view.log

Re: Where are tez logs?

jsensharma — Wed, 29 Nov 2017 18:11:48 GMT

@ed day

If you want to get more detailed information for any Tez AM related logging then please change the INFO logging level to DEBUG inside:

Ambari UI --> Tez --> Configs --> General --> "tez.am.log.level"  (INFO to DEBUG)

Root Logging level passed to the Tez app master. Simple configuration: Set the log level for all loggers. e.g. INFO This sets the log level to INFO for all loggers.

Re: Where are tez logs?

ed_day — Wed, 29 Nov 2017 18:25:42 GMT

Wow thanks. I'll try these tomorrow when my latest slow job finishes.