Archives of Support Questions (Read Only)

This is an archived board for historical reference. Information and links may no longer be available or relevant
Announcements
This board is archived and read-only for historical reference. To ask a new question, please post a new topic on the appropriate active board.

Where are tez logs?

avatar
Expert Contributor

My Hive query fails:

java.sql.SQLException: Error while processing statement: FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.tez.TezTask

I cannot see any logs in the tez view. It looks like the parse stage is hiding to the right but I cannot access it? How do I look at it and where are the logs?

TIA!!

For some reason I cannot upload a jpg so there is a png here.

1 ACCEPTED SOLUTION

avatar
Master Mentor

@ed day
Do you see any Tez View logs here?

# less /var/log/ambari-server/tez-view/tez-view.log


To get more details on the tez view you can also try to enable the DEBUG on tez view logs as following:


Step1. Change the Tez View logging level to DEBUG (default is INFO)

# grep 'INFO' /var/lib/ambari-server/resources/views/work/TEZ\{0.7.0.2.6.0.3-8\}/view.log4j.properties 
log4j.logger.org.apache.ambari.view.tez=INFO,tezView


Edit the above file and change the INFO to DEBUG as following:

log4j.logger.org.apache.ambari.view.tez=DEBUG,tezView

NOTE: Similarly for the Hive View you can enable the DEBUG logging inside the following files:

# grep 'INFO' /var/lib/ambari-server/resources/views/work/HIVE\{2.0.0\}/view.log4j.properties 
log4j.logger.org.apache.ambari.view.hive20=INFO,hive20


# grep 'INFO' /var/lib/ambari-server/resources/views/work/HIVE\{1.5.0\}/view.log4j.properties 
log4j.logger.org.apache.ambari.view.hive2=INFO,hiveNextView

.
Step2. Now restart Ambari Server and the access Tez View

# ambari-server restart


Step3. Check the Tez Logs.

# tail -300f /var/log/ambari-server/tez-view/tez-view.log

.

View solution in original post

3 REPLIES 3

avatar
Master Mentor

@ed day
Do you see any Tez View logs here?

# less /var/log/ambari-server/tez-view/tez-view.log


To get more details on the tez view you can also try to enable the DEBUG on tez view logs as following:


Step1. Change the Tez View logging level to DEBUG (default is INFO)

# grep 'INFO' /var/lib/ambari-server/resources/views/work/TEZ\{0.7.0.2.6.0.3-8\}/view.log4j.properties 
log4j.logger.org.apache.ambari.view.tez=INFO,tezView


Edit the above file and change the INFO to DEBUG as following:

log4j.logger.org.apache.ambari.view.tez=DEBUG,tezView

NOTE: Similarly for the Hive View you can enable the DEBUG logging inside the following files:

# grep 'INFO' /var/lib/ambari-server/resources/views/work/HIVE\{2.0.0\}/view.log4j.properties 
log4j.logger.org.apache.ambari.view.hive20=INFO,hive20


# grep 'INFO' /var/lib/ambari-server/resources/views/work/HIVE\{1.5.0\}/view.log4j.properties 
log4j.logger.org.apache.ambari.view.hive2=INFO,hiveNextView

.
Step2. Now restart Ambari Server and the access Tez View

# ambari-server restart


Step3. Check the Tez Logs.

# tail -300f /var/log/ambari-server/tez-view/tez-view.log

.

avatar
Master Mentor

@ed day

If you want to get more detailed information for any Tez AM related logging then please change the INFO logging level to DEBUG inside:

Ambari UI --> Tez --> Configs --> General --> "tez.am.log.level"  (INFO to DEBUG) 

.

Root Logging level passed to the Tez app master. Simple configuration: Set the log level for all loggers. e.g. INFO This sets the log level to INFO for all loggers.

.

avatar
Expert Contributor

Wow thanks. I'll try these tomorrow when my latest slow job finishes.