Created 11-29-2017 09:45 AM
My Hive query fails:
java.sql.SQLException: Error while processing statement: FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.tez.TezTask
I cannot see any logs in the tez view. It looks like the parse stage is hiding to the right but I cannot access it? How do I look at it and where are the logs?
TIA!!
For some reason I cannot upload a jpg so there is a png here.
Created 11-29-2017 09:59 AM
@ed day
Do you see any Tez View logs here?
# less /var/log/ambari-server/tez-view/tez-view.log
To get more details on the tez view you can also try to enable the DEBUG on tez view logs as following:
Step1. Change the Tez View logging level to DEBUG (default is INFO)
# grep 'INFO' /var/lib/ambari-server/resources/views/work/TEZ\{0.7.0.2.6.0.3-8\}/view.log4j.properties log4j.logger.org.apache.ambari.view.tez=INFO,tezView
Edit the above file and change the INFO to DEBUG as following:
log4j.logger.org.apache.ambari.view.tez=DEBUG,tezView
NOTE: Similarly for the Hive View you can enable the DEBUG logging inside the following files:
# grep 'INFO' /var/lib/ambari-server/resources/views/work/HIVE\{2.0.0\}/view.log4j.properties log4j.logger.org.apache.ambari.view.hive20=INFO,hive20 # grep 'INFO' /var/lib/ambari-server/resources/views/work/HIVE\{1.5.0\}/view.log4j.properties log4j.logger.org.apache.ambari.view.hive2=INFO,hiveNextView
.
Step2. Now restart Ambari Server and the access Tez View
# ambari-server restart
Step3. Check the Tez Logs.
# tail -300f /var/log/ambari-server/tez-view/tez-view.log
.
Created 11-29-2017 09:59 AM
@ed day
Do you see any Tez View logs here?
# less /var/log/ambari-server/tez-view/tez-view.log
To get more details on the tez view you can also try to enable the DEBUG on tez view logs as following:
Step1. Change the Tez View logging level to DEBUG (default is INFO)
# grep 'INFO' /var/lib/ambari-server/resources/views/work/TEZ\{0.7.0.2.6.0.3-8\}/view.log4j.properties log4j.logger.org.apache.ambari.view.tez=INFO,tezView
Edit the above file and change the INFO to DEBUG as following:
log4j.logger.org.apache.ambari.view.tez=DEBUG,tezView
NOTE: Similarly for the Hive View you can enable the DEBUG logging inside the following files:
# grep 'INFO' /var/lib/ambari-server/resources/views/work/HIVE\{2.0.0\}/view.log4j.properties log4j.logger.org.apache.ambari.view.hive20=INFO,hive20 # grep 'INFO' /var/lib/ambari-server/resources/views/work/HIVE\{1.5.0\}/view.log4j.properties log4j.logger.org.apache.ambari.view.hive2=INFO,hiveNextView
.
Step2. Now restart Ambari Server and the access Tez View
# ambari-server restart
Step3. Check the Tez Logs.
# tail -300f /var/log/ambari-server/tez-view/tez-view.log
.
Created 11-29-2017 10:11 AM
If you want to get more detailed information for any Tez AM related logging then please change the INFO logging level to DEBUG inside:
Ambari UI --> Tez --> Configs --> General --> "tez.am.log.level" (INFO to DEBUG)
.
Root Logging level passed to the Tez app master. Simple configuration: Set the log level for all loggers. e.g. INFO This sets the log level to INFO for all loggers.
.
Created 11-29-2017 10:25 AM
Wow thanks. I'll try these tomorrow when my latest slow job finishes.