Support Questions
Find answers, ask questions, and share your expertise

tez in hive tutorial not working

tez in hive tutorial not working

Explorer

just installed a new sandbox and started the tutorial. cant upload a new table ( or perform any select command ) but if i use MR and not tez in hive it will work. after some digging around I saw that tez doesn't succeed in creating an app (

hive -hiveconf hive.root.logger=ALL,console

) and I found log files in the hdfs in /usr/admin/hive/jobs which gives me the following content :


============================ Logs for Query 'use default' ============================ ====================================================================================================================== Logs for Query 'select d.*, t.hours_logged, t.miles_logged from drivers d join timesheet t on d.driverId = t.driverId' ====================================================================================================================== INFO : Tez session hasn't been created yet. Opening session ERROR : Failed to execute tez graph. org.apache.tez.dag.api.SessionNotRunning: TezSession has already shutdown. Application application_1513849021521_0019 failed 2 times due to AM Container for appattempt_1513849021521_0019_000002 exited with exitCode: -1000 For more detailed output, check the application tracking page: http://sandbox-hdp.hortonworks.com:8088/cluster/app/application_1513849021521_0019 Then click on links to logs of each attempt. Diagnostics: org.apache.hadoop.fs.ChecksumException: Checksum error: /hdp/apps/2.6.3.0-235/tez/tez.tar.gz at 41811968 exp: -826577146 got: -1058145232 Failing this attempt. Failing the application. at org.apache.tez.client.TezClient.waitTillReady(TezClient.java:699) at org.apache.hadoop.hive.ql.exec.tez.TezSessionState.open(TezSessionState.java:218) at org.apache.hadoop.hive.ql.exec.tez.TezTask.updateSession(TezTask.java:286) at org.apache.hadoop.hive.ql.exec.tez.TezTask.execute(TezTask.java:165) at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:162) at org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:89) at org.apache.hadoop.hive.ql.Driver.launchTask(Driver.java:1756) at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:1497) at org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:1294) at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1161) at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1156) at org.apache.hive.service.cli.operation.SQLOperation.runQuery(SQLOperation.java:197) at org.apache.hive.service.cli.operation.SQLOperation.access$300(SQLOperation.java:76) at org.apache.hive.service.cli.operation.SQLOperation$2$1.run(SQLOperation.java:255) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1866) at org.apache.hive.service.cli.operation.SQLOperation$2.run(SQLOperation.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748)

Thank you very much

2 REPLIES 2

Re: tez in hive tutorial not working

Heya @Ilya Brodetsky , pinging @gdeleon as I think he may be able to provide some insight here.

Re: tez in hive tutorial not working

Expert Contributor

Hi @Ilya Brodetsky,
It turns out that the tutorial you're having issues with is tutorial-290 and not tutorial-100.

I was successful going through tutorial using Sandbox HDP 2.6.3 on Docker (Mac).
Which VM and operating system are you using?

Can you please verify sandbox-version? It should be:

Sandbox information:                                        
Created on: 11.10.2017 for Docker                           
Hadoop stack version:  Hadoop 2.7.3.2.6.3.0-235            
Ambari Version: 2.6.0.0-267                                 
Ambari Hash: 96849839378a44df46fd07c22ce748cb911ffe7f       
Ambari build:  Release : 267                               
Java version:  1.8.0_151                                   
OS Version:  CentOS release 6.9 (Final)