Support Questions
Find answers, ask questions, and share your expertise

TezSessionManager - Exception while waiting for Tez client to be ready

Explorer

Hi folks,

I'm following HDP Hello World tutorial. In Lab 3 when I execute the PIG script by checking "Execute on Tez" checkbox I got the following error. I think I have a configuration issue.

Have an idea?

I've attached the log file.

Thanks

Özgür

[PigTezLauncher-0] ERROR org.apache.pig.backend.hadoop.executionengine.tez.TezSessionManager - Exception while waiting for Tez client to be ready 
 org.apache.tez.dag.api.TezUncheckedException: Invalid configuration of tez jars, tez.lib.uris is not defined in the configuration 
 	at org.apache.tez.client.TezClientUtils.setupTezJarsLocalResources(TezClientUtils.java:168) 
 	at org.apache.tez.client.TezClient.getTezJarResources(TezClient.java:841) 
 	at org.apache.tez.client.TezClient.start(TezClient.java:380) 
 	at org.apache.pig.backend.hadoop.executionengine.tez.TezSessionManager.createSession(TezSessionManager.java:96) 
 	at org.apache.pig.backend.hadoop.executionengine.tez.TezSessionManager.getClient(TezSessionManager.java:211) 
 	at org.apache.pig.backend.hadoop.executionengine.tez.TezJob.run(TezJob.java:158) 
 	at org.apache.pig.backend.hadoop.executionengine.tez.TezLauncher$1.run(TezLauncher.java:195) 
 	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) 
 	at java.util.concurrent.FutureTask.run(FutureTask.java:266) 
 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) 
 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) 
 	at java.lang.Thread.run(Thread.java:745) 
 2016-01-25 11:06:57,500 [PigTezLauncher-0] ERROR org.apache.pig.backend.hadoop.executionengine.tez.TezJob - Cannot submit DAG 

tezerror.txt

33 REPLIES 33

Explorer

nope 😄 they do not exist, I've already checked 😄

I started a fresh installation with this document, and it'll be "my last trial" with hdp. hdp is really a tough job. 😞

http://docs.hortonworks.com/HDPDocuments/Ambari/Ambari-2.2.0.0/index.html

@Özgür Akdemirci

Good luck! HDP is easy 🙂 Ambari rocks. Please make sure not to ignore any errors during the install.

Also, once done then attach the output of this

curl -u admin:admin -i -H 'X-Requested-By: ambari' -X GET http://host:8080/api/v1/clusters/clustername?format=blueprint

@Özgür Akdemirci You can install clients in ambari server and one of data nodes.

Region server will be on data nodes (not master nodes)

Node manager on data nodes

Explorer

What about Phoenix Query, Spark Thrift and NFS Gateway?

And about the clients: i think it was the reason why my last installation halted, I trust you :D, and select ambari-server and one data node. @Neeraj Sabharwal

@Özgür Akdemirci They look good to me. Also, we can add client tools in any node after the install if we have to

Explorer

@Neeraj Sabharwal It's not completed yet 😄 (I think vm cluster is not a good idea), one installation attempt failed, I increased the following timeout values,

agent.package.install.task.timeout = 1800-->25000 agent.task.timeout = 900->25000

if this attempt succeeds, it may be added to the documentation 😄

Explorer

Have a good night (good morning for me), @Neeraj Sabharwal

Yesterday I made a typo in hive mysql db config, services did not started, but today, I correct it, and I have an ambari dashboard without any red light (unbelievable :)) . I hope it doesnot affect the installation. 😞

I'll configure Files(HDFS) and Pig instances. Let me find its hdp tutorial...

curl output is attached...

abcdefgh.txt

PS: btw, if time difference makes a problem, i'll arrange my message times.

Thanks

Regards

Explorer

Same error 😄

is the following link a clue ??

I have 4 hosts tez installed, 3 pig installed, and i didnot select this 😄

https://issues.apache.org/jira/browse/AMBARI-10129

Explorer

@Neeraj Sabharwal 😄 good morning, since you are awaken, I can ask a question 😉

with 1 ambari-server 2 master nodes 3 data nodes,

with the following services HDFS, YARN + mapReduce,Tez, Hive, Pig, ZooKeeper, Ambari Metrics, Spark, HBase

what's the optimal "Assign Slaves and Clients" configuration? I'm attaching an image...

selection.png

I wanna complete at least one HDP tutorial in my "current" life.. =D

Thanks.

Özgür

Explorer

Hi @Neeraj Sabharwal did u have a chance to control the blueprint? I've news for you. My pig script runs in a non deterministic fashion. i ran about 15 times, 1/3 of successful, 2/3 failure with the same error). But i added tez class and jar paths to run it.do you have a cluster setup ?

Mentor

@Özgür Akdemirci has this been resolved? Can you post your solution or accept best answer?

Expert Contributor

The reason this exception comes because that the Pig needs a local Tez client, if its not available then this exception is thrown even though the tez.lib.uris is present and the hdfs has the tez.tar.gz under correct hdp release.

Contributor

synchronize the Tez configurations on all nodes, and restart hiveserver2, it should work fine.

; ;