I'm following HDP Hello World tutorial. In Lab 3 when I execute the PIG script by checking "Execute on Tez" checkbox I got the following error. I think I have a configuration issue.
Have an idea?
I've attached the log file.
[PigTezLauncher-0] ERROR org.apache.pig.backend.hadoop.executionengine.tez.TezSessionManager - Exception while waiting for Tez client to be ready
org.apache.tez.dag.api.TezUncheckedException: Invalid configuration of tez jars, tez.lib.uris is not defined in the configuration
2016-01-25 11:06:57,500 [PigTezLauncher-0] ERROR org.apache.pig.backend.hadoop.executionengine.tez.TezJob - Cannot submit DAG
nope 😄 they do not exist, I've already checked 😄
I started a fresh installation with this document, and it'll be "my last trial" with hdp. hdp is really a tough job. 😞
Good luck! HDP is easy 🙂 Ambari rocks. Please make sure not to ignore any errors during the install.
Also, once done then attach the output of this
curl -u admin:admin -i -H 'X-Requested-By: ambari' -X GET http://host:8080/api/v1/clusters/clustername?format=blueprint
What about Phoenix Query, Spark Thrift and NFS Gateway?
And about the clients: i think it was the reason why my last installation halted, I trust you :D, and select ambari-server and one data node. @Neeraj Sabharwal
@Neeraj Sabharwal It's not completed yet 😄 (I think vm cluster is not a good idea), one installation attempt failed, I increased the following timeout values,
agent.package.install.task.timeout = 1800-->25000 agent.task.timeout = 900->25000
if this attempt succeeds, it may be added to the documentation 😄
Have a good night (good morning for me), @Neeraj Sabharwal
Yesterday I made a typo in hive mysql db config, services did not started, but today, I correct it, and I have an ambari dashboard without any red light (unbelievable :)) . I hope it doesnot affect the installation. 😞
I'll configure Files(HDFS) and Pig instances. Let me find its hdp tutorial...
curl output is attached...
PS: btw, if time difference makes a problem, i'll arrange my message times.
@Neeraj Sabharwal 😄 good morning, since you are awaken, I can ask a question 😉
with 1 ambari-server 2 master nodes 3 data nodes,
with the following services HDFS, YARN + mapReduce,Tez, Hive, Pig, ZooKeeper, Ambari Metrics, Spark, HBase
what's the optimal "Assign Slaves and Clients" configuration? I'm attaching an image...
I wanna complete at least one HDP tutorial in my "current" life.. =D
Hi @Neeraj Sabharwal did u have a chance to control the blueprint? I've news for you. My pig script runs in a non deterministic fashion. i ran about 15 times, 1/3 of successful, 2/3 failure with the same error). But i added tez class and jar paths to run it.do you have a cluster setup ?
The reason this exception comes because that the Pig needs a local Tez client, if its not available then this exception is thrown even though the tez.lib.uris is present and the hdfs has the tez.tar.gz under correct hdp release.