Created 09-16-2022 05:02 AM
Hi,
I have CDP private Cloud Base version 7.4.4 running in EC2 instance. I have hive, hive onTez and Tez services running. When I try to execute query in hive I get below issue
Tez session hasn't been created yet. Opening session
ERROR : Failed to execute tez graph.
org.apache.tez.dag.api.TezUncheckedException: Invalid configuration of tez jars, tez.lib.uris is not defined in the configuration
Below is the complete error log
INFO : Compiling command(queryId=hive_20220915080651_6fe3fec1-a2ab-462b-ad3c-e7f4d53c2b46):
insert into customer values('sample1','1')
INFO : Semantic Analysis Completed (retrial = false)
INFO : Created Hive schema: Schema(fieldSchemas:[FieldSchema(name:col1, type:string, comment:null), FieldSchema(name:col2, type:string, comment:null)], properties:null)
INFO : Completed compiling command(queryId=hive_20220915080651_6fe3fec1-a2ab-462b-ad3c-e7f4d53c2b46); Time taken: 0.121 seconds
INFO : Executing command(queryId=hive_20220915080651_6fe3fec1-a2ab-462b-ad3c-e7f4d53c2b46):
insert into customer values('sample1','1')
INFO : Query ID = hive_20220915080651_6fe3fec1-a2ab-462b-ad3c-e7f4d53c2b46
INFO : Total jobs = 1
INFO : Launching Job 1 out of 1
INFO : Starting task [Stage-1:MAPRED] in serial mode
WARN : The session: sessionId=9940e671-640e-46d3-b9ae-4ff27d255256, queueName=null, user=hive, doAs=false, isOpen=false, isDefault=false has not been opened
INFO : Subscribed to counters: [] for queryId: hive_20220915080651_6fe3fec1-a2ab-462b-ad3c-e7f4d53c2b46
INFO : Tez session hasn't been created yet. Opening session
ERROR : Failed to execute tez graph.
org.apache.tez.dag.api.TezUncheckedException: Invalid configuration of tez jars, tez.lib.uris is not defined in the configuration
at org.apache.tez.client.TezClientUtils.setupTezJarsLocalResources(TezClientUtils.java:180) ~[tez-api-0.9.1.7.1.7.0-551.jar:0.9.1.7.1.7.0-551]
at org.apache.tez.client.TezClient.getTezJarResources(TezClient.java:1095) ~[tez-api-0.9.1.7.1.7.0-551.jar:0.9.1.7.1.7.0-551]
at org.apache.tez.client.TezClient.setupApplicationContext(TezClient.java:477) ~[tez-api-0.9.1.7.1.7.0-551.jar:0.9.1.7.1.7.0-551]
at org.apache.tez.client.TezClient.start(TezClient.java:404) ~[tez-api-0.9.1.7.1.7.0-551.jar:0.9.1.7.1.7.0-551]
at org.apache.hadoop.hive.ql.exec.tez.TezSessionState.startSessionAndContainers(TezSessionState.java:536) ~[hive-exec-3.1.3000.7.1.7.0-551.jar:3.1.3000.7.1.7.0-551]
at org.apache.hadoop.hive.ql.exec.tez.TezSessionState.openInternal(TezSessionState.java:374) ~[hive-exec-3.1.3000.7.1.7.0-551.jar:3.1.3000.7.1.7.0-551]
at org.apache.hadoop.hive.ql.exec.tez.TezSessionState.open(TezSessionState.java:299) ~[hive-exec-3.1.3000.7.1.7.0-551.jar:3.1.3000.7.1.7.0-551]
at org.apache.hadoop.hive.ql.exec.tez.TezSessionPoolSession.open(TezSessionPoolSession.java:106) ~[hive-exec-3.1.3000.7.1.7.0-551.jar:3.1.3000.7.1.7.0-551]
Any help appreciated.
Created 09-27-2022 06:14 AM
Can you make sure that Hiveserver2 is installed under Hive_on_Tez and not under Hive ?
Most probably the tez libraries are not defined under hive configurations
1- try adding this property "tez.lib.uris" in Hive on Tez and Hive services
- Cloudera Manager -> Hive on Tez -> Configurations -> "Hive Service Advanced Configuration Snippet (Safety Valve) for hive-site.xml"
tez.lib.uris=/user/tez/<version>/tez.tar.gz
## Where (/user/tez/<version>/tez.tar.gz) is an HDFS location.
- Cloudera Manager -> Hive -> Configurations -> "Hive Service Advanced Configuration Snippet (Safety Valve) for hive-site.xml"
tez.lib.uris=/user/tez/<version>/tez.tar.gz
Also make sure tez client is installed on all the edge nodes and the file exists on HDFS
2 - If you don't find the file on HDFS do the following
- Cloudera Manager -> Tez -> Actions -> "Upload Tez tar file to HDFS"
Created 11-22-2023 07:09 AM
Hi @udeshmukh ,
Above mentioned solution doesn't work for me as the things are in place. Please suggest anything else.
Thanks,
MR_KD
Created 11-22-2023 08:37 AM
@MR_KD As this is an older post, you would have a better chance of receiving a resolution by starting a new thread. This will also be an opportunity to provide details specific to your environment that could aid others in assisting you with a more accurate answer to your question. You can link this thread as a reference in your new post. Thanks.
Regards,
Diana Torres,