Member since
04-25-2022
2
Posts
0
Kudos Received
0
Solutions
09-16-2022
05:02 AM
Hi, I have CDP private Cloud Base version 7.4.4 running in EC2 instance. I have hive, hive onTez and Tez services running. When I try to execute query in hive I get below issue Tez session hasn't been created yet. Opening session ERROR : Failed to execute tez graph. org.apache.tez.dag.api.TezUncheckedException: Invalid configuration of tez jars, tez.lib.uris is not defined in the configuration Below is the complete error log INFO : Compiling command(queryId=hive_20220915080651_6fe3fec1-a2ab-462b-ad3c-e7f4d53c2b46): insert into customer values('sample1','1') INFO : Semantic Analysis Completed (retrial = false) INFO : Created Hive schema: Schema(fieldSchemas:[FieldSchema(name:col1, type:string, comment:null), FieldSchema(name:col2, type:string, comment:null)], properties:null) INFO : Completed compiling command(queryId=hive_20220915080651_6fe3fec1-a2ab-462b-ad3c-e7f4d53c2b46); Time taken: 0.121 seconds INFO : Executing command(queryId=hive_20220915080651_6fe3fec1-a2ab-462b-ad3c-e7f4d53c2b46): insert into customer values('sample1','1') INFO : Query ID = hive_20220915080651_6fe3fec1-a2ab-462b-ad3c-e7f4d53c2b46 INFO : Total jobs = 1 INFO : Launching Job 1 out of 1 INFO : Starting task [Stage-1:MAPRED] in serial mode WARN : The session: sessionId=9940e671-640e-46d3-b9ae-4ff27d255256, queueName=null, user=hive, doAs=false, isOpen=false, isDefault=false has not been opened INFO : Subscribed to counters: [] for queryId: hive_20220915080651_6fe3fec1-a2ab-462b-ad3c-e7f4d53c2b46 INFO : Tez session hasn't been created yet. Opening session ERROR : Failed to execute tez graph. org.apache.tez.dag.api.TezUncheckedException: Invalid configuration of tez jars, tez.lib.uris is not defined in the configuration at org.apache.tez.client.TezClientUtils.setupTezJarsLocalResources(TezClientUtils.java:180) ~[tez-api-0.9.1.7.1.7.0-551.jar:0.9.1.7.1.7.0-551] at org.apache.tez.client.TezClient.getTezJarResources(TezClient.java:1095) ~[tez-api-0.9.1.7.1.7.0-551.jar:0.9.1.7.1.7.0-551] at org.apache.tez.client.TezClient.setupApplicationContext(TezClient.java:477) ~[tez-api-0.9.1.7.1.7.0-551.jar:0.9.1.7.1.7.0-551] at org.apache.tez.client.TezClient.start(TezClient.java:404) ~[tez-api-0.9.1.7.1.7.0-551.jar:0.9.1.7.1.7.0-551] at org.apache.hadoop.hive.ql.exec.tez.TezSessionState.startSessionAndContainers(TezSessionState.java:536) ~[hive-exec-3.1.3000.7.1.7.0-551.jar:3.1.3000.7.1.7.0-551] at org.apache.hadoop.hive.ql.exec.tez.TezSessionState.openInternal(TezSessionState.java:374) ~[hive-exec-3.1.3000.7.1.7.0-551.jar:3.1.3000.7.1.7.0-551] at org.apache.hadoop.hive.ql.exec.tez.TezSessionState.open(TezSessionState.java:299) ~[hive-exec-3.1.3000.7.1.7.0-551.jar:3.1.3000.7.1.7.0-551] at org.apache.hadoop.hive.ql.exec.tez.TezSessionPoolSession.open(TezSessionPoolSession.java:106) ~[hive-exec-3.1.3000.7.1.7.0-551.jar:3.1.3000.7.1.7.0-551] Any help appreciated.
... View more
Labels:
06-01-2022
12:24 AM
I have set up Cloudera Manager (Trial) 7.4.4 in Ubuntu 20.04.4 LTS (Focal Fossa) as a single node cluster in AWS EC2.
All the services HDFS, Hue , Hive , Spark , Livy , Solr , ZooKeeper , Yarn are in good health and running.
I can login to Hue editor and open spark notebook. But I'm getting the issue as The Spark session could not be created in the cluster when trying to execute notebook.
I
The Spark session could not be created in the cluster: at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1898) at org.apache.spark.deploy.SparkSubmit.doRunMain$1(SparkSubmit.scala:144) at org.apache.spark.deploy.SparkSubmit.submit(SparkSubmit.scala:184) at org.apache.spark.deploy.SparkSubmit.doSubmit(SparkSubmit.scala:86) at org.apache.spark.deploy.SparkSubmit$$anon$2.doSubmit(SparkSubmit.scala:922) at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:931) at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala) 22/06/01 06:32:29 INFO util.ShutdownHookManager: Shutdown hook called 22/06/01 06:32:29 INFO util.ShutdownHookManager: Deleting directory /tmp/spark-84563e48-b47b-4c3e-ab3d-4f25bb31a036 YARN Diagnostics:
Any help is appreciated.
Thanks,
... View more
Labels: