Reply
Highlighted
Contributor
Posts: 76
Registered: ‎05-19-2016

SemanticException Failed to get a spark session

[ Edited ]

 

Error: Error while compiling statement: FAILED: SemanticException Failed to get a spark session: org.apache.hadoop.hive.ql.metadata.HiveException: Failed to create spark client. (state=42000,code=40000)

 

Some of my hive jobs submitted through oozie fail with this error. Hive editor is used throughout the day and we mostly have our jobs scheduled through oozie the entire time of the day. We cannot afford for any of our jobs to fail.

 

What can I do to avoid this error?

 

 

 

Here's my cluster configuration:

 

What can I do to accept any number of connections to spark? I cannot afford any of my jobs failing

Yarn containers are allowed a memory of 6GB and it has worked fine with Map Reduce.

 

Spark Executor Cores : 4

Spark Executor Maximum Java Heap Size: 2 GB

Spark Driver Memory Overhead:26 MiB

Spark Executor Memory Overhead: 26 MiB

My node configurations:

1 Master node with spark server on it: 16vCPU, 64GB memory

3 worker nodes with HDFS and YARN on it: 16vCPU, 64GB memory

What should be the values for above-mentioned parameters?

I am guessing it to be 6 executors and 25GB heap size with 7GB executor memory overhead

Correct me if I am wrong, please

 

IP1 IP1 3 Role(s)
  • HDFS Datanode
  • YARN(MR2 Included) NodeManager
  • Spark Gateway
6.6s ago 504.1 GiB / 2 TiB 11.9 GiB / 62.5 GiB
IP2 IP2 3 Role(s)
  • HDFS Datanode
  • YARN(MR2 Included) NodeManager
  • Spark Gateway
6.71s ago 494 GiB / 2 TiB 10.5 GiB / 62.5 GiB
IP3 IP3 6 Role(s)
  • Cloudera services and manager
  • YARN Node manager
7.41s ago 1.1 TiB / 1.4 TiB 10.7 GiB / 31 GiB
IP4 IP4 15 Role(s)
  • HDFS Balancer
  • HDFS Datanode
  • HDFS NameNode
  • HDFS SNN
  • Hive Metastore
  • HiveServer2
  • Oozie Server
  • YARN JobHistoryServer
  • YARN Resource Manager
  • Zookeeper
  • Hue
  • Sentry
  • Spark gateway
  • Spark History server
  • Sqoop 2 server
6.53s ago 1 TiB / 2.4 TiB 52.9 GiB / 62.5 GiB
IP5 IP5 2 Role(s)
  • HDFS Datanode
  • YARN(MR2 Included) NodeManager
  • Spark Gateway
14.07s ago 2.8 GiB / 2 TiB 998.7 MiB / 62.5 GiB
IP6 IP6 7 Role(s)
All gateways
YARN Node manager
3.66s ago 927.5 GiB / 1000 GiB 6.7 GiB / 31 GiB
IP7 IP7 2 Role(s)
  • HDFS Datanode
  • YARN(MR2 Included) NodeManager
4.44s ago

 

 
Announcements