Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

ERROR SparkYarnApp: Error whiling refreshing YARN state: java.lang.Exception: No YARN application is found with tag livy-batch in 120 Seconds

Highlighted

ERROR SparkYarnApp: Error whiling refreshing YARN state: java.lang.Exception: No YARN application is found with tag livy-batch in 120 Seconds

Explorer

Hi,

We are having one HDInsight cluster (3.6) with 2 head nodes & 4 worker nodes. (16 core & 55 GB RAM for worker nodes).

We have one weird issue with livy2 that, when we submit job, it executes fine, when we submit 2 simultaneous jobs also it executes fine. But after that if we submit any job, it fails saying

ERROR SparkYarnApp: Error whiling refreshing YARN state: java.lang.Exception: No YARN application is found with tag livy-batch in 120 seconds, Please check your cluster status, it is may be very busy. 

After 10 mins, the same job runs fine.is it some configuration issues? The job doesn't even reach Yarn. Cluster state is healthy.

We have set these values to tune Yarn & mapreduce. Any other parameter that we need to take a look? Pls help

yarn.scheduler.minimum-allocation-mb=6144
yarn.scheduler.maximum-allocation-mb=49152
yarn.nodemanager.resource.memory-mb=49152
mapreduce.map.memory.mb=6144
mapreduce.map.java.opts=-Xmx4915m
mapreduce.reduce.memory.mb=6144
mapreduce.reduce.java.opts=-Xmx4915m
yarn.app.mapreduce.am.resource.mb=6144
yarn.app.mapreduce.am.command-opts=-Xmx4915m
mapreduce.task.io.sort.mb=2457
tez.am.resource.memory.mb=6144
tez.am.launch.cmd-opts =-Xmx4096m
hive.tez.container.size=6144
hive.tez.java.opts=-Xmx4096