Reply
New Contributor
Posts: 4
Registered: ‎12-08-2015

resource can not release spark on yarn

I am using cloudera manager-5.5.0 that manager hadoop-cdh-2.6.0 ,spark-cdh-1.5.0, hive-cdh-1.1.0 and so on.

when I runing job to Spark On Yarn and Hive On Spark in Cluster, is very easy appear  job maintain in "RUNNING UNDEFINED"。

when I open the SparkApplicationMaster Page (Spark Jobs), all the spark Job Id  and Task has succeeded in 3 min,but, the container of the resource  can't released. 

 

in besides, the log appear has some error: 

 

23634 15/12/14 15:23:56 INFO exec.FileSinkOperator: RECORDS_OUT_1_db_report.report_content_ad_user_statistical:1
23635 15/12/14 15:23:56 INFO exec.FileSinkOperator: 1095 Close done
23636 15/12/14 15:23:56 INFO exec.SelectOperator: 1094 Close done
23637 15/12/14 15:23:56 INFO exec.SelectOperator: 1093 Close done
23638 15/12/14 15:23:56 INFO exec.GroupByOperator: 1092 Close done
23639 15/12/14 15:23:56 ERROR counter.SparkCounters: counter[HIVE, RECORDS_OUT_1_db_report.report_content_ad_user_statistical] has not initialized before.
23640 15/12/14 15:23:56 INFO executor.Executor: Finished task 556.0 in stage 10.0 (TID 741). 1215 bytes result sent to driver
23641 15/12/14 15:25:00 ERROR executor.CoarseGrainedExecutorBackend: RECEIVED SIGNAL 15: SIGTERM

 

---------------------------------------------------------------------------------------------------------------------------------------------

 

Page detail.

Spark Jobs (?)

Event Timeline

Completed Jobs (5)

 

Job Id Description Submitted Duration Stages: Succeeded/Total Tasks (for all stages): Succeeded/Total

 

4 foreachAsync at RemoteHiveSparkClient.java:305 2015/12/14 15:21:34 2.5 min 4/4 974/974
3 foreachAsync at RemoteHiveSparkClient.java:305 2015/12/14 15:21:31 0.6 s 2/2 2/2
2 foreachAsync at RemoteHiveSparkClient.java:305 2015/12/14 15:21:29 1 s 2/2 2/2
1 foreachAsync at RemoteHiveSparkClient.java:305 2015/12/14 15:21:26 2 s 2/2 2/2
0 foreachAsync at RemoteHiveSparkClient.java:305 2015/12/14 15:21:19 5 s 1/1 1/1


 

New Contributor
Posts: 4
Registered: ‎12-08-2015

Re: resource can not release spark on yarn

i find a link https://issues.apache.org/jira/browse/HIVE-12466 topic is "SparkCounter not initialized error".

the patch in 24/Nov/15 05:56