Reply
Highlighted
Explorer
Posts: 6
Registered: ‎03-01-2018

Hive Job Stuck

[ Edited ]

Hello,

I am using CDH 5.14, on VirtualBox with 10Gb memory 2 nodes cluster.

I wanted to test the hive functionality so i set the nodemanager memory to 2.6G.

Created hive table with 8000 rows in text format.

when i try to count the rows through hive it did not progress as follows, can you please give some hints:

hive> select count(*) from geo;
Query ID = hdfs_20180416185858_a1bbf6cb-0d82-4682-90ef-0ef49a5d1777
Total jobs = 1
Launching Job 1 out of 1
Number of reduce tasks determined at compile time: 1
In order to change the average load for a reducer (in bytes):
set hive.exec.reducers.bytes.per.reducer=<number>
In order to limit the maximum number of reducers:
set hive.exec.reducers.max=<number>
In order to set a constant number of reducers:
set mapreduce.job.reduces=<number>
Starting Job = job_1523896483209_0002, Tracking URL = http://mugzy:8088/proxy/application_1523896483209_0002/
Kill Command = /opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/hadoop/bin/hadoop job -kill job_1523896483209_0002
Hadoop job information for Stage-1: number of mappers: 1; number of reducers: 1
2018-04-16 18:58:33,289 Stage-1 map = 0%, reduce = 0%
2018-04-16 18:59:34,122 Stage-1 map = 0%, reduce = 0%
2018-04-16 19:00:34,879 Stage-1 map = 0%, reduce = 0%
2018-04-16 19:01:35,630 Stage-1 map = 0%, reduce = 0%
2018-04-16 19:02:36,494 Stage-1 map = 0%, reduce = 0%
2018-04-16 19:03:37,172 Stage-1 map = 0%, reduce = 0%
2018-04-16 19:04:38,043 Stage-1 map = 0%, reduce = 0%
2018-04-16 19:05:38,688 Stage-1 map = 0%, reduce = 0%
2018-04-16 19:06:39,323 Stage-1 map = 0%, reduce = 0%
2018-04-16 19:07:39,982 Stage-1 map = 0%, reduce = 0%
2018-04-16 19:08:40,803 Stage-1 map = 0%, reduce = 0%
2018-04-16 19:09:41,456 Stage-1 map = 0%, reduce = 0%
2018-04-16 19:10:42,092 Stage-1 map = 0%, reduce = 0%
2018-04-16 19:11:42,703 Stage-1 map = 0%, reduce = 0%
2018-04-16 19:12:43,467 Stage-1 map = 0%, reduce = 0%
2018-04-16 19:13:44,131 Stage-1 map = 0%, reduce = 0%
2018-04-16 19:14:44,947 Stage-1 map = 0%, reduce = 0%
2018-04-16 19:15:45,599 Stage-1 map = 0%, reduce = 0%
2018-04-16 19:16:46,176 Stage-1 map = 0%, reduce = 0%
2018-04-16 19:17:46,985 Stage-1 map = 0%, reduce = 0%
2018-04-16 19:18:47,587 Stage-1 map = 0%, reduce = 0%
2018-04-16 19:19:48,280 Stage-1 map = 0%, reduce = 0%
2018-04-16 19:20:48,978 Stage-1 map = 0%, reduce = 0%
2018-04-16 19:21:49,626 Stage-1 map = 0%, reduce = 0%
2018-04-16 19:22:50,375 Stage-1 map = 0%, reduce = 0%
2018-04-16 19:23:51,002 Stage-1 map = 0%, reduce = 0%
2018-04-16 19:24:51,622 Stage-1 map = 0%, reduce = 0%
2018-04-16 19:25:52,227 Stage-1 map = 0%, reduce = 0%
2018-04-16 19:26:52,789 Stage-1 map = 0%, reduce = 0%
2018-04-16 19:27:53,365 Stage-1 map = 0%, reduce = 0%
2018-04-16 19:28:53,978 Stage-1 map = 0%, reduce = 0%
2018-04-16 19:29:54,747 Stage-1 map = 0%, reduce = 0%
2018-04-16 19:30:55,495 Stage-1 map = 0%, reduce = 0%
2018-04-16 19:31:56,171 Stage-1 map = 0%, reduce = 0%
2018-04-16 19:32:56,910 Stage-1 map = 0%, reduce = 0%
2018-04-16 19:33:57,642 Stage-1 map = 0%, reduce = 0%

Champion
Posts: 680
Registered: ‎05-16-2016

Re: Hive Job Stuck

[ Edited ]

could you check your yarn web ui for the corresponding job id 

Announcements