Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Tbl flush

org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Tbl flush

Expert Contributor

Hi,

 

After the upgradation of cloudera from 4.7 to cdh 5.3.

I am getting warnings in the log files and the job is taking tooo long to run.

The log file says:-

Logs for container_1439220480088_1797_01_098459 <script src="/static/jquery/jquery-1.8.2.min.js" type="text/javascript">// // </script> <script src="/static/jquery/jquery-ui-1.9.1.custom.min.js" type="text/javascript">// // </script> <script src="/static/dt-1.9.4/js/jquery.dataTables.min.js" type="text/javascript">// // </script> <script src="/static/yarn.dt.plugins.js" type="text/javascript">// // </script> <script type="text/javascript">// $(function() { $('#nav').accordion({autoHeight:false, active:0}); }); // </script>

2015-08-10 17:09:01,493 INFO [main] ExecReducer: ExecReducer: processing 8000000 rows: used memory = 1615166528
2015-08-10 17:09:01,729 INFO [main] org.apache.hadoop.hive.ql.exec.CommonJoinOperator: table 0 has 7228000 rows for join key [GTS1019783444, 96916743]
2015-08-10 17:09:02,829 INFO [main] org.apache.hadoop.hive.ql.exec.CommonJoinOperator: table 0 has 7328000 rows for join key [GTS1019783444, 96916743]
2015-08-10 17:09:04,257 INFO [main] org.apache.hadoop.hive.ql.exec.CommonJoinOperator: table 0 has 7428000 rows for join key [GTS1019783444, 96916743]
2015-08-10 17:09:05,321 INFO [main] org.apache.hadoop.hive.ql.exec.CommonJoinOperator: table 0 has 7528000 rows for join key [GTS1019783444, 96916743]
2015-08-10 17:09:06,375 INFO [main] org.apache.hadoop.hive.ql.exec.CommonJoinOperator: table 0 has 7628000 rows for join key [GTS1019783444, 96916743]
2015-08-10 17:09:07,528 INFO [main] org.apache.hadoop.hive.ql.exec.CommonJoinOperator: table 0 has 7728000 rows for join key [GTS1019783444, 96916743]
2015-08-10 17:09:08,608 INFO [main] org.apache.hadoop.hive.ql.exec.CommonJoinOperator: table 0 has 7828000 rows for join key [GTS1019783444, 96916743]
2015-08-10 17:09:10,014 INFO [main] org.apache.hadoop.hive.ql.exec.CommonJoinOperator: table 0 has 7928000 rows for join key [GTS1019783444, 96916743]
2015-08-10 17:09:10,370 INFO [main] org.apache.hadoop.mapred.FileInputFormat: Total input paths to process : 1
2015-08-10 17:22:37,994 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Tbl flush: #hash table = 2219689
2015-08-10 17:22:37,995 INFO [main] org.apache.hadoop.hive.ql.exec.FileSinkOperator: Final Path: FS hdfs://burrito/tmp/hive-hive/hive_2015-08-10_16-27-13_378_7079430883879413208-2563/_tmp.-mr-10011/000210_0
2015-08-10 17:22:37,995 INFO [main] org.apache.hadoop.hive.ql.exec.FileSinkOperator: Writing to temp file: FS hdfs://burrito/tmp/hive-hive/hive_2015-08-10_16-27-13_378_7079430883879413208-2563/_task_tmp.-mr-10011/_tmp.000210_0
2015-08-10 17:22:37,995 INFO [main] org.apache.hadoop.hive.ql.exec.FileSinkOperator: New Final Path: FS hdfs://burrito/tmp/hive-hive/hive_2015-08-10_16-27-13_378_7079430883879413208-2563/_tmp.-mr-10011/000210_0
2015-08-10 17:22:38,007 WARN [main] org.apache.hadoop.security.UserGroupInformation: PriviledgedActionException as:ll06208 (auth:SIMPLE) cause:org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.ipc.StandbyException): Operation category READ is not supported in state standby
2015-08-10 17:22:38,008 WARN [main] org.apache.hadoop.ipc.Client: Exception encountered while connecting to the server : org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.ipc.StandbyException): Operation category READ is not supported in state standby
2015-08-10 17:22:38,008 WARN [main] org.apache.hadoop.security.UserGroupInformation: PriviledgedActionException as:ll06208 (auth:SIMPLE) cause:org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.ipc.StandbyException): Operation category READ is not supported in state standby
2015-08-10 17:22:39,550 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Table flushed: new size = 1997720
2015-08-10 17:24:26,047 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Tbl flush: #hash table = 2219689
2015-08-10 17:24:27,314 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Table flushed: new size = 1997720
2015-08-10 17:26:13,775 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Tbl flush: #hash table = 2219689
2015-08-10 17:26:14,980 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Table flushed: new size = 1997720
2015-08-10 17:26:17,268 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Tbl flush: #hash table = 2219689
2015-08-10 17:26:18,546 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Table flushed: new size = 1997720
2015-08-10 17:28:04,456 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Tbl flush: #hash table = 2219689
2015-08-10 17:28:05,591 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Table flushed: new size = 1997720
2015-08-10 17:29:47,636 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Tbl flush: #hash table = 2219689
2015-08-10 17:29:48,862 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Table flushed: new size = 1997720
2015-08-10 17:31:38,030 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Tbl flush: #hash table = 2219689
2015-08-10 17:31:39,202 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Table flushed: new size = 1997720
2015-08-10 17:31:41,646 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Tbl flush: #hash table = 2221411
2015-08-10 17:31:42,975 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Table flushed: new size = 1999269
2015-08-10 17:33:27,669 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Tbl flush: #hash table = 2221411
2015-08-10 17:33:28,780 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Table flushed: new size = 1999269
2015-08-10 17:35:22,326 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Tbl flush: #hash table = 2221411
2015-08-10 17:35:23,513 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Table flushed: new size = 1999269
2015-08-10 17:35:25,843 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Tbl flush: #hash table = 2221411
2015-08-10 17:35:27,364 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Table flushed: new size = 1999269
2015-08-10 17:37:09,083 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Tbl flush: #hash table = 2221411
2015-08-10 17:37:10,221 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Table flushed: new size = 1999269
2015-08-10 17:38:52,160 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Tbl flush: #hash table = 2221411
2015-08-10 17:38:53,297 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Table flushed: new size = 1999269
2015-08-10 17:38:56,067 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Tbl flush: #hash table = 2221411
2015-08-10 17:38:57,276 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Table flushed: new size = 1999269
2015-08-10 17:40:37,203 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Tbl flush: #hash table = 2221411
2015-08-10 17:40:38,284 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Table flushed: new size = 1999269
2015-08-10 17:42:21,486 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Tbl flush: #hash table = 2221411
2015-08-10 17:42:22,619 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Table flushed: new size = 1999269
2015-08-10 17:42:25,450 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Tbl flush: #hash table = 2221411
2015-08-10 17:42:26,592 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Table flushed: new size = 1999269
2015-08-10 17:44:05,253 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Tbl flush: #hash table = 2221411
2015-08-10 17:44:06,300 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Table flushed: new size = 1999269
2015-08-10 17:44:09,373 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Tbl flush: #hash table = 2221411
2015-08-10 17:44:10,449 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Table flushed: new size = 1999269
2015-08-10 17:45:09,747 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Tbl flush: #hash table = 2221411
2015-08-10 17:45:10,928 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Table flushed: new size = 1999269
2015-08-10 17:45:13,343 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Tbl flush: #hash table = 2217969
2015-08-10 17:45:14,892 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Table flushed: new size = 1996172
2015-08-10 17:45:36,757 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Tbl flush: #hash table = 2212827
2015-08-10 17:45:37,964 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Table flushed: new size = 1991544
2015-08-10 17:45:40,952 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Tbl flush: #hash table = 2209412
2015-08-10 17:45:42,168 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Table flushed: new size = 1988470
2015-08-10 17:47:39,324 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Tbl flush: #hash table = 2206008
2015-08-10 17:47:40,514 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Table flushed: new size = 1985407
2015-08-10 17:47:42,937 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Tbl flush: #hash table = 2202614
2015-08-10 17:47:44,282 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Table flushed: new size = 1982352
2015-08-10 17:49:37,457 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Tbl flush: #hash table = 2199231
2015-08-10 17:49:38,568 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Table flushed: new size = 1979307
2015-08-10 17:49:40,906 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Tbl flush: #hash table = 2193000
2015-08-10 17:49:42,289 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Table flushed: new size = 1973700
2015-08-10 17:51:34,530 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Tbl flush: #hash table = 2194175
2015-08-10 17:51:35,589 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Table flushed: new size = 1974757
2015-08-10 17:51:35,698 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Tbl flush: #hash table = 1985000
2015-08-10 17:51:36,759 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Table flushed: new size = 1786500
2015-08-10 17:51:36,765 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Tbl flush: #hash table = 1787000
2015-08-10 17:51:37,733 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Table flushed: new size = 1608300
2015-08-10 17:51:37,741 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Tbl flush: #hash table = 1609000
2015-08-10 17:51:38,725 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Table flushed: new size = 1448100
2015-08-10 17:53:35,455 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Tbl flush: #hash table = 1857000
2015-08-10 17:53:36,462 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Table flushed: new size = 1671300
2015-08-10 17:53:36,470 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Tbl flush: #hash table = 1672000
2015-08-10 17:53:37,324 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Table flushed: new size = 1504800
2015-08-10 17:53:37,326 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Tbl flush: #hash table = 1505000
2015-08-10 17:53:38,216 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Table flushed: new size = 1354500
2015-08-10 17:53:38,221 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Tbl flush: #hash table = 1355000
2015-08-10 17:53:39,075 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Table flushed: new size = 1219500
2015-08-10 17:55:32,230 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Tbl flush: #hash table = 1438000
2015-08-10 17:55:32,896 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Table flushed: new size = 1294200
2015-08-10 17:55:32,905 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Tbl flush: #hash table = 1295000
2015-08-10 17:55:33,706 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Table flushed: new size = 1165500
2015-08-10 18:03:33,839 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Tbl flush: #hash table = 2180806
2015-08-10 18:03:35,043 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Table flushed: new size = 1962725
2015-08-10 18:03:37,302 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Tbl flush: #hash table = 2179146
2015-08-10 18:03:38,807 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Table flushed: new size = 1961231
2015-08-10 18:05:35,500 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Tbl flush: #hash table = 2177489
2015-08-10 18:05:37,084 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Table flushed: new size = 1959740
2015-08-10 18:07:33,699 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Tbl flush: #hash table = 2174182
2015-08-10 18:07:34,891 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Table flushed: new size = 1956763
2015-08-10 18:07:37,331 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Tbl flush: #hash table = 2174182
2015-08-10 18:07:38,553 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Table flushed: new size = 1956763
2015-08-10 18:09:35,064 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Tbl flush: #hash table = 2172533
2015-08-10 18:09:36,202 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Table flushed: new size = 1955279
2015-08-10 18:11:33,227 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Tbl flush: #hash table = 2170886
2015-08-10 18:11:34,272 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Table flushed: new size = 1953797
2015-08-10 18:11:36,666 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Tbl flush: #hash table = 2169241
2015-08-10 18:11:37,788 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Table flushed: new size = 1952316
2015-08-10 18:12:19,845 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Tbl flush: #hash table = 2167599
2015-08-10 18:12:20,881 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Table flushed: new size = 1950839
2015-08-10 18:13:12,302 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Tbl flush: #hash table = 2169241
2015-08-10 18:13:13,363 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Table flushed: new size = 1952316
2015-08-10 18:13:49,780 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Tbl flush: #hash table = 2170886
2015-08-10 18:13:50,770 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Table flushed: new size = 1953797
2015-08-10 18:15:03,609 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Tbl flush: #hash table = 2169241
2015-08-10 18:15:04,647 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Table flushed: new size = 1952316
2015-08-10 18:16:18,790 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Tbl flush: #hash table = 2169241
2015-08-10 18:16:19,926 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Table flushed: new size = 1952316
2015-08-10 18:17:20,496 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Tbl flush: #hash table = 2169241
2015-08-10 18:17:21,699 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Table flushed: new size = 1952316
2015-08-10 18:17:24,235 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Tbl flush: #hash table = 2167599
2015-08-10 18:17:25,437 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Table flushed: new size = 1950839
2015-08-10 18:17:26,479 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Tbl flush: #hash table = 2022000
2015-08-10 18:17:27,777 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Table flushed: new size = 1819800
2015-08-10 18:18:46,974 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Tbl flush: #hash table = 2165959
2015-08-10 18:18:48,161 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Table flushed: new size = 1949363
2015-08-10 18:21:05,432 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Tbl flush: #hash table = 2165959
2015-08-10 18:21:06,665 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Table flushed: new size = 1949363
2015-08-10 18:21:09,047 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Tbl flush: #hash table = 2164322
2015-08-10 18:21:10,340 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Table flushed: new size = 1947889
2015-08-10 18:23:09,278 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Tbl flush: #hash table = 2162688
2015-08-10 18:23:10,475 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Table flushed: new size = 1946419
2015-08-10 18:23:13,043 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Tbl flush: #hash table = 2162688
2015-08-10 18:23:14,254 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Table flushed: new size = 1946419
2015-08-10 18:25:11,939 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Tbl flush: #hash table = 2161055
2015-08-10 18:25:13,071 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Table flushed: new size = 1944949
2015-08-10 18:25:15,533 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Tbl flush: #hash table = 2161055
2015-08-10 18:25:16,923 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Table flushed: new size = 1944949
2015-08-10 18:27:11,191 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Tbl flush: #hash table = 2159426
2015-08-10 18:27:12,204 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Table flushed: new size = 1943483
2015-08-10 18:27:14,747 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Tbl flush: #hash table = 2159426
2015-08-10 18:27:15,740 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Table flushed: new size = 1943483
2015-08-10 18:29:07,332 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Tbl flush: #hash table = 2157798
2015-08-10 18:29:08,375 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Table flushed: new size = 1942018
2015-08-10 18:29:11,100 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Tbl flush: #hash table = 2157798
2015-08-10 18:29:12,178 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Table flushed: new size = 1942018
2015-08-10 18:29:14,875 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Tbl flush: #hash table = 2153000
2015-08-10 18:29:16,131 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Table flushed: new size = 1937700
2015-08-10 18:31:22,622 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Tbl flush: #hash table = 2156173
2015-08-10 18:31:23,953 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Table flushed: new size = 1940555
2015-08-10 18:31:26,301 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Tbl flush: #hash table = 2156173
2015-08-10 18:31:27,495 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Table flushed: new size = 1940555
2015-08-10 18:33:22,484 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Tbl flush: #hash table = 2154551
2015-08-10 18:33:23,563 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Table flushed: new size = 1939095
2015-08-10 18:33:25,982 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Tbl flush: #hash table = 2154551
2015-08-10 18:33:27,271 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Table flushed: new size = 1939095
2015-08-10 18:33:30,156 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Tbl flush: #hash table = 2152931
2015-08-10 18:33:31,290 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Table flushed: new size = 1937637
2015-08-10 18:35:25,078 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Tbl flush: #hash table = 2152931
2015-08-10 18:35:26,315 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Table flushed: new size = 1937637
2015-08-10 18:35:28,997 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Tbl flush: #hash table = 2152931
2015-08-10 18:35:30,443 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Table flushed: new size = 1937637
2015-08-10 18:35:33,388 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Tbl flush: #hash table = 2151313
2015-08-10 18:35:34,637 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Table flushed: new size = 1936181
2015-08-10 18:37:34,774 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Tbl flush: #hash table = 2151313
2015-08-10 18:37:35,805 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Table flushed: new size = 1936181
2015-08-10 18:37:38,213 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Tbl flush: #hash table = 2151313
2015-08-10 18:37:39,538 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Table flushed: new size = 1936181
2015-08-10 18:37:42,343 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Tbl flush: #hash table = 2149698
2015-08-10 18:37:43,538 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Table flushed: new size = 1934728
2015-08-10 18:39:49,468 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Tbl flush: #hash table = 2149698
2015-08-10 18:39:50,603 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Table flushed: new size = 1934728
2015-08-10 18:39:53,115 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Tbl flush: #hash table = 2149698
2015-08-10 18:39:54,312 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Table flushed: new size = 1934728
2015-08-10 18:39:57,254 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Tbl flush: #hash table = 2148086
2015-08-10 18:39:58,395 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Table flushed: new size = 1933277
2015-08-10 18:41:51,850 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Tbl flush: #hash table = 2148086
2015-08-10 18:41:52,877 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Table flushed: new size = 1933277
2015-08-10 18:41:55,514 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Tbl flush: #hash table = 2148086
2015-08-10 18:41:56,542 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Table flushed: new size = 1933277
2015-08-10 18:41:59,171 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Tbl flush: #hash table = 2148086
2015-08-10 18:42:00,401 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Table flushed: new size = 1933277
2015-08-10 18:43:49,574 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Tbl flush: #hash table = 2146475
2015-08-10 18:43:50,623 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Table flushed: new size = 1931827
2015-08-10 18:43:53,142 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Tbl flush: #hash table = 2146475
2015-08-10 18:43:54,543 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Table flushed: new size = 1931827
2015-08-10 18:43:57,198 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Tbl flush: #hash table = 2146475
2015-08-10 18:43:58,264 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Table flushed: new size = 1931827
2015-08-10 18:44:01,070 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Tbl flush: #hash table = 2144868
2015-08-10 18:44:02,358 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Table flushed: new size = 1930381
2015-08-10 18:45:37,432 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Tbl flush: #hash table = 2144868
2015-08-10 18:45:38,470 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Table flushed: new size = 1930381
2015-08-10 18:45:53,464 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Tbl flush: #hash table = 2146475
2015-08-10 18:45:54,467 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Table flushed: new size = 1931827
2015-08-10 18:45:56,948 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Tbl flush: #hash table = 2146475
2015-08-10 18:45:58,025 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Table flushed: new size = 1931827
2015-08-10 18:46:01,066 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Tbl flush: #hash table = 2148086
2015-08-10 18:46:02,034 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Table flushed: new size = 1933277
2015-08-10 18:47:47,983 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Tbl flush: #hash table = 2148086
2015-08-10 18:47:49,062 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Table flushed: new size = 1933277
2015-08-10 18:47:51,594 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Tbl flush: #hash table = 2148086
2015-08-10 18:47:52,801 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Table flushed: new size = 1933277
2015-08-10 18:47:55,458 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Tbl flush: #hash table = 2149698
2015-08-10 18:47:56,848 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Table flushed: new size = 1934728
2015-08-10 18:49:30,346 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Tbl flush: #hash table = 2149698
2015-08-10 18:49:31,447 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Table flushed: new size = 1934728
2015-08-10 18:50:47,874 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Tbl flush: #hash table = 2151313
2015-08-10 18:50:49,146 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Table flushed: new size = 1936181
2015-08-10 18:51:29,149 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Tbl flush: #hash table = 2151313
2015-08-10 18:51:30,324 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Table flushed: new size = 1936181
2015-08-10 18:51:33,221 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Tbl flush: #hash table = 2151313
2015-08-10 18:51:34,312 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Table flushed: new size = 1936181
2015-08-10 18:53:11,710 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Tbl flush: #hash table = 2152931
2015-08-10 18:53:12,769 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Table flushed: new size = 1937637
2015-08-10 18:53:15,327 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Tbl flush: #hash table = 2152931
2015-08-10 18:53:16,627 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Table flushed: new size = 1937637
2015-08-10 18:53:19,150 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Tbl flush: #hash table = 2152931
2015-08-10 18:53:20,335 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Table flushed: new size = 1937637
2015-08-10 18:54:53,635 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Tbl flush: #hash table = 2154551
2015-08-10 18:54:54,633 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Table flushed: new size = 1939095
2015-08-10 18:55:37,037 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Tbl flush: #hash table = 2154551
2015-08-10 18:55:38,191 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Table flushed: new size = 1939095
2015-08-10 18:55:41,938 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Tbl flush: #hash table = 2154551
2015-08-10 18:55:43,048 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Table flushed: new size = 1939095
2015-08-10 18:56:12,034 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Tbl flush: #hash table = 2156173
2015-08-10 18:56:13,076 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Table flushed: new size = 1940555
2015-08-10 18:57:38,853 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Tbl flush: #hash table = 2154551
2015-08-10 18:57:39,946 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Table flushed: new size = 1939095
2015-08-10 18:57:40,559 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Tbl flush: #hash table = 1996000
2015-08-10 18:57:41,603 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Table flushed: new size = 1796400
2015-08-10 18:57:41,609 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Tbl flush: #hash table = 1797000
2015-08-10 18:57:42,644 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Table flushed: new size = 1617300
2015-08-10 18:59:36,845 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Tbl flush: #hash table = 1974000
2015-08-10 18:59:38,391 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Table flushed: new size = 1776600
2015-08-10 19:02:15,053 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Tbl flush: #hash table = 2157798
2015-08-10 19:02:16,042 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Table flushed: new size = 1942018
2015-08-10 19:02:34,882 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Tbl flush: #hash table = 2157798
2015-08-10 19:02:36,601 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Table flushed: new size = 1942018
2015-08-10 19:02:39,317 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Tbl flush: #hash table = 2157798
2015-08-10 19:02:40,432 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Table flushed: new size = 1942018
2015-08-10 19:03:59,537 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Tbl flush: #hash table = 2157798
2015-08-10 19:04:00,566 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Table flushed: new size = 1942018
2015-08-10 19:04:02,996 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Tbl flush: #hash table = 2156173
2015-08-10 19:04:04,059 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Table flushed: new size = 1940555
2015-08-10 19:05:51,908 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Tbl flush: #hash table = 2156173
2015-08-10 19:05:52,926 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Table flushed: new size = 1940555
2015-08-10 19:05:55,441 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Tbl flush: #hash table = 2156173
2015-08-10 19:05:56,477 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Table flushed: new size = 1940555
2015-08-10 19:07:49,107 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Tbl flush: #hash table = 2154551
2015-08-10 19:07:50,192 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Table flushed: new size = 1939095
2015-08-10 19:07:52,746 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Tbl flush: #hash table = 2154551
2015-08-10 19:07:53,800 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Table flushed: new size = 1939095
2015-08-10 19:09:56,338 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Tbl flush: #hash table = 2154551
2015-08-10 19:09:57,334 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Table flushed: new size = 1939095
2015-08-10 19:09:59,971 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Tbl flush: #hash table = 2154551
2015-08-10 19:10:01,028 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Table flushed: new size = 1939095
2015-08-10 19:11:54,096 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Tbl flush: #hash table = 2154551
2015-08-10 19:11:55,288 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Table flushed: new size = 1939095
2015-08-10 19:11:57,835 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Tbl flush: #hash table = 2152931
2015-08-10 19:11:59,107 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Table flushed: new size = 1937637
2015-08-10 19:12:02,007 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Tbl flush: #hash table = 2152931
2015-08-10 19:12:03,236 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Table flushed: new size = 1937637
2015-08-10 19:13:54,021 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Tbl flush: #hash table = 2152931
2015-08-10 19:13:55,153 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Table flushed: new size = 1937637
2015-08-10 19:13:57,500 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Tbl flush: #hash table = 2152931
2015-08-10 19:13:58,584 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Table flushed: new size = 1937637
2015-08-10 19:14:01,367 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Tbl flush: #hash table = 2151313
2015-08-10 19:14:02,439 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Table flushed: new size = 1936181
2015-08-10 19:14:05,399 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Tbl flush: #hash table = 2151313
2015-08-10 19:14:06,443 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Table flushed: new size = 1936181
2015-08-10 19:14:09,182 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Tbl flush: #hash table = 2151313
2015-08-10 19:14:10,396 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Table flushed: new size = 1936181
2015-08-10 19:14:13,048 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Tbl flush: #hash table = 2151313
2015-08-10 19:14:14,204 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Table flushed: new size = 1936181
2015-08-10 19:14:17,036 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Tbl flush: #hash table = 2149698
2015-08-10 19:14:18,102 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Table flushed: new size = 1934728
2015-08-10 19:14:20,777 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Tbl flush: #hash table = 2149698
2015-08-10 19:14:22,042 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Table flushed: new size = 1934728
2015-08-10 19:14:24,710 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Tbl flush: #hash table = 2149698
2015-08-10 19:14:25,792 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Table flushed: new size = 1934728
2015-08-10 19:14:28,705 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Tbl flush: #hash table = 2149698
2015-08-10 19:14:29,755 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Table flushed: new size = 1934728
2015-08-10 19:14:32,429 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Tbl flush: #hash table = 2149698
2015-08-10 19:14:33,501 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Table flushed: new size = 1934728
2015-08-10 19:14:36,282 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Tbl flush: #hash table = 2148086
2015-08-10 19:14:37,356 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Table flushed: new size = 1933277
2015-08-10 19:14:40,239 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Tbl flush: #hash table = 2148086
2015-08-10 19:14:41,407 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Table flushed: new size = 1933277
2015-08-10 19:14:44,078 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Tbl flush: #hash table = 2148086
2015-08-10 19:14:45,146 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Table flushed: new size = 1933277
2015-08-10 19:14:47,884 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Tbl flush: #hash table = 2148086
2015-08-10 19:14:48,955 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Table flushed: new size = 1933277
2015-08-10 19:14:51,565 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Tbl flush: #hash table = 2148086
2015-08-10 19:14:52,964 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Table flushed: new size = 1933277
2015-08-10 19:14:55,532 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Tbl flush: #hash table = 2146475
2015-08-10 19:14:56,613 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Table flushed: new size = 1931827
2015-08-10 19:14:59,524 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Tbl flush: #hash table = 2146475
2015-08-10 19:15:00,597 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Table flushed: new size = 1931827
2015-08-10 19:15:03,238 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Tbl flush: #hash table = 2146475
2015-08-10 19:15:04,526 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Table flushed: new size = 1931827
2015-08-10 19:15:07,295 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Tbl flush: #hash table = 2146475
2015-08-10 19:15:08,366 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Table flushed: new size = 1931827
2015-08-10 19:15:11,184 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Tbl flush: #hash table = 2146475
2015-08-10 19:15:12,216 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Table flushed: new size = 1931827
2015-08-10 19:15:14,946 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Tbl flush: #hash table = 2146475
2015-08-10 19:15:16,036 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Table flushed: new size = 1931827
2015-08-10 19:15:18,718 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Tbl flush: #hash table = 2144868
2015-08-10 19:15:19,784 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Table flushed: new size = 1930381
2015-08-10 19:15:22,606 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Tbl flush: #hash table = 2144868
2015-08-10 19:15:23,851 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Table flushed: new size = 1930381
2015-08-10 19:15:26,496 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Tbl flush: #hash table = 2144868
2015-08-10 19:15:27,593 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Table flushed: new size = 1930381
2015-08-10 19:15:30,543 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Tbl flush: #hash table = 2144868
2015-08-10 19:15:31,605 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Table flushed: new size = 1930381
2015-08-10 19:15:34,226 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Tbl flush: #hash table = 2144868
2015-08-10 19:15:35,326 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Table flushed: new size = 1930381
2015-08-10 19:15:38,224 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Tbl flush: #hash table = 2144868
2015-08-10 19:15:39,337 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Table flushed: new size = 1930381
2015-08-10 19:15:42,025 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Tbl flush: #hash table = 2143262
2015-08-10 19:15:43,202 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Table flushed: new size = 1928935
2015-08-10 19:15:46,033 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Tbl flush: #hash table = 2143262
2015-08-10 19:15:47,136 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Table flushed: new size = 1928935
2015-08-10 19:15:50,001 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Tbl flush: #hash table = 2143262
2015-08-10 19:15:51,097 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Table flushed: new size = 1928935
2015-08-10 19:15:53,753 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Tbl flush: #hash table = 2143262
2015-08-10 19:15:54,829 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Table flushed: new size = 1928935
2015-08-10 19:15:57,631 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Tbl flush: #hash table = 2143262
2015-08-10 19:15:58,836 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Table flushed: new size = 1928935
2015-08-10 19:16:01,475 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Tbl flush: #hash table = 2143262
2015-08-10 19:16:02,554 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Table flushed: new size = 1928935
2015-08-10 19:16:05,295 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Tbl flush: #hash table = 2143262
2015-08-10 19:16:06,413 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Table flushed: new size = 1928935
2015-08-10 19:16:09,026 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Tbl flush: #hash table = 2141659
2015-08-10 19:16:10,179 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Table flushed: new size = 1927493
2015-08-10 19:16:12,917 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Tbl flush: #hash table = 2141659
2015-08-10 19:16:13,988 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Table flushed: new size = 1927493
2015-08-10 19:16:16,622 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Tbl flush: #hash table = 2141659
2015-08-10 19:16:17,839 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Table flushed: new size = 1927493
2015-08-10 19:16:20,505 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Tbl flush: #hash table = 2141659
2015-08-10 19:16:21,571 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Table flushed: new size = 1927493
2015-08-10 19:16:24,272 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Tbl flush: #hash table = 2141659
2015-08-10 19:16:25,290 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Table flushed: new size = 1927493
2015-08-10 19:16:27,817 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Tbl flush: #hash table = 2141659
2015-08-10 19:16:29,070 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Table flushed: new size = 1927493
2015-08-10 19:16:31,859 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Tbl flush: #hash table = 2141659
2015-08-10 19:16:32,903 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Table flushed: new size = 1927493
2015-08-10 19:16:35,517 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Tbl flush: #hash table = 2140058
2015-08-10 19:16:36,586 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Table flushed: new size = 1926052
2015-08-10 19:16:39,335 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Tbl flush: #hash table = 2140058
2015-08-10 19:16:40,393 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Table flushed: new size = 1926052
2015-08-10 19:16:43,209 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Tbl flush: #hash table = 2140058
2015-08-10 19:16:44,288 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Table flushed: new size = 1926052
2015-08-10 19:16:46,966 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Tbl flush: #hash table = 2140058
2015-08-10 19:16:48,064 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Table flushed: new size = 1926052
2015-08-10 19:16:50,662 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Tbl flush: #hash table = 2140058
2015-08-10 19:16:51,962 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Table flushed: new size = 1926052
2015-08-10 19:16:54,559 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Tbl flush: #hash table = 2140058
2015-08-10 19:16:55,656 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Table flushed: new size = 1926052
2015-08-10 19:16:58,488 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Tbl flush: #hash table = 2140058
2015-08-10 19:16:59,671 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Table flushed: new size = 1926052
2015-08-10 19:17:02,108 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Tbl flush: #hash table = 2140058
2015-08-10 19:17:03,178 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Table flushed: new size = 1926052
2015-08-10 19:17:05,828 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Tbl flush: #hash table = 2138460
1 REPLY 1

Re: org.apache.hadoop.hive.ql.exec.GroupByOperator: Hash Tbl flush

Master Guru
Does the same happen if you set hive.auto.convert.join to false?

Also try to increase the CLI heap (if this is a Hive CLI command) via the below:

export HADOOP_CLIENT_OPTS="-Xmx5g"

And then re-run the same query.