2018-08-07T16:29:12,750 INFO [HiveServer2-Handler-Pool: Thread-53] ql.Driver: Compiling command(queryId=hive_20180807162912_519c1503-c151-4da7-b5a2-bd067e9c 42b9): insert into default.temp_tro (str1,str2,str3) select str1,str2,str3 from bddbm_db.temp_large_table3 2018-08-07T16:29:12,752 INFO [HiveServer2-Handler-Pool: Thread-53] parse.CalcitePlanner: Starting Semantic Analysis 2018-08-07T16:29:12,907 INFO [HiveServer2-Handler-Pool: Thread-53] parse.CalcitePlanner: Completed phase 1 of Semantic Analysis 2018-08-07T16:29:12,907 INFO [HiveServer2-Handler-Pool: Thread-53] parse.CalcitePlanner: Get metadata for source tables 2018-08-07T16:29:13,023 INFO [HiveServer2-Handler-Pool: Thread-53] parse.CalcitePlanner: Get metadata for subqueries 2018-08-07T16:29:13,023 INFO [HiveServer2-Handler-Pool: Thread-53] parse.CalcitePlanner: Get metadata for destination tables 2018-08-07T16:29:13,138 INFO [HiveServer2-Handler-Pool: Thread-53] parse.CalcitePlanner: Completed getting MetaData in Semantic Analysis 2018-08-07T16:29:13,140 WARN [HiveServer2-Handler-Pool: Thread-53] serde2.AbstractEncodingAwareSerDe: The data may not be properly converted to target chars et ISO-8859-1 2018-08-07T16:29:13,253 INFO [HiveServer2-Handler-Pool: Thread-53] parse.CalcitePlanner: Get metadata for source tables 2018-08-07T16:29:13,368 INFO [HiveServer2-Handler-Pool: Thread-53] parse.CalcitePlanner: Get metadata for subqueries 2018-08-07T16:29:13,368 INFO [HiveServer2-Handler-Pool: Thread-53] parse.CalcitePlanner: Get metadata for destination tables 2018-08-07T16:29:13,483 WARN [HiveServer2-Handler-Pool: Thread-53] serde2.AbstractEncodingAwareSerDe: The data may not be properly converted to target chars et ISO-8859-1 2018-08-07T16:29:13,485 INFO [HiveServer2-Handler-Pool: Thread-53] common.FileUtils: Creating directory if it doesn't exist: hdfs://edhcluster/tmp/hive/stag ing_hive_2018-08-07_16-29-12_750_8973639287951385407-1 2018-08-07T16:29:13,551 WARN [HiveServer2-Handler-Pool: Thread-53] serde2.AbstractEncodingAwareSerDe: The data may not be properly converted to target chars et ISO-8859-1 2018-08-07T16:29:13,552 WARN [HiveServer2-Handler-Pool: Thread-53] serde2.AbstractEncodingAwareSerDe: The data may not be properly converted to target chars et ISO-8859-1 2018-08-07T16:29:13,552 WARN [HiveServer2-Handler-Pool: Thread-53] serde2.AbstractEncodingAwareSerDe: The data may not be properly converted to target chars et ISO-8859-1 2018-08-07T16:29:13,552 INFO [HiveServer2-Handler-Pool: Thread-53] parse.CalcitePlanner: CBO Succeeded; optimized logical plan. 2018-08-07T16:29:13,552 INFO [HiveServer2-Handler-Pool: Thread-53] ppd.OpProcFactory: Processing for FS(2) 2018-08-07T16:29:13,552 INFO [HiveServer2-Handler-Pool: Thread-53] ppd.OpProcFactory: Processing for SEL(1) 2018-08-07T16:29:13,552 INFO [HiveServer2-Handler-Pool: Thread-53] ppd.OpProcFactory: Processing for TS(0) 2018-08-07T16:29:13,554 INFO [HiveServer2-Handler-Pool: Thread-53] parse.TezCompiler: Cycle free: true 2018-08-07T16:29:13,555 INFO [HiveServer2-Handler-Pool: Thread-53] parse.CalcitePlanner: Completed plan generation 2018-08-07T16:29:13,555 INFO [HiveServer2-Handler-Pool: Thread-53] ql.Driver: Semantic Analysis Completed 2018-08-07T16:29:13,555 INFO [HiveServer2-Handler-Pool: Thread-53] ql.Driver: Returning Hive schema: Schema(fieldSchemas:[FieldSchema(name:_col0, type:strin g, comment:null), FieldSchema(name:_col1, type:string, comment:null), FieldSchema(name:_col2, type:string, comment:null)], properties:null) 2018-08-07T16:29:13,722 INFO [HiveServer2-Handler-Pool: Thread-53] ql.Driver: Completed compiling command(queryId=hive_20180807162912_519c1503-c151-4da7-b5a 2-bd067e9c42b9); Time taken: 0.972 seconds 2018-08-07T16:29:13,723 INFO [HiveServer2-Handler-Pool: Thread-53] session.SessionState: Resetting thread name to HiveServer2-Handler-Pool: Thread-53 2018-08-07T16:29:13,723 INFO [HiveServer2-Background-Pool: Thread-1549] lockmgr.DbTxnManager: Setting lock request transaction to txnid:0 for queryId=hive_2 0180807162912_519c1503-c151-4da7-b5a2-bd067e9c42b9 2018-08-07T16:29:13,724 INFO [HiveServer2-Background-Pool: Thread-1549] lockmgr.DbLockManager: Requesting: queryId=hive_20180807162912_519c1503-c151-4da7-b5 a2-bd067e9c42b9 LockRequest(component:[LockComponent(type:EXCLUSIVE, level:TABLE, dbname:default, tablename:temp_tro, operationType:INSERT, isAcid:false), Lo ckComponent(type:SHARED_READ, level:TABLE, dbname:bddbm_db, tablename:temp_large_table3, operationType:SELECT)], txnid:0, user:hive, hostname:bdtst1b.serverd ev.hadev.org.hk, agentInfo:hive_20180807162912_519c1503-c151-4da7-b5a2-bd067e9c42b9) 2018-08-07T16:29:13,765 INFO [HiveServer2-Background-Pool: Thread-1549] lockmgr.DbLockManager: Response to queryId=hive_20180807162912_519c1503-c151-4da7-b5 a2-bd067e9c42b9 LockResponse(lockid:25854, state:ACQUIRED) 2018-08-07T16:29:13,765 INFO [HiveServer2-Background-Pool: Thread-1549] lockmgr.DbTxnManager: Started heartbeat with delay/interval = 150000/150000 MILLISEC ONDS for query: hive_20180807162912_519c1503-c151-4da7-b5a2-bd067e9c42b9 2018-08-07T16:29:13,765 INFO [HiveServer2-Background-Pool: Thread-1549] ql.Driver: Executing command(queryId=hive_20180807162912_519c1503-c151-4da7-b5a2-bd0 67e9c42b9): insert into default.temp_tro (str1,str2,str3) select str1,str2,str3 from bddbm_db.temp_large_table3 2018-08-07T16:29:13,765 INFO [HiveServer2-Background-Pool: Thread-1549] ql.Driver: Query ID = hive_20180807162912_519c1503-c151-4da7-b5a2-bd067e9c42b9 2018-08-07T16:29:13,765 INFO [HiveServer2-Background-Pool: Thread-1549] ql.Driver: Total jobs = 1 2018-08-07T16:29:13,766 INFO [HiveServer2-Background-Pool: Thread-1549] ql.Driver: Launching Job 1 out of 1 2018-08-07T16:29:13,766 INFO [HiveServer2-Background-Pool: Thread-1549] ql.Driver: Starting task [Stage-1:MAPRED] in serial mode 2018-08-07T16:29:13,766 INFO [HiveServer2-Background-Pool: Thread-1549] tez.TezSessionPoolManager: The current user: hive, session user: hive 2018-08-07T16:29:13,766 INFO [HiveServer2-Background-Pool: Thread-1549] tez.TezSessionPoolManager: Current queue name is null incoming queue name is null 2018-08-07T16:29:13,826 INFO [HiveServer2-Background-Pool: Thread-1549] ql.Context: New scratch dir is hdfs://edhcluster/tmp/hive/scratch/hive/0887b266-675a -4fb2-8c85-3a27ebb3b9fc/hive_2018-08-07_16-29-12_750_8973639287951385407-3 2018-08-07T16:29:13,850 INFO [HiveServer2-Background-Pool: Thread-1549] exec.Task: Session is already open 2018-08-07T16:29:13,851 INFO [HiveServer2-Background-Pool: Thread-1549] tez.DagUtils: Resource modification time: 1533629937001 for hdfs://edhcluster/tmp/hi ve/scratch/hive/_tez_session_dir/e2dfe4df-37f0-4d95-946d-30557075f807/zookeeper-3.4.10.jar 2018-08-07T16:29:13,852 INFO [HiveServer2-Background-Pool: Thread-1549] tez.DagUtils: Resource modification time: 1533629937195 for hdfs://edhcluster/tmp/hi ve/scratch/hive/_tez_session_dir/e2dfe4df-37f0-4d95-946d-30557075f807/hive-hbase-handler-2.1.1.jar 2018-08-07T16:29:13,853 INFO [HiveServer2-Background-Pool: Thread-1549] tez.DagUtils: Resource modification time: 1533629937736 for hdfs://edhcluster/tmp/hi ve/scratch/hive/_tez_session_dir/e2dfe4df-37f0-4d95-946d-30557075f807/guava-14.0.1.jar 2018-08-07T16:29:13,853 INFO [HiveServer2-Background-Pool: Thread-1549] tez.DagUtils: Resource modification time: 1533629938102 for hdfs://edhcluster/tmp/hi ve/scratch/hive/_tez_session_dir/e2dfe4df-37f0-4d95-946d-30557075f807/hbase-client-1.2.5.jar 2018-08-07T16:29:13,854 INFO [HiveServer2-Background-Pool: Thread-1549] tez.DagUtils: Resource modification time: 1533629938327 for hdfs://edhcluster/tmp/hi ve/scratch/hive/_tez_session_dir/e2dfe4df-37f0-4d95-946d-30557075f807/hbase-common-1.2.5.jar 2018-08-07T16:29:13,854 INFO [HiveServer2-Background-Pool: Thread-1549] tez.DagUtils: Resource modification time: 1533629939312 for hdfs://edhcluster/tmp/hi ve/scratch/hive/_tez_session_dir/e2dfe4df-37f0-4d95-946d-30557075f807/hbase-protocol-1.2.5.jar 2018-08-07T16:29:13,855 INFO [HiveServer2-Background-Pool: Thread-1549] tez.DagUtils: Resource modification time: 1533629940242 for hdfs://edhcluster/tmp/hi ve/scratch/hive/_tez_session_dir/e2dfe4df-37f0-4d95-946d-30557075f807/hbase-server-1.2.5.jar 2018-08-07T16:29:13,855 INFO [HiveServer2-Background-Pool: Thread-1549] tez.DagUtils: Resource modification time: 1533629940459 for hdfs://edhcluster/tmp/hi ve/scratch/hive/_tez_session_dir/e2dfe4df-37f0-4d95-946d-30557075f807/hadoop-distcp-2.7.3.jar 2018-08-07T16:29:13,856 INFO [HiveServer2-Background-Pool: Thread-1549] exec.Task: Dag name: insert into default.t...db.temp_large_table3(Stage-1) 2018-08-07T16:29:13,856 INFO [HiveServer2-Background-Pool: Thread-1549] ql.Context: New scratch dir is hdfs://edhcluster/tmp/hive/scratch/hive/0887b266-675a -4fb2-8c85-3a27ebb3b9fc/hive_2018-08-07_16-29-12_750_8973639287951385407-3 2018-08-07T16:29:13,900 INFO [HiveServer2-Background-Pool: Thread-1549] tez.DagUtils: Vertex has custom input? false 2018-08-07T16:29:13,901 INFO [HiveServer2-Background-Pool: Thread-1549] exec.SerializationUtilities: Serializing MapWork using kryo 2018-08-07T16:29:13,903 INFO [HiveServer2-Background-Pool: Thread-1549] exec.Utilities: Setting plan: /tmp/hive/scratch/hive/0887b266-675a-4fb2-8c85-3a27ebb 3b9fc/hive_2018-08-07_16-29-12_750_8973639287951385407-3/hive/_tez_scratch_dir/6f4620d8-310c-4aff-bbe8-6f69ea9d1341/map.xml 2018-08-07T16:29:13,934 INFO [HiveServer2-Background-Pool: Thread-1549] fs.FSStatsPublisher: created : hdfs://edhcluster/tmp/hive/staging_hive_2018-08-07_16 -29-12_750_8973639287951385407-1/-ext-10001 2018-08-07T16:29:13,938 INFO [HiveServer2-Background-Pool: Thread-1549] client.TezClient: Submitting dag to TezSession, sessionName=HIVE-e2dfe4df-37f0-4d95- 946d-30557075f807, applicationId=application_1533623337748_0148, dagName=insert into default.t...db.temp_large_table3(Stage-1), callerContext={ context=HIVE, callerType=HIVE_QUERY_ID, callerId=hive_20180807162912_519c1503-c151-4da7-b5a2-bd067e9c42b9 } 2018-08-07T16:29:14,127 INFO [HiveServer2-Background-Pool: Thread-1549] client.TezClient: Submitted dag to TezSession, sessionName=HIVE-e2dfe4df-37f0-4d95-9 46d-30557075f807, applicationId=application_1533623337748_0148, dagId=dag_1533623337748_0148_2, dagName=insert into default.t...db.temp_large_table3(Stage-1) 2018-08-07T16:29:14,185 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: 2018-08-07T16:29:14,390 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Status: Running (Executing on YARN cluster with App id application_153 3623337748_0148) 2018-08-07T16:29:14,390 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 0/171 2018-08-07T16:29:16,600 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 0(+3)/171 2018-08-07T16:29:16,800 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 0(+4)/171 2018-08-07T16:29:17,808 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 0(+7)/171 2018-08-07T16:29:19,013 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 0(+9)/171 2018-08-07T16:29:19,214 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 0(+12)/171 2018-08-07T16:29:20,219 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 0(+14)/171 2018-08-07T16:29:20,420 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 0(+15)/171 2018-08-07T16:29:21,224 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 0(+16)/171 2018-08-07T16:29:21,626 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 0(+18)/171 2018-08-07T16:29:22,431 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 0(+19)/171 2018-08-07T16:29:22,833 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 0(+21)/171 2018-08-07T16:29:23,235 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 0(+22)/171 2018-08-07T16:29:23,639 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 0(+24)/171 2018-08-07T16:29:24,248 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 0(+25)/171 2018-08-07T16:29:24,449 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 0(+26)/171 2018-08-07T16:29:24,650 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 0(+28)/171 2018-08-07T16:29:25,863 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 0(+31)/171 2018-08-07T16:29:26,678 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 0(+32)/171 2018-08-07T16:29:27,686 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 0(+34)/171 2018-08-07T16:29:27,893 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 0(+35)/171 2018-08-07T16:29:28,503 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 0(+36)/171 2018-08-07T16:29:28,704 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 0(+37)/171 2018-08-07T16:29:28,906 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 0(+39)/171 2018-08-07T16:29:29,509 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 0(+40)/171 2018-08-07T16:29:29,911 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 0(+41)/171 2018-08-07T16:29:30,113 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 0(+42)/171 2018-08-07T16:29:30,314 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 0(+44)/171 2018-08-07T16:29:31,324 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 0(+45)/171 2018-08-07T16:29:31,525 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 0(+48)/171 2018-08-07T16:29:31,726 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 0(+49)/171 2018-08-07T16:29:32,530 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 0(+51)/171 2018-08-07T16:29:32,735 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 0(+52)/171 2018-08-07T16:29:32,936 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 0(+53)/171 2018-08-07T16:29:33,549 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 0(+55)/171 2018-08-07T16:29:34,363 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 0(+57)/171 2018-08-07T16:29:35,769 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 0(+59)/171 2018-08-07T16:29:36,171 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 0(+61)/171 2018-08-07T16:29:36,581 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 0(+63)/171 2018-08-07T16:29:37,199 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 0(+64)/171 2018-08-07T16:29:38,035 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 0(+65)/171 2018-08-07T16:29:38,447 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 0(+66)/171 2018-08-07T16:29:38,648 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 0(+68)/171 2018-08-07T16:29:38,857 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 0(+69)/171 2018-08-07T16:29:39,679 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 0(+70)/171 2018-08-07T16:29:39,887 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 0(+72)/171 2018-08-07T16:29:40,088 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 0(+73)/171 2018-08-07T16:29:40,306 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 0(+74)/171 2018-08-07T16:29:40,708 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 0(+76)/171 2018-08-07T16:29:41,321 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 0(+78)/171 2018-08-07T16:29:41,522 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 0(+79)/171 2018-08-07T16:29:42,527 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 0(+80)/171 2018-08-07T16:29:43,130 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 0(+82)/171 2018-08-07T16:29:43,331 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 0(+84)/171 2018-08-07T16:29:44,135 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 0(+85)/171 2018-08-07T16:29:44,338 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 0(+87)/171 2018-08-07T16:29:44,539 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 0(+88)/171 2018-08-07T16:29:44,740 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 0(+89)/171 2018-08-07T16:29:45,349 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 0(+90)/171 2018-08-07T16:29:45,751 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 0(+91)/171 2018-08-07T16:29:45,952 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 0(+92)/171 2018-08-07T16:29:46,153 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 0(+93)/171 2018-08-07T16:29:46,756 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 0(+94)/171 2018-08-07T16:29:47,559 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 0(+95)/171 2018-08-07T16:29:47,961 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 0(+96)/171 2018-08-07T16:29:48,564 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 0(+97)/171 2018-08-07T16:29:51,602 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 0(+97)/171 2018-08-07T16:29:54,625 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 0(+97)/171 2018-08-07T16:29:56,054 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 0(+98)/171 2018-08-07T16:29:59,362 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 0(+98)/171 2018-08-07T16:30:02,422 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 0(+98)/171 2018-08-07T16:30:05,473 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 0(+98)/171 2018-08-07T16:30:08,524 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 0(+98)/171 2018-08-07T16:30:11,557 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 0(+98)/171 2018-08-07T16:30:14,609 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 0(+98)/171 2018-08-07T16:30:17,656 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 0(+98)/171 2018-08-07T16:30:20,945 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 0(+98)/171 2018-08-07T16:30:23,994 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 0(+98)/171 2018-08-07T16:30:27,039 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 0(+98)/171 2018-08-07T16:30:30,092 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 0(+98)/171 2018-08-07T16:30:33,331 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 0(+98)/171 2018-08-07T16:30:36,378 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 0(+98)/171 2018-08-07T16:30:39,418 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 0(+98)/171 2018-08-07T16:30:42,453 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 0(+98)/171 2018-08-07T16:30:45,765 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 0(+98)/171 2018-08-07T16:30:48,794 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 0(+98)/171 2018-08-07T16:30:51,856 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 0(+98)/171 2018-08-07T16:30:53,805 INFO [HiveServer2-Handler-Pool: Thread-53] session.SessionState: Updating thread name to 0887b266-675a-4fb2-8c85-3a27ebb3b9fc HiveSe rver2-Handler-Pool: Thread-53 2018-08-07T16:30:53,805 INFO [HiveServer2-Handler-Pool: Thread-53] session.SessionState: Resetting thread name to HiveServer2-Handler-Pool: Thread-53 2018-08-07T16:30:54,898 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 0(+98)/171 2018-08-07T16:30:58,184 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 0(+98)/171 2018-08-07T16:30:58,808 INFO [HiveServer2-Handler-Pool: Thread-53] session.SessionState: Updating thread name to 0887b266-675a-4fb2-8c85-3a27ebb3b9fc HiveSe rver2-Handler-Pool: Thread-53 2018-08-07T16:30:58,808 INFO [HiveServer2-Handler-Pool: Thread-53] session.SessionState: Resetting thread name to HiveServer2-Handler-Pool: Thread-53 2018-08-07T16:31:01,234 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 0(+98)/171 2018-08-07T16:31:04,290 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 0(+98)/171 2018-08-07T16:31:07,322 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 0(+98)/171 2018-08-07T16:31:10,373 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 0(+98)/171 2018-08-07T16:31:13,403 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 0(+98)/171 2018-08-07T16:31:16,455 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 0(+98)/171 2018-08-07T16:31:19,560 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 0(+98)/171 2018-08-07T16:31:22,598 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 0(+98)/171 2018-08-07T16:31:25,620 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 0(+98)/171 2018-08-07T16:31:28,941 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 0(+98)/171 2018-08-07T16:31:31,987 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 0(+98)/171 2018-08-07T16:31:35,017 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 0(+98)/171 2018-08-07T16:31:38,078 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 0(+98)/171 2018-08-07T16:31:41,125 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 0(+98)/171 2018-08-07T16:31:43,765 INFO [Heartbeater-3] lockmgr.DbTxnManager: Sending heartbeat for txnid:0 and lockid:25854 queryId=hive_20180807162912_519c1503-c151- 4da7-b5a2-bd067e9c42b9 txnid:0 2018-08-07T16:31:44,189 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 0(+98)/171 2018-08-07T16:31:47,230 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 0(+98)/171 2018-08-07T16:31:50,283 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 0(+98)/171 2018-08-07T16:31:53,326 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 0(+98)/171 2018-08-07T16:31:56,397 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 0(+98)/171 2018-08-07T16:31:59,440 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 0(+98)/171 2018-08-07T16:32:02,483 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 0(+98)/171 2018-08-07T16:32:03,297 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 1(+97)/171 2018-08-07T16:32:03,698 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 1(+98)/171 2018-08-07T16:32:06,717 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 1(+98)/171 2018-08-07T16:32:09,769 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 1(+98)/171 2018-08-07T16:32:12,233 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 2(+97)/171 2018-08-07T16:32:12,846 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 3(+97)/171 2018-08-07T16:32:13,449 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 3(+98)/171 2018-08-07T16:32:16,510 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 3(+98)/171 2018-08-07T16:32:17,113 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 4(+97)/171 2018-08-07T16:32:17,917 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 4(+98)/171 2018-08-07T16:32:18,932 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 5(+97)/171 2018-08-07T16:32:19,543 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 5(+98)/171 2018-08-07T16:32:22,605 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 5(+98)/171 2018-08-07T16:32:23,015 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 6(+97)/171 2018-08-07T16:32:23,617 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 6(+98)/171 2018-08-07T16:32:24,230 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 7(+97)/171 2018-08-07T16:32:24,848 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 7(+98)/171 2018-08-07T16:32:25,861 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 8(+97)/171 2018-08-07T16:32:26,868 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 8(+98)/171 2018-08-07T16:32:27,473 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 9(+97)/171 2018-08-07T16:32:28,077 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 9(+98)/171 2018-08-07T16:32:31,132 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 9(+98)/171 2018-08-07T16:32:32,765 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 10(+97)/171 2018-08-07T16:32:33,584 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 10(+98)/171 2018-08-07T16:32:33,986 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 11(+97)/171 2018-08-07T16:32:34,397 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 12(+97)/171 2018-08-07T16:32:35,005 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 12(+98)/171 2018-08-07T16:32:36,816 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 13(+97)/171 2018-08-07T16:32:37,623 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 13(+98)/171 2018-08-07T16:32:38,027 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 14(+97)/171 2018-08-07T16:32:38,630 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 14(+98)/171 2018-08-07T16:32:41,685 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 15(+97)/171 2018-08-07T16:32:42,296 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 15(+98)/171 2018-08-07T16:32:42,697 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 17(+96)/171 2018-08-07T16:32:43,313 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 17(+98)/171 2018-08-07T16:32:43,523 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 18(+97)/171 2018-08-07T16:32:44,136 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 18(+98)/171 2018-08-07T16:32:45,148 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 19(+97)/171 2018-08-07T16:32:45,561 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 20(+96)/171 2018-08-07T16:32:45,762 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 20(+97)/171 2018-08-07T16:32:46,163 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 20(+98)/171 2018-08-07T16:32:48,584 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 21(+97)/171 2018-08-07T16:32:49,196 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 22(+97)/171 2018-08-07T16:32:50,002 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 22(+98)/171 2018-08-07T16:32:51,630 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 23(+97)/171 2018-08-07T16:32:51,831 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 24(+96)/171 2018-08-07T16:32:52,037 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 24(+97)/171 2018-08-07T16:32:52,238 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 24(+98)/171 2018-08-07T16:32:52,640 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 25(+97)/171 2018-08-07T16:32:52,841 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 26(+96)/171 2018-08-07T16:32:53,243 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 26(+97)/171 2018-08-07T16:32:53,444 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 27(+97)/171 2018-08-07T16:32:53,846 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 28(+96)/171 2018-08-07T16:32:54,053 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 28(+97)/171 2018-08-07T16:32:54,464 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 28(+98)/171 2018-08-07T16:32:54,665 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 30(+96)/171 2018-08-07T16:32:54,866 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 31(+95)/171 2018-08-07T16:32:55,276 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 31(+97)/171 2018-08-07T16:32:55,477 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 31(+98)/171 2018-08-07T16:32:58,531 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 31(+98)/171 2018-08-07T16:32:59,183 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 32(+97)/171 2018-08-07T16:32:59,786 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 32(+98)/171 2018-08-07T16:33:02,254 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 34(+96)/171 2018-08-07T16:33:02,455 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 35(+95)/171 2018-08-07T16:33:02,662 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 35(+97)/171 2018-08-07T16:33:03,063 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 36(+96)/171 2018-08-07T16:33:03,467 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 36(+97)/171 2018-08-07T16:33:03,869 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 36(+98)/171 2018-08-07T16:33:04,272 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 37(+97)/171 2018-08-07T16:33:05,075 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 38(+97)/171 2018-08-07T16:33:05,276 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 38(+96)/171 2018-08-07T16:33:05,482 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 39(+96)/171 2018-08-07T16:33:05,683 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 41(+94)/171 2018-08-07T16:33:05,884 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 41(+95)/171 2018-08-07T16:33:06,085 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 41(+96)/171 2018-08-07T16:33:06,286 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 41(+98)/171 2018-08-07T16:33:06,487 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 43(+96)/171 2018-08-07T16:33:07,101 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 43(+98)/171 2018-08-07T16:33:07,304 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 44(+97)/171 2018-08-07T16:33:07,505 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 45(+96)/171 2018-08-07T16:33:07,912 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 45(+97)/171 2018-08-07T16:33:08,113 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 45(+98)/171 2018-08-07T16:33:08,921 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 46(+97)/171 2018-08-07T16:33:09,927 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 46(+98)/171 2018-08-07T16:33:12,359 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 48(+96)/171 2018-08-07T16:33:12,969 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 49(+97)/171 2018-08-07T16:33:13,371 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 49(+98)/171 2018-08-07T16:33:13,575 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 50(+97)/171 2018-08-07T16:33:14,378 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 51(+97)/171 2018-08-07T16:33:14,581 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 52(+96)/171 2018-08-07T16:33:15,103 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 52(+98)/171 2018-08-07T16:33:16,921 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 53(+97)/171 2018-08-07T16:33:17,323 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 53(+98)/171 2018-08-07T16:33:17,938 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 55(+96)/171 2018-08-07T16:33:18,347 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 55(+97)/171 2018-08-07T16:33:18,548 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 55(+98)/171 2018-08-07T16:33:18,903 INFO [HiveServer2-Handler-Pool: Thread-53] session.SessionState: Updating thread name to 0887b266-675a-4fb2-8c85-3a27ebb3b9fc HiveSe rver2-Handler-Pool: Thread-53 2018-08-07T16:33:18,903 INFO [HiveServer2-Handler-Pool: Thread-53] session.SessionState: Resetting thread name to HiveServer2-Handler-Pool: Thread-53 2018-08-07T16:33:19,561 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 56(+97)/171 2018-08-07T16:33:19,972 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 56(+98)/171 2018-08-07T16:33:20,585 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 57(+97)/171 2018-08-07T16:33:20,996 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 58(+96)/171 2018-08-07T16:33:21,197 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 58(+97)/171 2018-08-07T16:33:21,605 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 58(+98)/171 2018-08-07T16:33:22,022 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 59(+97)/171 2018-08-07T16:33:22,628 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 59(+98)/171 2018-08-07T16:33:22,829 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 60(+97)/171 2018-08-07T16:33:23,632 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 62(+96)/171 2018-08-07T16:33:23,905 INFO [HiveServer2-Handler-Pool: Thread-53] session.SessionState: Updating thread name to 0887b266-675a-4fb2-8c85-3a27ebb3b9fc HiveSe rver2-Handler-Pool: Thread-53 2018-08-07T16:33:23,905 INFO [HiveServer2-Handler-Pool: Thread-53] session.SessionState: Resetting thread name to HiveServer2-Handler-Pool: Thread-53 2018-08-07T16:33:24,034 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 62(+98)/171 2018-08-07T16:33:26,278 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 63(+97)/171 2018-08-07T16:33:26,483 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 64(+96)/171 2018-08-07T16:33:26,684 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 65(+95)/171 2018-08-07T16:33:26,886 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 65(+96)/171 2018-08-07T16:33:27,094 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 65(+97)/171 2018-08-07T16:33:27,294 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 65(+98)/171 2018-08-07T16:33:28,700 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 66(+97)/171 2018-08-07T16:33:28,907 INFO [HiveServer2-Handler-Pool: Thread-53] session.SessionState: Updating thread name to 0887b266-675a-4fb2-8c85-3a27ebb3b9fc HiveSe rver2-Handler-Pool: Thread-53 2018-08-07T16:33:28,908 INFO [HiveServer2-Handler-Pool: Thread-53] session.SessionState: Resetting thread name to HiveServer2-Handler-Pool: Thread-53 2018-08-07T16:33:29,110 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 66(+98)/171 2018-08-07T16:33:30,129 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 68(+96)/171 2018-08-07T16:33:30,536 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 68(+97)/171 2018-08-07T16:33:30,737 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 68(+98)/171 2018-08-07T16:33:31,550 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 69(+97)/171 2018-08-07T16:33:32,162 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 70(+97)/171 2018-08-07T16:33:32,773 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 70(+98)/171 2018-08-07T16:33:32,981 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 71(+97)/171 2018-08-07T16:33:33,586 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 71(+98)/171 2018-08-07T16:33:36,630 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 71(+98)/171 2018-08-07T16:33:36,831 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 72(+97)/171 2018-08-07T16:33:37,263 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 72(+98)/171 2018-08-07T16:33:37,464 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 74(+96)/171 2018-08-07T16:33:38,077 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 75(+96)/171 2018-08-07T16:33:38,278 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 76(+95)/171 2018-08-07T16:33:38,884 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 77(+94)/171 2018-08-07T16:33:40,513 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 78(+93)/171 2018-08-07T16:33:41,526 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 79(+92)/171 2018-08-07T16:33:41,727 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 80(+91)/171 2018-08-07T16:33:42,932 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 81(+90)/171 2018-08-07T16:33:45,968 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 81(+90)/171 2018-08-07T16:33:46,169 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 82(+89)/171 2018-08-07T16:33:47,379 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 83(+88)/171 2018-08-07T16:33:48,191 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 84(+87)/171 2018-08-07T16:33:48,392 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 85(+86)/171 2018-08-07T16:33:48,593 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 86(+85)/171 2018-08-07T16:33:49,396 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 87(+84)/171 2018-08-07T16:33:51,821 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 88(+83)/171 2018-08-07T16:33:52,825 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 89(+82)/171 2018-08-07T16:33:55,053 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 90(+81)/171 2018-08-07T16:33:56,076 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 91(+80)/171 2018-08-07T16:33:57,288 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 92(+79)/171 2018-08-07T16:33:57,489 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 93(+78)/171 2018-08-07T16:33:58,727 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 94(+77)/171 2018-08-07T16:33:58,928 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 95(+76)/171 2018-08-07T16:34:00,340 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 96(+75)/171 2018-08-07T16:34:00,949 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 97(+74)/171 2018-08-07T16:34:01,970 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 98(+73)/171 2018-08-07T16:34:04,995 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 98(+73)/171 2018-08-07T16:34:08,028 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 98(+73)/171 2018-08-07T16:34:11,045 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 98(+73)/171 2018-08-07T16:34:13,765 INFO [Heartbeater-3] lockmgr.DbTxnManager: Sending heartbeat for txnid:0 and lockid:25854 queryId=hive_20180807162912_519c1503-c151- 4da7-b5a2-bd067e9c42b9 txnid:0 2018-08-07T16:34:13,939 INFO [HiveServer2-Handler-Pool: Thread-53] session.SessionState: Updating thread name to 0887b266-675a-4fb2-8c85-3a27ebb3b9fc HiveSe rver2-Handler-Pool: Thread-53 2018-08-07T16:34:13,939 INFO [HiveServer2-Handler-Pool: Thread-53] session.SessionState: Resetting thread name to HiveServer2-Handler-Pool: Thread-53 2018-08-07T16:34:14,135 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 98(+73)/171 2018-08-07T16:34:17,242 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 98(+73)/171 2018-08-07T16:34:18,941 INFO [HiveServer2-Handler-Pool: Thread-53] session.SessionState: Updating thread name to 0887b266-675a-4fb2-8c85-3a27ebb3b9fc HiveSe rver2-Handler-Pool: Thread-53 2018-08-07T16:34:18,941 INFO [HiveServer2-Handler-Pool: Thread-53] session.SessionState: Resetting thread name to HiveServer2-Handler-Pool: Thread-53 2018-08-07T16:34:20,270 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 98(+73)/171 2018-08-07T16:34:23,311 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 98(+73)/171 2018-08-07T16:34:23,943 INFO [HiveServer2-Handler-Pool: Thread-53] session.SessionState: Updating thread name to 0887b266-675a-4fb2-8c85-3a27ebb3b9fc HiveSe rver2-Handler-Pool: Thread-53 2018-08-07T16:34:23,944 INFO [HiveServer2-Handler-Pool: Thread-53] session.SessionState: Resetting thread name to HiveServer2-Handler-Pool: Thread-53 2018-08-07T16:34:26,361 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 98(+73)/171 2018-08-07T16:34:29,404 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 98(+73)/171 2018-08-07T16:34:32,514 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 98(+73)/171 2018-08-07T16:34:35,569 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 98(+73)/171 2018-08-07T16:34:38,799 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 98(+73)/171 2018-08-07T16:34:38,964 INFO [HiveServer2-Handler-Pool: Thread-53] session.SessionState: Updating thread name to 0887b266-675a-4fb2-8c85-3a27ebb3b9fc HiveSe rver2-Handler-Pool: Thread-53 2018-08-07T16:34:38,965 INFO [HiveServer2-Handler-Pool: Thread-53] session.SessionState: Resetting thread name to HiveServer2-Handler-Pool: Thread-53 2018-08-07T16:34:41,830 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 98(+73)/171 2018-08-07T16:34:43,967 INFO [HiveServer2-Handler-Pool: Thread-53] session.SessionState: Updating thread name to 0887b266-675a-4fb2-8c85-3a27ebb3b9fc HiveSe rver2-Handler-Pool: Thread-53 2018-08-07T16:34:43,967 INFO [HiveServer2-Handler-Pool: Thread-53] session.SessionState: Resetting thread name to HiveServer2-Handler-Pool: Thread-53 2018-08-07T16:34:44,861 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 98(+73)/171 2018-08-07T16:34:47,904 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 98(+73)/171 2018-08-07T16:34:48,969 INFO [HiveServer2-Handler-Pool: Thread-53] session.SessionState: Updating thread name to 0887b266-675a-4fb2-8c85-3a27ebb3b9fc HiveSe rver2-Handler-Pool: Thread-53 2018-08-07T16:34:48,969 INFO [HiveServer2-Handler-Pool: Thread-53] session.SessionState: Resetting thread name to HiveServer2-Handler-Pool: Thread-53 2018-08-07T16:34:51,029 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 98(+73)/171 2018-08-07T16:34:51,834 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 99(+72)/171 2018-08-07T16:34:53,971 INFO [HiveServer2-Handler-Pool: Thread-53] session.SessionState: Updating thread name to 0887b266-675a-4fb2-8c85-3a27ebb3b9fc HiveSe rver2-Handler-Pool: Thread-53 2018-08-07T16:34:53,972 INFO [HiveServer2-Handler-Pool: Thread-53] session.SessionState: Resetting thread name to HiveServer2-Handler-Pool: Thread-53 2018-08-07T16:34:54,862 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 99(+72)/171 2018-08-07T16:34:57,955 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 99(+72)/171 2018-08-07T16:34:58,974 INFO [HiveServer2-Handler-Pool: Thread-53] session.SessionState: Updating thread name to 0887b266-675a-4fb2-8c85-3a27ebb3b9fc HiveSe rver2-Handler-Pool: Thread-53 2018-08-07T16:34:58,974 INFO [HiveServer2-Handler-Pool: Thread-53] session.SessionState: Resetting thread name to HiveServer2-Handler-Pool: Thread-53 2018-08-07T16:35:00,988 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 99(+72)/171 2018-08-07T16:35:03,976 INFO [HiveServer2-Handler-Pool: Thread-53] session.SessionState: Updating thread name to 0887b266-675a-4fb2-8c85-3a27ebb3b9fc HiveSe rver2-Handler-Pool: Thread-53 2018-08-07T16:35:03,976 INFO [HiveServer2-Handler-Pool: Thread-53] session.SessionState: Resetting thread name to HiveServer2-Handler-Pool: Thread-53 2018-08-07T16:35:04,033 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 99(+72)/171 2018-08-07T16:35:07,106 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 99(+72)/171 2018-08-07T16:35:08,979 INFO [HiveServer2-Handler-Pool: Thread-53] session.SessionState: Updating thread name to 0887b266-675a-4fb2-8c85-3a27ebb3b9fc HiveSe rver2-Handler-Pool: Thread-53 2018-08-07T16:35:08,979 INFO [HiveServer2-Handler-Pool: Thread-53] session.SessionState: Resetting thread name to HiveServer2-Handler-Pool: Thread-53 2018-08-07T16:35:10,160 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 99(+72)/171 2018-08-07T16:35:12,589 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 100(+71)/171 2018-08-07T16:35:12,798 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 101(+70)/171 2018-08-07T16:35:13,503 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 102(+69)/171 2018-08-07T16:35:13,982 INFO [HiveServer2-Handler-Pool: Thread-53] session.SessionState: Updating thread name to 0887b266-675a-4fb2-8c85-3a27ebb3b9fc HiveSe rver2-Handler-Pool: Thread-53 2018-08-07T16:35:13,982 INFO [HiveServer2-Handler-Pool: Thread-53] session.SessionState: Resetting thread name to HiveServer2-Handler-Pool: Thread-53 2018-08-07T16:35:16,580 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 102(+69)/171 2018-08-07T16:35:17,585 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 103(+68)/171 2018-08-07T16:35:17,986 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 104(+67)/171 2018-08-07T16:35:18,984 INFO [HiveServer2-Handler-Pool: Thread-53] session.SessionState: Updating thread name to 0887b266-675a-4fb2-8c85-3a27ebb3b9fc HiveSe rver2-Handler-Pool: Thread-53 2018-08-07T16:35:18,985 INFO [HiveServer2-Handler-Pool: Thread-53] session.SessionState: Resetting thread name to HiveServer2-Handler-Pool: Thread-53 2018-08-07T16:35:21,028 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 104(+67)/171 2018-08-07T16:35:23,254 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 105(+66)/171 2018-08-07T16:35:23,986 INFO [HiveServer2-Handler-Pool: Thread-53] session.SessionState: Updating thread name to 0887b266-675a-4fb2-8c85-3a27ebb3b9fc HiveSe rver2-Handler-Pool: Thread-53 2018-08-07T16:35:23,987 INFO [HiveServer2-Handler-Pool: Thread-53] session.SessionState: Resetting thread name to HiveServer2-Handler-Pool: Thread-53 2018-08-07T16:35:24,671 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 106(+65)/171 2018-08-07T16:35:25,073 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 107(+64)/171 2018-08-07T16:35:25,876 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 108(+63)/171 2018-08-07T16:35:26,901 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 109(+62)/171 2018-08-07T16:35:27,101 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 110(+61)/171 2018-08-07T16:35:27,302 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 111(+60)/171 2018-08-07T16:35:28,925 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 112(+59)/171 2018-08-07T16:35:29,933 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 113(+58)/171 2018-08-07T16:35:31,548 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 114(+57)/171 2018-08-07T16:35:32,963 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 115(+56)/171 2018-08-07T16:35:33,368 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 116(+55)/171 2018-08-07T16:35:33,990 INFO [HiveServer2-Handler-Pool: Thread-53] session.SessionState: Updating thread name to 0887b266-675a-4fb2-8c85-3a27ebb3b9fc HiveSe rver2-Handler-Pool: Thread-53 2018-08-07T16:35:33,991 INFO [HiveServer2-Handler-Pool: Thread-53] session.SessionState: Resetting thread name to HiveServer2-Handler-Pool: Thread-53 2018-08-07T16:35:34,171 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 117(+54)/171 2018-08-07T16:35:34,372 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 118(+53)/171 2018-08-07T16:35:35,175 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 119(+52)/171 2018-08-07T16:35:35,376 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 120(+51)/171 2018-08-07T16:35:36,381 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 121(+50)/171 2018-08-07T16:35:36,582 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 122(+49)/171 2018-08-07T16:35:36,783 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 124(+47)/171 2018-08-07T16:35:38,790 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 125(+46)/171 2018-08-07T16:35:38,991 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 126(+45)/171 2018-08-07T16:35:38,992 INFO [HiveServer2-Handler-Pool: Thread-53] session.SessionState: Updating thread name to 0887b266-675a-4fb2-8c85-3a27ebb3b9fc HiveSe rver2-Handler-Pool: Thread-53 2018-08-07T16:35:38,992 INFO [HiveServer2-Handler-Pool: Thread-53] session.SessionState: Resetting thread name to HiveServer2-Handler-Pool: Thread-53 2018-08-07T16:35:39,392 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 127(+44)/171 2018-08-07T16:35:39,794 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 128(+43)/171 2018-08-07T16:35:40,396 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 129(+42)/171 2018-08-07T16:35:43,407 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 130(+41)/171 2018-08-07T16:35:43,994 INFO [HiveServer2-Handler-Pool: Thread-53] session.SessionState: Updating thread name to 0887b266-675a-4fb2-8c85-3a27ebb3b9fc HiveSe rver2-Handler-Pool: Thread-53 2018-08-07T16:35:43,994 INFO [HiveServer2-Handler-Pool: Thread-53] session.SessionState: Resetting thread name to HiveServer2-Handler-Pool: Thread-53 2018-08-07T16:35:44,013 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 131(+40)/171 2018-08-07T16:35:45,822 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 132(+39)/171 2018-08-07T16:35:47,026 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 136(+35)/171 2018-08-07T16:35:47,428 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 137(+34)/171 2018-08-07T16:35:48,431 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 138(+33)/171 2018-08-07T16:35:48,833 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 139(+32)/171 2018-08-07T16:35:48,996 INFO [HiveServer2-Handler-Pool: Thread-53] session.SessionState: Updating thread name to 0887b266-675a-4fb2-8c85-3a27ebb3b9fc HiveSe rver2-Handler-Pool: Thread-53 2018-08-07T16:35:48,996 INFO [HiveServer2-Handler-Pool: Thread-53] session.SessionState: Resetting thread name to HiveServer2-Handler-Pool: Thread-53 2018-08-07T16:35:49,434 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 140(+31)/171 2018-08-07T16:35:49,836 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 141(+30)/171 2018-08-07T16:35:50,037 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 143(+28)/171 2018-08-07T16:35:50,237 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 144(+27)/171 2018-08-07T16:35:50,840 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 146(+25)/171 2018-08-07T16:35:51,040 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 147(+24)/171 2018-08-07T16:35:51,643 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 149(+22)/171 2018-08-07T16:35:52,245 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 150(+21)/171 2018-08-07T16:35:52,446 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 152(+19)/171 2018-08-07T16:35:53,450 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 153(+18)/171 2018-08-07T16:35:53,998 INFO [HiveServer2-Handler-Pool: Thread-53] session.SessionState: Updating thread name to 0887b266-675a-4fb2-8c85-3a27ebb3b9fc HiveSe rver2-Handler-Pool: Thread-53 2018-08-07T16:35:53,998 INFO [HiveServer2-Handler-Pool: Thread-53] session.SessionState: Resetting thread name to HiveServer2-Handler-Pool: Thread-53 2018-08-07T16:35:54,253 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 156(+15)/171 2018-08-07T16:35:54,454 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 157(+14)/171 2018-08-07T16:35:54,654 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 158(+13)/171 2018-08-07T16:35:55,056 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 160(+11)/171 2018-08-07T16:35:55,658 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 161(+10)/171 2018-08-07T16:35:55,859 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 162(+9)/171 2018-08-07T16:35:56,060 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 163(+8)/171 2018-08-07T16:35:56,662 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 164(+7)/171 2018-08-07T16:35:57,264 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 165(+6)/171 2018-08-07T16:35:57,465 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 167(+4)/171 2018-08-07T16:35:57,665 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 168(+3)/171 2018-08-07T16:35:57,866 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 170(+1)/171 2018-08-07T16:35:57,955 INFO [HiveServer2-Background-Pool: Thread-1549] SessionState: Map 1: 171/171 2018-08-07T16:35:57,963 INFO [HiveServer2-Background-Pool: Thread-1549] exec.FileSinkOperator: Moving tmp dir: hdfs://edhcluster/tmp/hive/staging_hive_2018- 08-07_16-29-12_750_8973639287951385407-1/_tmp.-ext-10000 to: hdfs://edhcluster/tmp/hive/staging_hive_2018-08-07_16-29-12_750_8973639287951385407-1/-ext-10000 2018-08-07T16:35:57,996 INFO [HiveServer2-Background-Pool: Thread-1549] ql.Driver: Starting task [Stage-2:DEPENDENCY_COLLECTION] in serial mode 2018-08-07T16:35:57,996 INFO [HiveServer2-Background-Pool: Thread-1549] ql.Driver: Starting task [Stage-0:MOVE] in serial mode 2018-08-07T16:35:57,996 INFO [HiveServer2-Background-Pool: Thread-1549] exec.Task: Loading data to table default.temp_tro from hdfs://edhcluster/tmp/hive/st aging_hive_2018-08-07_16-29-12_750_8973639287951385407-1/-ext-10000 2018-08-07T16:35:58,158 INFO [HiveServer2-Background-Pool: Thread-1549] metadata.Hive: Copying source hdfs://edhcluster/tmp/hive/staging_hive_2018-08-07_16- 29-12_750_8973639287951385407-1/-ext-10000/000000_0 to hdfs://edhcluster/user/hive/warehouse/temp_tro/000000_0 because HDFS encryption zones are different. 2018-08-07T16:35:58,158 INFO [HiveServer2-Background-Pool: Thread-1549] common.FileUtils: Source is 129368810 bytes. (MAX: 33554432) 2018-08-07T16:35:58,158 INFO [HiveServer2-Background-Pool: Thread-1549] common.FileUtils: Launch distributed copy (distcp) job. 2018-08-07T16:35:58,239 INFO [HiveServer2-Background-Pool: Thread-1549] tools.DistCp: Input Options: DistCpOptions{atomicCommit=false, syncFolder=true, dele teMissing=false, ignoreFailures=false, maxMaps=20, sslConfigurationFile='null', copyStrategy='uniformsize', sourceFileListing=null, sourcePaths=[hdfs://edhcl uster/tmp/hive/staging_hive_2018-08-07_16-29-12_750_8973639287951385407-1/-ext-10000/000000_0], targetPath=hdfs://edhcluster/user/hive/warehouse/temp_tro/000 000_0, targetPathExists=false, preserveRawXattrs=false} 2018-08-07T16:35:58,288 INFO [HiveServer2-Background-Pool: Thread-1549] hdfs.DFSClient: Created HDFS_DELEGATION_TOKEN token 10139 for hive on ha-hdfs:edhclu ster 2018-08-07T16:35:58,295 INFO [HiveServer2-Background-Pool: Thread-1549] security.TokenCache: Got dt for hdfs://edhcluster; Kind: HDFS_DELEGATION_TOKEN, Serv ice: ha-hdfs:edhcluster, Ident: (HDFS_DELEGATION_TOKEN token 10139 for hive) 2018-08-07T16:35:58,295 WARN [HiveServer2-Background-Pool: Thread-1549] token.Token: Cannot find class for token kind kms-dt 2018-08-07T16:35:58,295 INFO [HiveServer2-Background-Pool: Thread-1549] security.TokenCache: Got dt for hdfs://edhcluster; Kind: kms-dt, Service: 160.88.112 .163:9393, Ident: 00 04 68 69 76 65 04 79 61 72 6e 04 68 69 76 65 8a 01 65 13 87 4a d6 8a 01 65 37 93 ce d6 8e 1d f6 24 2018-08-07T16:35:58,738 WARN [HiveServer2-Background-Pool: Thread-1549] token.Token: Cannot find class for token kind kms-dt 2018-08-07T16:35:58,738 INFO [HiveServer2-Background-Pool: Thread-1549] security.TokenCache: Got dt for hdfs://edhcluster; Kind: kms-dt, Service: 160.88.112 .162:9393, Ident: 00 04 68 69 76 65 04 79 61 72 6e 04 68 69 76 65 8a 01 65 13 87 4c 91 8a 01 65 37 93 d0 91 8e 1d 49 23 2018-08-07T16:35:58,745 WARN [HiveServer2-Background-Pool: Thread-1549] mapreduce.JobResourceUploader: Hadoop command-line option parsing not performed. Imp lement the Tool interface and execute your application with ToolRunner to remedy this. 2018-08-07T16:35:59,000 INFO [HiveServer2-Handler-Pool: Thread-53] session.SessionState: Updating thread name to 0887b266-675a-4fb2-8c85-3a27ebb3b9fc HiveSe rver2-Handler-Pool: Thread-53 2018-08-07T16:35:59,000 INFO [HiveServer2-Handler-Pool: Thread-53] session.SessionState: Resetting thread name to HiveServer2-Handler-Pool: Thread-53 2018-08-07T16:35:59,130 INFO [HiveServer2-Background-Pool: Thread-1549] mapreduce.JobSubmitter: number of splits:1 2018-08-07T16:35:59,313 INFO [HiveServer2-Background-Pool: Thread-1549] mapreduce.JobSubmitter: Submitting tokens for job: job_1533623337748_0215 2018-08-07T16:35:59,313 WARN [HiveServer2-Background-Pool: Thread-1549] token.Token: Cannot find class for token kind kms-dt 2018-08-07T16:35:59,313 INFO [HiveServer2-Background-Pool: Thread-1549] mapreduce.JobSubmitter: Kind: kms-dt, Service: 160.88.112.162:9393, Ident: 00 04 68 69 76 65 04 79 61 72 6e 04 68 69 76 65 8a 01 65 13 87 4c 91 8a 01 65 37 93 d0 91 8e 1d 49 23 2018-08-07T16:35:59,313 WARN [HiveServer2-Background-Pool: Thread-1549] token.Token: Cannot find class for token kind kms-dt 2018-08-07T16:35:59,313 INFO [HiveServer2-Background-Pool: Thread-1549] mapreduce.JobSubmitter: Kind: kms-dt, Service: 160.88.112.163:9393, Ident: 00 04 68 69 76 65 04 79 61 72 6e 04 68 69 76 65 8a 01 65 13 87 4a d6 8a 01 65 37 93 ce d6 8e 1d f6 24 2018-08-07T16:35:59,313 WARN [HiveServer2-Background-Pool: Thread-1549] token.Token: Cannot find class for token kind HIVE_DELEGATION_TOKEN 2018-08-07T16:35:59,313 INFO [HiveServer2-Background-Pool: Thread-1549] mapreduce.JobSubmitter: Kind: HIVE_DELEGATION_TOKEN, Service: HiveServer2Impersonati onToken, Ident: 00 04 68 69 76 65 04 68 69 76 65 00 8a 01 65 13 76 fe e0 8a 01 65 37 83 82 e0 01 8e 02 73 2018-08-07T16:35:59,313 INFO [HiveServer2-Background-Pool: Thread-1549] mapreduce.JobSubmitter: Kind: HDFS_DELEGATION_TOKEN, Service: ha-hdfs:edhcluster, Id ent: (HDFS_DELEGATION_TOKEN token 10139 for hive) 2018-08-07T16:35:59,520 INFO [HiveServer2-Background-Pool: Thread-1549] impl.YarnClientImpl: Submitted application application_1533623337748_0215 2018-08-07T16:35:59,521 INFO [HiveServer2-Background-Pool: Thread-1549] mapreduce.Job: The url to track the job: https://bdtst1a.serverdev.hadev.org.hk:8888 /proxy/application_1533623337748_0215/ 2018-08-07T16:35:59,521 INFO [HiveServer2-Background-Pool: Thread-1549] tools.DistCp: DistCp job-id: job_1533623337748_0215 2018-08-07T16:35:59,521 INFO [HiveServer2-Background-Pool: Thread-1549] mapreduce.Job: Running job: job_1533623337748_0215 2018-08-07T16:36:04,002 INFO [HiveServer2-Handler-Pool: Thread-53] session.SessionState: Updating thread name to 0887b266-675a-4fb2-8c85-3a27ebb3b9fc HiveSe rver2-Handler-Pool: Thread-53 2018-08-07T16:36:04,002 INFO [HiveServer2-Handler-Pool: Thread-53] session.SessionState: Resetting thread name to HiveServer2-Handler-Pool: Thread-53 2018-08-07T16:36:06,571 INFO [HiveServer2-Background-Pool: Thread-1549] mapreduce.Job: Job job_1533623337748_0215 running in uber mode : false 2018-08-07T16:36:06,571 INFO [HiveServer2-Background-Pool: Thread-1549] mapreduce.Job: map 0% reduce 0% 2018-08-07T16:36:09,004 INFO [HiveServer2-Handler-Pool: Thread-53] session.SessionState: Updating thread name to 0887b266-675a-4fb2-8c85-3a27ebb3b9fc HiveSe rver2-Handler-Pool: Thread-53 2018-08-07T16:36:09,004 INFO [HiveServer2-Handler-Pool: Thread-53] session.SessionState: Resetting thread name to HiveServer2-Handler-Pool: Thread-53 2018-08-07T16:36:14,006 INFO [HiveServer2-Handler-Pool: Thread-53] session.SessionState: Updating thread name to 0887b266-675a-4fb2-8c85-3a27ebb3b9fc HiveSe rver2-Handler-Pool: Thread-53 2018-08-07T16:36:14,006 INFO [HiveServer2-Handler-Pool: Thread-53] session.SessionState: Resetting thread name to HiveServer2-Handler-Pool: Thread-53 2018-08-07T16:36:18,603 INFO [HiveServer2-Background-Pool: Thread-1549] mapreduce.Job: map 100% reduce 0% 2018-08-07T16:36:19,007 INFO [HiveServer2-Handler-Pool: Thread-53] session.SessionState: Updating thread name to 0887b266-675a-4fb2-8c85-3a27ebb3b9fc HiveSe rver2-Handler-Pool: Thread-53 2018-08-07T16:36:19,007 INFO [HiveServer2-Handler-Pool: Thread-53] session.SessionState: Resetting thread name to HiveServer2-Handler-Pool: Thread-53 2018-08-07T16:36:24,009 INFO [HiveServer2-Handler-Pool: Thread-53] session.SessionState: Updating thread name to 0887b266-675a-4fb2-8c85-3a27ebb3b9fc HiveSe rver2-Handler-Pool: Thread-53 2018-08-07T16:36:24,009 INFO [HiveServer2-Handler-Pool: Thread-53] session.SessionState: Resetting thread name to HiveServer2-Handler-Pool: Thread-53 2018-08-07T16:36:29,010 INFO [HiveServer2-Handler-Pool: Thread-53] session.SessionState: Updating thread name to 0887b266-675a-4fb2-8c85-3a27ebb3b9fc HiveSe rver2-Handler-Pool: Thread-53 2018-08-07T16:36:29,010 INFO [HiveServer2-Handler-Pool: Thread-53] session.SessionState: Resetting thread name to HiveServer2-Handler-Pool: Thread-53 2018-08-07T16:36:34,012 INFO [HiveServer2-Handler-Pool: Thread-53] session.SessionState: Updating thread name to 0887b266-675a-4fb2-8c85-3a27ebb3b9fc HiveSe rver2-Handler-Pool: Thread-53 2018-08-07T16:36:34,012 INFO [HiveServer2-Handler-Pool: Thread-53] session.SessionState: Resetting thread name to HiveServer2-Handler-Pool: Thread-53 2018-08-07T16:36:37,641 INFO [HiveServer2-Background-Pool: Thread-1549] mapreduce.Job: Job job_1533623337748_0215 completed successfully 2018-08-07T16:36:37,664 INFO [HiveServer2-Background-Pool: Thread-1549] mapreduce.Job: Counters: 33 File System Counters FILE: Number of bytes read=0 FILE: Number of bytes written=297867 FILE: Number of read operations=0 FILE: Number of large read operations=0 FILE: Number of write operations=0 HDFS: Number of bytes read=129369232 HDFS: Number of bytes written=129368810 HDFS: Number of read operations=16 HDFS: Number of large read operations=0 HDFS: Number of write operations=4 Job Counters Launched map tasks=1 Other local map tasks=1 Total time spent by all maps in occupied slots (ms)=85701 Total time spent by all reduces in occupied slots (ms)=0 Total time spent by all map tasks (ms)=28567 Total vcore-milliseconds taken by all map tasks=28567 Total megabyte-milliseconds taken by all map tasks=571340000 Map-Reduce Framework Map input records=1 Map output records=0 Input split bytes=134 Spilled Records=0 Failed Shuffles=0 Merged Map outputs=0 GC time elapsed (ms)=84 CPU time spent (ms)=31920 Physical memory (bytes) snapshot=542441472 Virtual memory (bytes) snapshot=19353210880 Total committed heap usage (bytes)=826277888 File Input Format Counters Bytes Read=288 File Output Format Counters Bytes Written=0 org.apache.hadoop.tools.mapred.CopyMapper$Counter BYTESCOPIED=129368810 BYTESEXPECTED=129368810 COPY=1 2018-08-07T16:36:37,706 INFO [HiveServer2-Background-Pool: Thread-1549] metadata.Hive: Copying source hdfs://edhcluster/tmp/hive/staging_hive_2018-08-07_16- 29-12_750_8973639287951385407-1/-ext-10000/000001_0 to hdfs://edhcluster/user/hive/warehouse/temp_tro/000001_0 because HDFS encryption zones are different. 2018-08-07T16:36:37,706 INFO [HiveServer2-Background-Pool: Thread-1549] common.FileUtils: Source is 129368980 bytes. (MAX: 33554432) 2018-08-07T16:36:37,706 INFO [HiveServer2-Background-Pool: Thread-1549] common.FileUtils: Launch distributed copy (distcp) job. 2018-08-07T16:36:37,783 INFO [HiveServer2-Background-Pool: Thread-1549] tools.DistCp: Input Options: DistCpOptions{atomicCommit=false, syncFolder=true, dele teMissing=false, ignoreFailures=false, maxMaps=20, sslConfigurationFile='null', copyStrategy='uniformsize', sourceFileListing=null, sourcePaths=[hdfs://edhcl uster/tmp/hive/staging_hive_2018-08-07_16-29-12_750_8973639287951385407-1/-ext-10000/000001_0], targetPath=hdfs://edhcluster/user/hive/warehouse/temp_tro/000 001_0, targetPathExists=false, preserveRawXattrs=false} 2018-08-07T16:36:37,830 INFO [HiveServer2-Background-Pool: Thread-1549] hdfs.DFSClient: Created HDFS_DELEGATION_TOKEN token 10140 for hive on ha-hdfs:edhclu ster 2018-08-07T16:36:37,836 INFO [HiveServer2-Background-Pool: Thread-1549] security.TokenCache: Got dt for hdfs://edhcluster; Kind: HDFS_DELEGATION_TOKEN, Serv ice: ha-hdfs:edhcluster, Ident: (HDFS_DELEGATION_TOKEN token 10140 for hive) 2018-08-07T16:36:37,836 WARN [HiveServer2-Background-Pool: Thread-1549] token.Token: Cannot find class for token kind kms-dt 2018-08-07T16:36:37,836 INFO [HiveServer2-Background-Pool: Thread-1549] security.TokenCache: Got dt for hdfs://edhcluster; Kind: kms-dt, Service: 160.88.112 .163:9393, Ident: 00 04 68 69 76 65 04 79 61 72 6e 04 68 69 76 65 8a 01 65 13 87 e5 4b 8a 01 65 37 94 69 4b 8e 1d f7 24 2018-08-07T16:36:38,064 WARN [HiveServer2-Background-Pool: Thread-1549] token.Token: Cannot find class for token kind kms-dt 2018-08-07T16:36:38,064 INFO [HiveServer2-Background-Pool: Thread-1549] security.TokenCache: Got dt for hdfs://edhcluster; Kind: kms-dt, Service: 160.88.112 .162:9393, Ident: 00 04 68 69 76 65 04 79 61 72 6e 04 68 69 76 65 8a 01 65 13 87 e6 2e 8a 01 65 37 94 6a 2e 8e 1d 4a 23 2018-08-07T16:36:38,069 WARN [HiveServer2-Background-Pool: Thread-1549] mapreduce.JobResourceUploader: Hadoop command-line option parsing not performed. Imp lement the Tool interface and execute your application with ToolRunner to remedy this. 2018-08-07T16:36:38,480 INFO [HiveServer2-Background-Pool: Thread-1549] mapreduce.JobSubmitter: number of splits:1 2018-08-07T16:36:38,688 INFO [HiveServer2-Background-Pool: Thread-1549] mapreduce.JobSubmitter: Submitting tokens for job: job_1533623337748_0216 2018-08-07T16:36:38,688 WARN [HiveServer2-Background-Pool: Thread-1549] token.Token: Cannot find class for token kind kms-dt 2018-08-07T16:36:38,688 INFO [HiveServer2-Background-Pool: Thread-1549] mapreduce.JobSubmitter: Kind: kms-dt, Service: 160.88.112.162:9393, Ident: 00 04 68 69 76 65 04 79 61 72 6e 04 68 69 76 65 8a 01 65 13 87 e6 2e 8a 01 65 37 94 6a 2e 8e 1d 4a 23 2018-08-07T16:36:38,688 WARN [HiveServer2-Background-Pool: Thread-1549] token.Token: Cannot find class for token kind kms-dt 2018-08-07T16:36:38,688 INFO [HiveServer2-Background-Pool: Thread-1549] mapreduce.JobSubmitter: Kind: kms-dt, Service: 160.88.112.163:9393, Ident: 00 04 68 69 76 65 04 79 61 72 6e 04 68 69 76 65 8a 01 65 13 87 e5 4b 8a 01 65 37 94 69 4b 8e 1d f7 24 2018-08-07T16:36:38,688 WARN [HiveServer2-Background-Pool: Thread-1549] token.Token: Cannot find class for token kind HIVE_DELEGATION_TOKEN 2018-08-07T16:36:38,688 INFO [HiveServer2-Background-Pool: Thread-1549] mapreduce.JobSubmitter: Kind: HIVE_DELEGATION_TOKEN, Service: HiveServer2Impersonati onToken, Ident: 00 04 68 69 76 65 04 68 69 76 65 00 8a 01 65 13 76 fe e0 8a 01 65 37 83 82 e0 01 8e 02 73 2018-08-07T16:36:38,688 INFO [HiveServer2-Background-Pool: Thread-1549] mapreduce.JobSubmitter: Kind: HDFS_DELEGATION_TOKEN, Service: ha-hdfs:edhcluster, Id ent: (HDFS_DELEGATION_TOKEN token 10140 for hive) 2018-08-07T16:36:38,895 INFO [HiveServer2-Background-Pool: Thread-1549] impl.YarnClientImpl: Submitted application application_1533623337748_0216 2018-08-07T16:36:38,896 INFO [HiveServer2-Background-Pool: Thread-1549] mapreduce.Job: The url to track the job: https://bdtst1a.serverdev.hadev.org.hk:8888 /proxy/application_1533623337748_0216/ 2018-08-07T16:36:38,896 INFO [HiveServer2-Background-Pool: Thread-1549] tools.DistCp: DistCp job-id: job_1533623337748_0216 2018-08-07T16:36:38,896 INFO [HiveServer2-Background-Pool: Thread-1549] mapreduce.Job: Running job: job_1533623337748_0216 2018-08-07T16:36:39,014 INFO [HiveServer2-Handler-Pool: Thread-53] session.SessionState: Updating thread name to 0887b266-675a-4fb2-8c85-3a27ebb3b9fc HiveSe rver2-Handler-Pool: Thread-53 2018-08-07T16:36:39,014 INFO [HiveServer2-Handler-Pool: Thread-53] session.SessionState: Resetting thread name to HiveServer2-Handler-Pool: Thread-53 2018-08-07T16:36:43,765 INFO [Heartbeater-3] lockmgr.DbTxnManager: Sending heartbeat for txnid:0 and lockid:25854 queryId=hive_20180807162912_519c1503-c151- 4da7-b5a2-bd067e9c42b9 txnid:0 2018-08-07T16:36:44,016 INFO [HiveServer2-Handler-Pool: Thread-53] session.SessionState: Updating thread name to 0887b266-675a-4fb2-8c85-3a27ebb3b9fc HiveSe rver2-Handler-Pool: Thread-53 2018-08-07T16:36:44,016 INFO [HiveServer2-Handler-Pool: Thread-53] session.SessionState: Resetting thread name to HiveServer2-Handler-Pool: Thread-53 2018-08-07T16:36:45,960 INFO [HiveServer2-Background-Pool: Thread-1549] mapreduce.Job: Job job_1533623337748_0216 running in uber mode : false 2018-08-07T16:36:45,960 INFO [HiveServer2-Background-Pool: Thread-1549] mapreduce.Job: map 0% reduce 0% 2018-08-07T16:36:49,017 INFO [HiveServer2-Handler-Pool: Thread-53] session.SessionState: Updating thread name to 0887b266-675a-4fb2-8c85-3a27ebb3b9fc HiveSe rver2-Handler-Pool: Thread-53 2018-08-07T16:36:49,017 INFO [HiveServer2-Handler-Pool: Thread-53] session.SessionState: Resetting thread name to HiveServer2-Handler-Pool: Thread-53 2018-08-07T16:36:54,019 INFO [HiveServer2-Handler-Pool: Thread-53] session.SessionState: Updating thread name to 0887b266-675a-4fb2-8c85-3a27ebb3b9fc HiveSe rver2-Handler-Pool: Thread-53 2018-08-07T16:36:54,019 INFO [HiveServer2-Handler-Pool: Thread-53] session.SessionState: Resetting thread name to HiveServer2-Handler-Pool: Thread-53 2018-08-07T16:36:57,992 INFO [HiveServer2-Background-Pool: Thread-1549] mapreduce.Job: map 100% reduce 0% 2018-08-07T16:36:59,021 INFO [HiveServer2-Handler-Pool: Thread-53] session.SessionState: Updating thread name to 0887b266-675a-4fb2-8c85-3a27ebb3b9fc HiveSe rver2-Handler-Pool: Thread-53 2018-08-07T16:36:59,021 INFO [HiveServer2-Handler-Pool: Thread-53] session.SessionState: Resetting thread name to HiveServer2-Handler-Pool: Thread-53 2018-08-07T16:37:04,022 INFO [HiveServer2-Handler-Pool: Thread-53] session.SessionState: Updating thread name to 0887b266-675a-4fb2-8c85-3a27ebb3b9fc HiveSe rver2-Handler-Pool: Thread-53 2018-08-07T16:37:04,022 INFO [HiveServer2-Handler-Pool: Thread-53] session.SessionState: Resetting thread name to HiveServer2-Handler-Pool: Thread-53 2018-08-07T16:37:09,024 INFO [HiveServer2-Handler-Pool: Thread-53] session.SessionState: Updating thread name to 0887b266-675a-4fb2-8c85-3a27ebb3b9fc HiveSe rver2-Handler-Pool: Thread-53 2018-08-07T16:37:09,024 INFO [HiveServer2-Handler-Pool: Thread-53] session.SessionState: Resetting thread name to HiveServer2-Handler-Pool: Thread-53 2018-08-07T16:37:14,026 INFO [HiveServer2-Handler-Pool: Thread-53] session.SessionState: Updating thread name to 0887b266-675a-4fb2-8c85-3a27ebb3b9fc HiveSe rver2-Handler-Pool: Thread-53 2018-08-07T16:37:14,026 INFO [HiveServer2-Handler-Pool: Thread-53] session.SessionState: Resetting thread name to HiveServer2-Handler-Pool: Thread-53 2018-08-07T16:37:18,035 INFO [HiveServer2-Background-Pool: Thread-1549] mapreduce.Job: Job job_1533623337748_0216 completed successfully 2018-08-07T16:37:18,061 INFO [HiveServer2-Background-Pool: Thread-1549] mapreduce.Job: Counters: 33 File System Counters FILE: Number of bytes read=0 FILE: Number of bytes written=297867 FILE: Number of read operations=0 FILE: Number of large read operations=0 FILE: Number of write operations=0 HDFS: Number of bytes read=129369402 HDFS: Number of bytes written=129368980 HDFS: Number of read operations=16 HDFS: Number of large read operations=0 HDFS: Number of write operations=4 Job Counters Launched map tasks=1 Other local map tasks=1 Total time spent by all maps in occupied slots (ms)=85944 Total time spent by all reduces in occupied slots (ms)=0 Total time spent by all map tasks (ms)=28648 Total vcore-milliseconds taken by all map tasks=28648 Total megabyte-milliseconds taken by all map tasks=572960000 Map-Reduce Framework Map input records=1 Map output records=0 Input split bytes=134 Spilled Records=0 Failed Shuffles=0 Merged Map outputs=0 GC time elapsed (ms)=76 CPU time spent (ms)=30260 Physical memory (bytes) snapshot=693239808 Virtual memory (bytes) snapshot=19364175872 Total committed heap usage (bytes)=1001914368 File Input Format Counters Bytes Read=288 File Output Format Counters Bytes Written=0 org.apache.hadoop.tools.mapred.CopyMapper$Counter BYTESCOPIED=129368980 BYTESEXPECTED=129368980 COPY=1 2018-08-07T16:37:18,108 INFO [HiveServer2-Background-Pool: Thread-1549] metadata.Hive: Copying source hdfs://edhcluster/tmp/hive/staging_hive_2018-08-07_16- 29-12_750_8973639287951385407-1/-ext-10000/000002_0 to hdfs://edhcluster/user/hive/warehouse/temp_tro/000002_0 because HDFS encryption zones are different. 2018-08-07T16:37:18,108 INFO [HiveServer2-Background-Pool: Thread-1549] common.FileUtils: Source is 129368980 bytes. (MAX: 33554432) 2018-08-07T16:37:18,108 INFO [HiveServer2-Background-Pool: Thread-1549] common.FileUtils: Launch distributed copy (distcp) job. 2018-08-07T16:37:18,177 INFO [HiveServer2-Background-Pool: Thread-1549] tools.DistCp: Input Options: DistCpOptions{atomicCommit=false, syncFolder=true, dele teMissing=false, ignoreFailures=false, maxMaps=20, sslConfigurationFile='null', copyStrategy='uniformsize', sourceFileListing=null, sourcePaths=[hdfs://edhcl uster/tmp/hive/staging_hive_2018-08-07_16-29-12_750_8973639287951385407-1/-ext-10000/000002_0], targetPath=hdfs://edhcluster/user/hive/warehouse/temp_tro/000 002_0, targetPathExists=false, preserveRawXattrs=false} 2018-08-07T16:37:18,232 INFO [HiveServer2-Background-Pool: Thread-1549] hdfs.DFSClient: Created HDFS_DELEGATION_TOKEN token 10141 for hive on ha-hdfs:edhclu ster 2018-08-07T16:37:18,245 INFO [HiveServer2-Background-Pool: Thread-1549] security.TokenCache: Got dt for hdfs://edhcluster; Kind: HDFS_DELEGATION_TOKEN, Serv ice: ha-hdfs:edhcluster, Ident: (HDFS_DELEGATION_TOKEN token 10141 for hive) 2018-08-07T16:37:18,245 WARN [HiveServer2-Background-Pool: Thread-1549] token.Token: Cannot find class for token kind kms-dt 2018-08-07T16:37:18,245 INFO [HiveServer2-Background-Pool: Thread-1549] security.TokenCache: Got dt for hdfs://edhcluster; Kind: kms-dt, Service: 160.88.112 .163:9393, Ident: 00 04 68 69 76 65 04 79 61 72 6e 04 68 69 76 65 8a 01 65 13 88 83 24 8a 01 65 37 95 07 24 8e 1d f8 24 2018-08-07T16:37:18,514 WARN [HiveServer2-Background-Pool: Thread-1549] token.Token: Cannot find class for token kind kms-dt 2018-08-07T16:37:18,514 INFO [HiveServer2-Background-Pool: Thread-1549] security.TokenCache: Got dt for hdfs://edhcluster; Kind: kms-dt, Service: 160.88.112 .162:9393, Ident: 00 04 68 69 76 65 04 79 61 72 6e 04 68 69 76 65 8a 01 65 13 88 84 30 8a 01 65 37 95 08 30 8e 1d 4b 23 2018-08-07T16:37:18,522 WARN [HiveServer2-Background-Pool: Thread-1549] mapreduce.JobResourceUploader: Hadoop command-line option parsing not performed. Imp lement the Tool interface and execute your application with ToolRunner to remedy this. 2018-08-07T16:37:18,891 INFO [HiveServer2-Background-Pool: Thread-1549] mapreduce.JobSubmitter: number of splits:1 2018-08-07T16:37:19,027 INFO [HiveServer2-Handler-Pool: Thread-53] session.SessionState: Updating thread name to 0887b266-675a-4fb2-8c85-3a27ebb3b9fc HiveSe rver2-Handler-Pool: Thread-53 2018-08-07T16:37:19,028 INFO [HiveServer2-Handler-Pool: Thread-53] session.SessionState: Resetting thread name to HiveServer2-Handler-Pool: Thread-53 2018-08-07T16:37:19,057 INFO [HiveServer2-Background-Pool: Thread-1549] mapreduce.JobSubmitter: Submitting tokens for job: job_1533623337748_0217 2018-08-07T16:37:19,057 WARN [HiveServer2-Background-Pool: Thread-1549] token.Token: Cannot find class for token kind kms-dt 2018-08-07T16:37:19,057 INFO [HiveServer2-Background-Pool: Thread-1549] mapreduce.JobSubmitter: Kind: kms-dt, Service: 160.88.112.162:9393, Ident: 00 04 68 69 76 65 04 79 61 72 6e 04 68 69 76 65 8a 01 65 13 88 84 30 8a 01 65 37 95 08 30 8e 1d 4b 23 2018-08-07T16:37:19,057 WARN [HiveServer2-Background-Pool: Thread-1549] token.Token: Cannot find class for token kind kms-dt 2018-08-07T16:37:19,057 INFO [HiveServer2-Background-Pool: Thread-1549] mapreduce.JobSubmitter: Kind: kms-dt, Service: 160.88.112.163:9393, Ident: 00 04 68 69 76 65 04 79 61 72 6e 04 68 69 76 65 8a 01 65 13 88 83 24 8a 01 65 37 95 07 24 8e 1d f8 24 2018-08-07T16:37:19,057 WARN [HiveServer2-Background-Pool: Thread-1549] token.Token: Cannot find class for token kind HIVE_DELEGATION_TOKEN 2018-08-07T16:37:19,057 INFO [HiveServer2-Background-Pool: Thread-1549] mapreduce.JobSubmitter: Kind: HIVE_DELEGATION_TOKEN, Service: HiveServer2Impersonati onToken, Ident: 00 04 68 69 76 65 04 68 69 76 65 00 8a 01 65 13 76 fe e0 8a 01 65 37 83 82 e0 01 8e 02 73 2018-08-07T16:37:19,057 INFO [HiveServer2-Background-Pool: Thread-1549] mapreduce.JobSubmitter: Kind: HDFS_DELEGATION_TOKEN, Service: ha-hdfs:edhcluster, Id ent: (HDFS_DELEGATION_TOKEN token 10141 for hive) 2018-08-07T16:37:19,264 INFO [HiveServer2-Background-Pool: Thread-1549] impl.YarnClientImpl: Submitted application application_1533623337748_0217 2018-08-07T16:37:19,265 INFO [HiveServer2-Background-Pool: Thread-1549] mapreduce.Job: The url to track the job: https://bdtst1a.serverdev.hadev.org.hk:8888 /proxy/application_1533623337748_0217/ 2018-08-07T16:37:19,265 INFO [HiveServer2-Background-Pool: Thread-1549] tools.DistCp: DistCp job-id: job_1533623337748_0217 2018-08-07T16:37:19,265 INFO [HiveServer2-Background-Pool: Thread-1549] mapreduce.Job: Running job: job_1533623337748_0217 2018-08-07T16:37:24,029 INFO [HiveServer2-Handler-Pool: Thread-53] session.SessionState: Updating thread name to 0887b266-675a-4fb2-8c85-3a27ebb3b9fc HiveSe rver2-Handler-Pool: Thread-53 2018-08-07T16:37:24,029 INFO [HiveServer2-Handler-Pool: Thread-53] session.SessionState: Resetting thread name to HiveServer2-Handler-Pool: Thread-53 2018-08-07T16:37:26,313 INFO [HiveServer2-Background-Pool: Thread-1549] mapreduce.Job: Job job_1533623337748_0217 running in uber mode : false 2018-08-07T16:37:26,313 INFO [HiveServer2-Background-Pool: Thread-1549] mapreduce.Job: map 0% reduce 0% 2018-08-07T16:37:29,031 INFO [HiveServer2-Handler-Pool: Thread-53] session.SessionState: Updating thread name to 0887b266-675a-4fb2-8c85-3a27ebb3b9fc HiveSe rver2-Handler-Pool: Thread-53 2018-08-07T16:37:29,031 INFO [HiveServer2-Handler-Pool: Thread-53] session.SessionState: Resetting thread name to HiveServer2-Handler-Pool: Thread-53 2018-08-07T16:37:34,032 INFO [HiveServer2-Handler-Pool: Thread-53] session.SessionState: Updating thread name to 0887b266-675a-4fb2-8c85-3a27ebb3b9fc HiveSe rver2-Handler-Pool: Thread-53 2018-08-07T16:37:34,032 INFO [HiveServer2-Handler-Pool: Thread-53] session.SessionState: Resetting thread name to HiveServer2-Handler-Pool: Thread-53 2018-08-07T16:37:38,346 INFO [HiveServer2-Background-Pool: Thread-1549] mapreduce.Job: map 100% reduce 0% 2018-08-07T16:37:39,034 INFO [HiveServer2-Handler-Pool: Thread-53] session.SessionState: Updating thread name to 0887b266-675a-4fb2-8c85-3a27ebb3b9fc HiveSe rver2-Handler-Pool: Thread-53 2018-08-07T16:37:39,034 INFO [HiveServer2-Handler-Pool: Thread-53] session.SessionState: Resetting thread name to HiveServer2-Handler-Pool: Thread-53 2018-08-07T16:37:44,036 INFO [HiveServer2-Handler-Pool: Thread-53] session.SessionState: Updating thread name to 0887b266-675a-4fb2-8c85-3a27ebb3b9fc HiveSe rver2-Handler-Pool: Thread-53 2018-08-07T16:37:44,036 INFO [HiveServer2-Handler-Pool: Thread-53] session.SessionState: Resetting thread name to HiveServer2-Handler-Pool: Thread-53 2018-08-07T16:37:49,037 INFO [HiveServer2-Handler-Pool: Thread-53] session.SessionState: Updating thread name to 0887b266-675a-4fb2-8c85-3a27ebb3b9fc HiveSe rver2-Handler-Pool: Thread-53 2018-08-07T16:37:49,037 INFO [HiveServer2-Handler-Pool: Thread-53] session.SessionState: Resetting thread name to HiveServer2-Handler-Pool: Thread-53 2018-08-07T16:37:54,039 INFO [HiveServer2-Handler-Pool: Thread-53] session.SessionState: Updating thread name to 0887b266-675a-4fb2-8c85-3a27ebb3b9fc HiveSe rver2-Handler-Pool: Thread-53 2018-08-07T16:37:54,039 INFO [HiveServer2-Handler-Pool: Thread-53] session.SessionState: Resetting thread name to HiveServer2-Handler-Pool: Thread-53 2018-08-07T16:37:57,389 INFO [HiveServer2-Background-Pool: Thread-1549] mapreduce.Job: Job job_1533623337748_0217 completed successfully 2018-08-07T16:37:57,414 INFO [HiveServer2-Background-Pool: Thread-1549] mapreduce.Job: Counters: 33 File System Counters FILE: Number of bytes read=0 FILE: Number of bytes written=297861 FILE: Number of read operations=0 FILE: Number of large read operations=0 FILE: Number of write operations=0 HDFS: Number of bytes read=129369400 HDFS: Number of bytes written=129368980 HDFS: Number of read operations=16 HDFS: Number of large read operations=0 HDFS: Number of write operations=4 Job Counters Launched map tasks=1 Other local map tasks=1 Total time spent by all maps in occupied slots (ms)=85161 Total time spent by all reduces in occupied slots (ms)=0 Total time spent by all map tasks (ms)=28387 Total vcore-milliseconds taken by all map tasks=28387 Total megabyte-milliseconds taken by all map tasks=567740000 Map-Reduce Framework Map input records=1 Map output records=0 Input split bytes=132 Spilled Records=0 Failed Shuffles=0 Merged Map outputs=0 GC time elapsed (ms)=81 CPU time spent (ms)=30470 Physical memory (bytes) snapshot=703942656 Virtual memory (bytes) snapshot=19356225536 Total committed heap usage (bytes)=1003487232 File Input Format Counters Bytes Read=288 File Output Format Counters Bytes Written=0 org.apache.hadoop.tools.mapred.CopyMapper$Counter BYTESCOPIED=129368980 BYTESEXPECTED=129368980 COPY=1 2018-08-07T16:37:57,460 INFO [HiveServer2-Background-Pool: Thread-1549] metadata.Hive: Copying source hdfs://edhcluster/tmp/hive/staging_hive_2018-08-07_16- 29-12_750_8973639287951385407-1/-ext-10000/000003_0 to hdfs://edhcluster/user/hive/warehouse/temp_tro/000003_0 because HDFS encryption zones are different. 2018-08-07T16:37:57,461 INFO [HiveServer2-Background-Pool: Thread-1549] common.FileUtils: Source is 129368980 bytes. (MAX: 33554432) 2018-08-07T16:37:57,461 INFO [HiveServer2-Background-Pool: Thread-1549] common.FileUtils: Launch distributed copy (distcp) job. 2018-08-07T16:37:57,527 INFO [HiveServer2-Background-Pool: Thread-1549] tools.DistCp: Input Options: DistCpOptions{atomicCommit=false, syncFolder=true, dele teMissing=false, ignoreFailures=false, maxMaps=20, sslConfigurationFile='null', copyStrategy='uniformsize', sourceFileListing=null, sourcePaths=[hdfs://edhcl uster/tmp/hive/staging_hive_2018-08-07_16-29-12_750_8973639287951385407-1/-ext-10000/000003_0], targetPath=hdfs://edhcluster/user/hive/warehouse/temp_tro/000 003_0, targetPathExists=false, preserveRawXattrs=false}