016-12-15 16:15:03,681 INFO hooks.ATSHook (ATSHook.java:createPreHookEvent(149)) - Received pre-hook notification for :hive_20161215161503_ff60e97f-a0a7-4fbb-b20d-191be8fa69e3 2016-12-15 16:15:03,688 INFO mr.ExecDriver (ExecDriver.java:execute(288)) - Using org.apache.hadoop.hive.ql.io.CombineHiveInputFormat 2016-12-15 16:15:03,688 INFO mr.ExecDriver (ExecDriver.java:execute(310)) - adding libjars: file:///usr/iop/current/hbase-client/lib/hbase-client.jar,file:///usr/iop/current/hbase-client/lib/hbase-common.jar,file:///usr/iop/current/hbase-client/lib/hbase-hadoop2-compat.jar,file:///usr/iop/current/hbase-client/lib/hbase-prefix-tree.jar,file:///usr/iop/current/hbase-client/lib/hbase-protocol.jar,file:///usr/iop/current/hbase-client/lib/hbase-server.jar,file:///usr/iop/current/hbase-client/lib/htrace-core-3.1.0-incubating.jar,file:///usr/iop/current/hive-webhcat/share/hcatalog 2016-12-15 16:15:03,688 INFO exec.Utilities (Utilities.java:getInputPaths(3398)) - Processing alias drivers 2016-12-15 16:15:03,688 INFO exec.Utilities (Utilities.java:getInputPaths(3415)) - Adding input file hdfs://ibm-biginsight.com:8020/apps/hive/warehouse/bigsql.db/drivers 2016-12-15 16:15:03,689 INFO exec.Utilities (Utilities.java:isEmptyPath(2699)) - Content Summary not cached for hdfs://ibm-biginsight.com:8020/apps/hive/warehouse/bigsql.db/drivers 2016-12-15 16:15:03,692 INFO ql.Context (Context.java:getMRScratchDir(330)) - New scratch dir is hdfs://ibm-biginsight.com:8020/tmp/hive/admin/42e486e9-fa21-45d9-8d85-2973cf01e66c/hive_2016-12-15_16-15-03_610_1357879501286323826-11 2016-12-15 16:15:03,697 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-15 16:15:03,697 INFO exec.Utilities (Utilities.java:serializePlan(939)) - Serializing MapWork via kryo 2016-12-15 16:15:04,122 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-15 16:15:04,126 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-15 16:15:04,126 INFO exec.Utilities (Utilities.java:serializePlan(939)) - Serializing ReduceWork via kryo 2016-12-15 16:15:04,539 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-15 16:15:04,541 ERROR mr.ExecDriver (ExecDriver.java:execute(400)) - yarn 2016-12-15 16:15:04,632 INFO impl.TimelineClientImpl (TimelineClientImpl.java:serviceInit(296)) - Timeline service address: http://ibm-biginsight.com:8188/ws/v1/timeline/ 2016-12-15 16:15:04,632 INFO client.RMProxy (RMProxy.java:createRMProxy(98)) - Connecting to ResourceManager at ibm-biginsight.com/10.10.15.15:8050 2016-12-15 16:15:04,725 INFO impl.TimelineClientImpl (TimelineClientImpl.java:serviceInit(296)) - Timeline service address: http://ibm-biginsight.com:8188/ws/v1/timeline/ 2016-12-15 16:15:04,725 INFO client.RMProxy (RMProxy.java:createRMProxy(98)) - Connecting to ResourceManager at ibm-biginsight.com/10.10.15.15:8050 2016-12-15 16:15:04,727 INFO exec.Utilities (Utilities.java:getBaseWork(391)) - PLAN PATH = hdfs://ibm-biginsight.com:8020/tmp/hive/admin/42e486e9-fa21-45d9-8d85-2973cf01e66c/hive_2016-12-15_16-15-03_610_1357879501286323826-11/-mr-10004/35212b50-f845-41af-9b29-982f89fdbb6f/map.xml 2016-12-15 16:15:04,727 INFO exec.Utilities (Utilities.java:getBaseWork(391)) - PLAN PATH = hdfs://ibm-biginsight.com:8020/tmp/hive/admin/42e486e9-fa21-45d9-8d85-2973cf01e66c/hive_2016-12-15_16-15-03_610_1357879501286323826-11/-mr-10004/35212b50-f845-41af-9b29-982f89fdbb6f/reduce.xml 2016-12-15 16:15:04,735 WARN mapreduce.JobResourceUploader (JobResourceUploader.java:uploadFiles(64)) - Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this. 2016-12-15 16:15:05,033 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-15 16:15:05,033 INFO exec.Utilities (Utilities.java:getBaseWork(391)) - PLAN PATH = hdfs://ibm-biginsight.com:8020/tmp/hive/admin/42e486e9-fa21-45d9-8d85-2973cf01e66c/hive_2016-12-15_16-15-03_610_1357879501286323826-11/-mr-10004/35212b50-f845-41af-9b29-982f89fdbb6f/map.xml 2016-12-15 16:15:05,033 INFO io.CombineHiveInputFormat (CombineHiveInputFormat.java:getSplits(517)) - Total number of paths: 1, launching 1 threads to check non-combinable ones. 2016-12-15 16:15:05,037 INFO io.CombineHiveInputFormat (CombineHiveInputFormat.java:getCombineSplits(439)) - CombineHiveInputSplit creating pool for hdfs://ibm-biginsight.com:8020/apps/hive/warehouse/bigsql.db/drivers; using filter path hdfs://ibm-biginsight.com:8020/apps/hive/warehouse/bigsql.db/drivers 2016-12-15 16:15:05,041 INFO input.FileInputFormat (FileInputFormat.java:listStatus(283)) - Total input paths to process : 1 2016-12-15 16:15:05,042 INFO input.CombineFileInputFormat (CombineFileInputFormat.java:createSplits(413)) - DEBUG: Terminated node allocation with : CompletedNodes: 1, size left: 0 2016-12-15 16:15:05,042 INFO io.CombineHiveInputFormat (CombineHiveInputFormat.java:getCombineSplits(494)) - number of splits 1 2016-12-15 16:15:05,042 INFO io.CombineHiveInputFormat (CombineHiveInputFormat.java:getSplits(587)) - Number of all splits 1 2016-12-15 16:15:05,042 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-15 16:15:05,068 INFO mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(198)) - number of splits:1 2016-12-15 16:15:05,508 INFO mapreduce.JobSubmitter (JobSubmitter.java:printTokens(287)) - Submitting tokens for job: job_1481788223653_0003 2016-12-15 16:15:05,758 INFO impl.YarnClientImpl (YarnClientImpl.java:submitApplication(273)) - Submitted application application_1481788223653_0003 2016-12-15 16:15:05,763 INFO mapreduce.Job (Job.java:submit(1294)) - The url to track the job: http://ibm-biginsight.com:8088/proxy/application_1481788223653_0003/ 2016-12-15 16:15:05,763 INFO exec.Task (SessionState.java:printInfo(954)) - Starting Job = job_1481788223653_0003, Tracking URL = http://ibm-biginsight.com:8088/proxy/application_1481788223653_0003/ 2016-12-15 16:15:05,763 INFO exec.Task (SessionState.java:printInfo(954)) - Kill Command = /usr/iop/4.1.0.0/hadoop/bin/hadoop job -kill job_1481788223653_0003 2016-12-15 16:15:10,850 WARN thrift.ThriftCLIService (ThriftCLIService.java:GetOperationStatus(621)) - Error getting operation status: org.apache.hive.service.cli.HiveSQLException: Invalid OperationHandle: OperationHandle [opType=EXECUTE_STATEMENT, getHandleIdentifier()=1112a67b-1817-4720-bf04-40f60e456d51] at org.apache.hive.service.cli.operation.OperationManager.getOperation(OperationManager.java:151) at org.apache.hive.service.cli.CLIService.getOperationStatus(CLIService.java:375) at org.apache.hive.service.cli.thrift.ThriftCLIService.GetOperationStatus(ThriftCLIService.java:610) at org.apache.hive.service.cli.thrift.TCLIService$Processor$GetOperationStatus.getResult(TCLIService.java:1473) at org.apache.hive.service.cli.thrift.TCLIService$Processor$GetOperationStatus.getResult(TCLIService.java:1458) at org.apache.thrift.ProcessFunction.process(ProcessFunction.java:39) at org.apache.thrift.TBaseProcessor.process(TBaseProcessor.java:39) at org.apache.hive.service.auth.TSetIpAddressProcessor.process(TSetIpAddressProcessor.java:56) at org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:285) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:745) 2016-12-15 16:15:10,852 WARN thrift.ThriftCLIService (ThriftCLIService.java:FetchResults(681)) - Error fetching results: org.apache.hive.service.cli.HiveSQLException: Invalid OperationHandle: OperationHandle [opType=EXECUTE_STATEMENT, getHandleIdentifier()=1112a67b-1817-4720-bf04-40f60e456d51] at org.apache.hive.service.cli.operation.OperationManager.getOperation(OperationManager.java:151) at org.apache.hive.service.cli.CLIService.fetchResults(CLIService.java:454) at org.apache.hive.service.cli.thrift.ThriftCLIService.FetchResults(ThriftCLIService.java:672) at org.apache.hive.service.cli.thrift.TCLIService$Processor$FetchResults.getResult(TCLIService.java:1553) at org.apache.hive.service.cli.thrift.TCLIService$Processor$FetchResults.getResult(TCLIService.java:1538) at org.apache.thrift.ProcessFunction.process(ProcessFunction.java:39) at org.apache.thrift.TBaseProcessor.process(TBaseProcessor.java:39) at org.apache.hive.service.auth.TSetIpAddressProcessor.process(TSetIpAddressProcessor.java:56) at org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:285) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)