2016-12-16 16:52:24,871 INFO server.HiveServer2 (HiveStringUtils.java:startupShutdownMessage(691)) - STARTUP_MSG: /************************************************************ STARTUP_MSG: Starting HiveServer2 STARTUP_MSG: host = ibm-biginsight.com/10.10.15.15 STARTUP_MSG: args = [--hiveconf, hive.aux.jars.path=file:///usr/iop/current/hbase-client/lib/hbase-client.jar,file:///usr/iop/current/hbase-client/lib/hbase-common.jar,file:///usr/iop/current/hbase-client/lib/hbase-hadoop2-compat.jar,file:///usr/iop/current/hbase-client/lib/hbase-prefix-tree.jar,file:///usr/iop/current/hbase-client/lib/hbase-protocol.jar,file:///usr/iop/current/hbase-client/lib/hbase-server.jar,file:///usr/iop/current/hbase-client/lib/htrace-core-3.1.0-incubating.jar,file:///usr/iop/current/hive-webhcat/share/hcatalog, -hiveconf, hive.metastore.uris= , -hiveconf, hive.log.file=hiveserver2.log, -hiveconf, hive.log.dir=/var/log/hive] STARTUP_MSG: version = 1.2.1-IBM-12 STARTUP_MSG: classpath = /usr/iop/4.1.0.0/hadoop/conf:/usr/iop/4.1.0.0/hadoop/lib/activation-1.1.jar:/usr/iop/4.1.0.0/hadoop/lib/slf4j-api-1.7.10.jar:/usr/iop/4.1.0.0/hadoop/lib/apacheds-i18n-2.0.0-M15.jar:/usr/iop/4.1.0.0/hadoop/lib/apacheds-kerberos-codec-2.0.0-M15.jar:/usr/iop/4.1.0.0/hadoop/lib/slf4j-log4j12-1.7.10.jar:/usr/iop/4.1.0.0/hadoop/lib/api-asn1-api-1.0.0-M20.jar:/usr/iop/4.1.0.0/hadoop/lib/snappy-java-1.0.5-IBM-3.jar:/usr/iop/4.1.0.0/hadoop/lib/api-util-1.0.0-M20.jar:/usr/iop/4.1.0.0/hadoop/lib/asm-3.2.jar:/usr/iop/4.1.0.0/hadoop/lib/stax-api-1.0-2.jar:/usr/iop/4.1.0.0/hadoop/lib/avro-1.7.7-IBM-22.jar:/usr/iop/4.1.0.0/hadoop/lib/xmlenc-0.52.jar:/usr/iop/4.1.0.0/hadoop/lib/commons-beanutils-1.8.0.jar:/usr/iop/4.1.0.0/hadoop/lib/commons-cli-1.2.jar:/usr/iop/4.1.0.0/hadoop/lib/xz-1.0.jar:/usr/iop/4.1.0.0/hadoop/lib/commons-codec-1.4.jar:/usr/iop/4.1.0.0/hadoop/lib/jsp-api-2.1.jar:/usr/iop/4.1.0.0/hadoop/lib/commons-collections-3.2.1.jar:/usr/iop/4.1.0.0/hadoop/lib/zookeeper-3.4.6_IBM_3.jar:/usr/iop/4.1.0.0/hadoop/lib/commons-compress-1.4.1.jar:/usr/iop/4.1.0.0/hadoop/lib/jsr305-3.0.0.jar:/usr/iop/4.1.0.0/hadoop/lib/commons-configuration-1.6.jar:/usr/iop/4.1.0.0/hadoop/lib/commons-digester-1.8.jar:/usr/iop/4.1.0.0/hadoop/lib/commons-httpclient-3.1.jar:/usr/iop/4.1.0.0/hadoop/lib/commons-io-2.4.jar:/usr/iop/4.1.0.0/hadoop/lib/commons-lang-2.6.jar:/usr/iop/4.1.0.0/hadoop/lib/commons-logging-1.1.3.jar:/usr/iop/4.1.0.0/hadoop/lib/commons-math3-3.1.1.jar:/usr/iop/4.1.0.0/hadoop/lib/commons-net-3.1.jar:/usr/iop/4.1.0.0/hadoop/lib/curator-client-2.7.1.jar:/usr/iop/4.1.0.0/hadoop/lib/curator-framework-2.7.1.jar:/usr/iop/4.1.0.0/hadoop/lib/curator-recipes-2.7.1.jar:/usr/iop/4.1.0.0/hadoop/lib/gson-2.2.4.jar:/usr/iop/4.1.0.0/hadoop/lib/guava-11.0.2.jar:/usr/iop/4.1.0.0/hadoop/lib/hamcrest-core-1.3.jar:/usr/iop/4.1.0.0/hadoop/lib/junit-4.11.jar:/usr/iop/4.1.0.0/hadoop/lib/htrace-core-3.1.0-incubating.jar:/usr/iop/4.1.0.0/hadoop/lib/httpclient-4.2.5.jar:/usr/iop/4.1.0.0/hadoop/lib/httpcore-4.2.5.jar:/usr/iop/4.1.0.0/hadoop/lib/jackson-core-asl-1.9.13.jar:/usr/iop/4.1.0.0/hadoop/lib/jackson-jaxrs-1.9.13.jar:/usr/iop/4.1.0.0/hadoop/lib/servlet-api-2.5.jar:/usr/iop/4.1.0.0/hadoop/lib/jackson-mapper-asl-1.9.13.jar:/usr/iop/4.1.0.0/hadoop/lib/jackson-xc-1.9.13.jar:/usr/iop/4.1.0.0/hadoop/lib/java-xmlbuilder-0.4.jar:/usr/iop/4.1.0.0/hadoop/lib/jaxb-api-2.2.2.jar:/usr/iop/4.1.0.0/hadoop/lib/jaxb-impl-2.2.3-1.jar:/usr/iop/4.1.0.0/hadoop/lib/jersey-core-1.9.jar:/usr/iop/4.1.0.0/hadoop/lib/jersey-json-1.9.jar:/usr/iop/4.1.0.0/hadoop/lib/jersey-server-1.9.jar:/usr/iop/4.1.0.0/hadoop/lib/jets3t-0.9.0.jar:/usr/iop/4.1.0.0/hadoop/lib/jettison-1.1.jar:/usr/iop/4.1.0.0/hadoop/lib/jetty-6.1.26-ibm.jar:/usr/iop/4.1.0.0/hadoop/lib/jetty-util-6.1.26-ibm.jar:/usr/iop/4.1.0.0/hadoop/lib/jsch-0.1.50.jar:/usr/iop/4.1.0.0/hadoop/lib/json-simple-1.1.jar:/usr/iop/4.1.0.0/hadoop/lib/log4j-1.2.17.jar:/usr/iop/4.1.0.0/hadoop/lib/mockito-all-1.8.5.jar:/usr/iop/4.1.0.0/hadoop/lib/netty-3.6.2.Final.jar:/usr/iop/4.1.0.0/hadoop/lib/paranamer-2.3.jar:/usr/iop/4.1.0.0/hadoop/lib/protobuf-java-2.5.0.jar:/usr/iop/4.1.0.0/hadoop/.//hadoop-annotations-2.7.1-IBM-11.jar:/usr/iop/4.1.0.0/hadoop/.//hadoop-annotations.jar:/usr/iop/4.1.0.0/hadoop/.//hadoop-auth-2.7.1-IBM-11.jar:/usr/iop/4.1.0.0/hadoop/.//hadoop-auth.jar:/usr/iop/4.1.0.0/hadoop/.//hadoop-common-2.7.1-IBM-11-tests.jar:/usr/iop/4.1.0.0/hadoop/.//hadoop-common-2.7.1-IBM-11.jar:/usr/iop/4.1.0.0/hadoop/.//hadoop-common-tests.jar:/usr/iop/4.1.0.0/hadoop/.//hadoop-common.jar:/usr/iop/4.1.0.0/hadoop/.//hadoop-nfs-2.7.1-IBM-11.jar:/usr/iop/4.1.0.0/hadoop/.//hadoop-nfs.jar:/usr/iop/4.1.0.0/hadoop-hdfs/./:/usr/iop/4.1.0.0/hadoop-hdfs/lib/asm-3.2.jar:/usr/iop/4.1.0.0/hadoop-hdfs/lib/commons-cli-1.2.jar:/usr/iop/4.1.0.0/hadoop-hdfs/lib/commons-codec-1.4.jar:/usr/iop/4.1.0.0/hadoop-hdfs/lib/commons-daemon-1.0.13.jar:/usr/iop/4.1.0.0/hadoop-hdfs/lib/commons-io-2.4.jar:/usr/iop/4.1.0.0/hadoop-hdfs/lib/commons-lang-2.6.jar:/usr/iop/4.1.0.0/hadoop-hdfs/lib/commons-logging-1.1.3.jar:/usr/iop/4.1.0.0/hadoop-hdfs/lib/guava-11.0.2.jar:/usr/iop/4.1.0.0/hadoop-hdfs/lib/htrace-core-3.1.0-incubating.jar:/usr/iop/4.1.0.0/hadoop-hdfs/lib/jackson-core-asl-1.9.13.jar:/usr/iop/4.1.0.0/hadoop-hdfs/lib/jackson-mapper-asl-1.9.13.jar:/usr/iop/4.1.0.0/hadoop-hdfs/lib/jersey-core-1.9.jar:/usr/iop/4.1.0.0/hadoop-hdfs/lib/jersey-server-1.9.jar:/usr/iop/4.1.0.0/hadoop-hdfs/lib/jetty-6.1.26-ibm.jar:/usr/iop/4.1.0.0/hadoop-hdfs/lib/jetty-util-6.1.26-ibm.jar:/usr/iop/4.1.0.0/hadoop-hdfs/lib/jsr305-3.0.0.jar:/usr/iop/4.1.0.0/hadoop-hdfs/lib/leveldbjni-all-1.8-IBM-3.jar:/usr/iop/4.1.0.0/hadoop-hdfs/lib/log4j-1.2.17.jar:/usr/iop/4.1.0.0/hadoop-hdfs/lib/netty-3.6.2.Final.jar:/usr/iop/4.1.0.0/hadoop-hdfs/lib/netty-all-4.0.23.Final.jar:/usr/iop/4.1.0.0/hadoop-hdfs/lib/protobuf-java-2.5.0.jar:/usr/iop/4.1.0.0/hadoop-hdfs/lib/servlet-api-2.5.jar:/usr/iop/4.1.0.0/hadoop-hdfs/lib/xercesImpl-2.9.1.jar:/usr/iop/4.1.0.0/hadoop-hdfs/lib/xml-apis-1.3.04.jar:/usr/iop/4.1.0.0/hadoop-hdfs/lib/xmlenc-0.52.jar:/usr/iop/4.1.0.0/hadoop-hdfs/.//hadoop-hdfs-2.7.1-IBM-11-tests.jar:/usr/iop/4.1.0.0/hadoop-hdfs/.//hadoop-hdfs-2.7.1-IBM-11.jar:/usr/iop/4.1.0.0/hadoop-hdfs/.//hadoop-hdfs-nfs-2.7.1-IBM-11.jar:/usr/iop/4.1.0.0/hadoop-hdfs/.//hadoop-hdfs-nfs.jar:/usr/iop/4.1.0.0/hadoop-hdfs/.//hadoop-hdfs-tests.jar:/usr/iop/4.1.0.0/hadoop-hdfs/.//hadoop-hdfs.jar:/usr/iop/4.1.0.0/hadoop-yarn/lib/activation-1.1.jar:/usr/iop/4.1.0.0/hadoop-yarn/lib/aopalliance-1.0.jar:/usr/iop/4.1.0.0/hadoop-yarn/lib/asm-3.2.jar:/usr/iop/4.1.0.0/hadoop-yarn/lib/commons-cli-1.2.jar:/usr/iop/4.1.0.0/hadoop-yarn/lib/commons-codec-1.4.jar:/usr/iop/4.1.0.0/hadoop-yarn/lib/commons-collections-3.2.1.jar:/usr/iop/4.1.0.0/hadoop-yarn/lib/commons-compress-1.4.1.jar:/usr/iop/4.1.0.0/hadoop-yarn/lib/commons-io-2.4.jar:/usr/iop/4.1.0.0/hadoop-yarn/lib/commons-lang-2.6.jar:/usr/iop/4.1.0.0/hadoop-yarn/lib/commons-logging-1.1.3.jar:/usr/iop/4.1.0.0/hadoop-yarn/lib/guava-11.0.2.jar:/usr/iop/4.1.0.0/hadoop-yarn/lib/guice-3.0.jar:/usr/iop/4.1.0.0/hadoop-yarn/lib/guice-servlet-3.0.jar:/usr/iop/4.1.0.0/hadoop-yarn/lib/jackson-core-asl-1.9.13.jar:/usr/iop/4.1.0.0/hadoop-yarn/lib/jackson-jaxrs-1.9.13.jar:/usr/iop/4.1.0.0/hadoop-yarn/lib/jackson-mapper-asl-1.9.13.jar:/usr/iop/4.1.0.0/hadoop-yarn/lib/jackson-xc-1.9.13.jar:/usr/iop/4.1.0.0/hadoop-yarn/lib/javax.inject-1.jar:/usr/iop/4.1.0.0/hadoop-yarn/lib/jaxb-api-2.2.2.jar:/usr/iop/4.1.0.0/hadoop-yarn/lib/jaxb-impl-2.2.3-1.jar:/usr/iop/4.1.0.0/hadoop-yarn/lib/jersey-client-1.9.jar:/usr/iop/4.1.0.0/hadoop-yarn/lib/jersey-core-1.9.jar:/usr/iop/4.1.0.0/hadoop-yarn/lib/jersey-guice-1.9.jar:/usr/iop/4.1.0.0/hadoop-yarn/lib/jersey-json-1.9.jar:/usr/iop/4.1.0.0/hadoop-yarn/lib/jersey-server-1.9.jar:/usr/iop/4.1.0.0/hadoop-yarn/lib/jettison-1.1.jar:/usr/iop/4.1.0.0/hadoop-yarn/lib/jetty-6.1.26-ibm.jar:/usr/iop/4.1.0.0/hadoop-yarn/lib/jetty-util-6.1.26-ibm.jar:/usr/iop/4.1.0.0/hadoop-yarn/lib/jsr305-3.0.0.jar:/usr/iop/4.1.0.0/hadoop-yarn/lib/leveldbjni-all-1.8-IBM-3.jar:/usr/iop/4.1.0.0/hadoop-yarn/lib/log4j-1.2.17.jar:/usr/iop/4.1.0.0/hadoop-yarn/lib/netty-3.6.2.Final.jar:/usr/iop/4.1.0.0/hadoop-yarn/lib/protobuf-java-2.5.0.jar:/usr/iop/4.1.0.0/hadoop-yarn/lib/servlet-api-2.5.jar:/usr/iop/4.1.0.0/hadoop-yarn/lib/stax-api-1.0-2.jar:/usr/iop/4.1.0.0/hadoop-yarn/lib/xz-1.0.jar:/usr/iop/4.1.0.0/hadoop-yarn/lib/zookeeper-3.4.6_IBM_3-tests.jar:/usr/iop/4.1.0.0/hadoop-yarn/lib/zookeeper-3.4.6_IBM_3.jar:/usr/iop/4.1.0.0/hadoop-yarn/.//hadoop-yarn-api-2.7.1-IBM-11.jar:/usr/iop/4.1.0.0/hadoop-yarn/.//hadoop-yarn-api.jar:/usr/iop/4.1.0.0/hadoop-yarn/.//hadoop-yarn-applications-distributedshell-2.7.1-IBM-11.jar:/usr/iop/4.1.0.0/hadoop-yarn/.//hadoop-yarn-applications-distributedshell.jar:/usr/iop/4.1.0.0/hadoop-yarn/.//hadoop-yarn-applications-unmanaged-am-launcher-2.7.1-IBM-11.jar:/usr/iop/4.1.0.0/hadoop-yarn/.//hadoop-yarn-applications-unmanaged-am-launcher.jar:/usr/iop/4.1.0.0/hadoop-yarn/.//hadoop-yarn-client-2.7.1-IBM-11.jar:/usr/iop/4.1.0.0/hadoop-yarn/.//hadoop-yarn-client.jar:/usr/iop/4.1.0.0/hadoop-yarn/.//hadoop-yarn-common-2.7.1-IBM-11.jar:/usr/iop/4.1.0.0/hadoop-yarn/.//hadoop-yarn-common.jar:/usr/iop/4.1.0.0/hadoop-yarn/.//hadoop-yarn-registry-2.7.1-IBM-11.jar:/usr/iop/4.1.0.0/hadoop-yarn/.//hadoop-yarn-registry.jar:/usr/iop/4.1.0.0/hadoop-yarn/.//hadoop-yarn-server-applicationhistoryservice-2.7.1-IBM-11.jar:/usr/iop/4.1.0.0/hadoop-yarn/.//hadoop-yarn-server-applicationhistoryservice.jar:/usr/iop/4.1.0.0/hadoop-yarn/.//hadoop-yarn-server-common-2.7.1-IBM-11.jar:/usr/iop/4.1.0.0/hadoop-yarn/.//hadoop-yarn-server-common.jar:/usr/iop/4.1.0.0/hadoop-yarn/.//hadoop-yarn-server-nodemanager-2.7.1-IBM-11.jar:/usr/iop/4.1.0.0/hadoop-yarn/.//hadoop-yarn-server-nodemanager.jar:/usr/iop/4.1.0.0/hadoop-yarn/.//hadoop-yarn-server-resourcemanager-2.7.1-IBM-11.jar:/usr/iop/4.1.0.0/hadoop-yarn/.//hadoop-yarn-server-resourcemanager.jar:/usr/iop/4.1.0.0/hadoop-yarn/.//hadoop-yarn-server-sharedcachemanager-2.7.1-IBM-11.jar:/usr/iop/4.1.0.0/hadoop-yarn/.//hadoop-yarn-server-sharedcachemanager.jar:/usr/iop/4.1.0.0/hadoop-yarn/.//hadoop-yarn-server-tests-2.7.1-IBM-11.jar:/usr/iop/4.1.0.0/hadoop-yarn/.//hadoop-yarn-server-tests.jar:/usr/iop/4.1.0.0/hadoop-yarn/.//hadoop-yarn-server-web-proxy-2.7.1-IBM-11.jar:/usr/iop/4.1.0.0/hadoop-yarn/.//hadoop-yarn-server-web-proxy.jar:/usr/iop/4.1.0.0/hadoop-mapreduce/lib/aopalliance-1.0.jar:/usr/iop/4.1.0.0/hadoop-mapreduce/lib/asm-3.2.jar:/usr/iop/4.1.0.0/hadoop-mapreduce/lib/avro-1.7.7-IBM-22.jar:/usr/iop/4.1.0.0/hadoop-mapreduce/lib/commons-compress-1.4.1.jar:/usr/iop/4.1.0.0/hadoop-mapreduce/lib/commons-io-2.4.jar:/usr/iop/4.1.0.0/hadoop-mapreduce/lib/guice-3.0.jar:/usr/iop/4.1.0.0/hadoop-mapreduce/lib/guice-servlet-3.0.jar:/usr/iop/4.1.0.0/hadoop-mapreduce/lib/hamcrest-core-1.3.jar:/usr/iop/4.1.0.0/hadoop-mapreduce/lib/jackson-core-asl-1.9.13.jar:/usr/iop/4.1.0.0/hadoop-mapreduce/lib/jackson-mapper-asl-1.9.13.jar:/usr/iop/4.1.0.0/hadoop-mapreduce/lib/javax.inject-1.jar:/usr/iop/4.1.0.0/hadoop-mapreduce/lib/jersey-core-1.9.jar:/usr/iop/4.1.0.0/hadoop-mapreduce/lib/jersey-guice-1.9.jar:/usr/iop/4.1.0.0/hadoop-mapreduce/lib/jersey-server-1.9.jar:/usr/iop/4.1.0.0/hadoop-mapreduce/lib/junit-4.11.jar:/usr/iop/4.1.0.0/hadoop-mapreduce/lib/leveldbjni-all-1.8-IBM-3.jar:/usr/iop/4.1.0.0/hadoop-mapreduce/lib/log4j-1.2.17.jar:/usr/iop/4.1.0.0/hadoop-mapreduce/lib/netty-3.6.2.Final.jar:/usr/iop/4.1.0.0/hadoop-mapreduce/lib/paranamer-2.3.jar:/usr/iop/4.1.0.0/hadoop-mapreduce/lib/protobuf-java-2.5.0.jar:/usr/iop/4.1.0.0/hadoop-mapreduce/lib/snappy-java-1.0.5-IBM-3.jar:/usr/iop/4.1.0.0/hadoop-mapreduce/lib/xz-1.0.jar:/usr/iop/4.1.0.0/hadoop-mapreduce/.//jackson-xc-1.9.13.jar:/usr/iop/4.1.0.0/hadoop-mapreduce/.//activation-1.1.jar:/usr/iop/4.1.0.0/hadoop-mapreduce/.//hadoop-mapreduce-client-jobclient.jar:/usr/iop/4.1.0.0/hadoop-mapreduce/.//apacheds-i18n-2.0.0-M15.jar:/usr/iop/4.1.0.0/hadoop-mapreduce/.//hadoop-mapreduce-client-core-2.7.1-IBM-11.jar:/usr/iop/4.1.0.0/hadoop-mapreduce/.//apacheds-kerberos-codec-2.0.0-M15.jar:/usr/iop/4.1.0.0/hadoop-mapreduce/.//hadoop-mapreduce-examples.jar:/usr/iop/4.1.0.0/hadoop-mapreduce/.//api-asn1-api-1.0.0-M20.jar:/usr/iop/4.1.0.0/hadoop-mapreduce/.//hadoop-openstack-2.7.1-IBM-11.jar:/usr/iop/4.1.0.0/hadoop-mapreduce/.//api-util-1.0.0-M20.jar:/usr/iop/4.1.0.0/hadoop-mapreduce/.//json-simple-1.1.jar:/usr/iop/4.1.0.0/hadoop-mapreduce/.//asm-3.2.jar:/usr/iop/4.1.0.0/hadoop-mapreduce/.//hadoop-sls-2.7.1-IBM-11.jar:/usr/iop/4.1.0.0/hadoop-mapreduce/.//avro-1.7.7-IBM-22.jar:/usr/iop/4.1.0.0/hadoop-mapreduce/.//hadoop-openstack.jar:/usr/iop/4.1.0.0/hadoop-mapreduce/.//aws-java-sdk-1.7.4.jar:/usr/iop/4.1.0.0/hadoop-mapreduce/.//hadoop-rumen-2.7.1-IBM-11.jar:/usr/iop/4.1.0.0/hadoop-mapreduce/.//azure-storage-2.0.0.jar:/usr/iop/4.1.0.0/hadoop-mapreduce/.//hadoop-rumen.jar:/usr/iop/4.1.0.0/hadoop-mapreduce/.//commons-beanutils-1.8.0.jar:/usr/iop/4.1.0.0/hadoop-mapreduce/.//java-xmlbuilder-0.4.jar:/usr/iop/4.1.0.0/hadoop-mapreduce/.//commons-cli-1.2.jar:/usr/iop/4.1.0.0/hadoop-mapreduce/.//hadoop-sls.jar:/usr/iop/4.1.0.0/hadoop-mapreduce/.//commons-codec-1.4.jar:/usr/iop/4.1.0.0/hadoop-mapreduce/.//hadoop-extras.jar:/usr/iop/4.1.0.0/hadoop-mapreduce/.//commons-collections-3.2.1.jar:/usr/iop/4.1.0.0/hadoop-mapreduce/.//hamcrest-core-1.3.jar:/usr/iop/4.1.0.0/hadoop-mapreduce/.//commons-compress-1.4.1.jar:/usr/iop/4.1.0.0/hadoop-mapreduce/.//hadoop-gridmix-2.7.1-IBM-11.jar:/usr/iop/4.1.0.0/hadoop-mapreduce/.//commons-configuration-1.6.jar:/usr/iop/4.1.0.0/hadoop-mapreduce/.//hadoop-streaming-2.7.1-IBM-11.jar:/usr/iop/4.1.0.0/hadoop-mapreduce/.//commons-digester-1.8.jar:/usr/iop/4.1.0.0/hadoop-mapreduce/.//hadoop-streaming.jar:/usr/iop/4.1.0.0/hadoop-mapreduce/.//commons-httpclient-3.1.jar:/usr/iop/4.1.0.0/hadoop-mapreduce/.//jersey-json-1.9.jar:/usr/iop/4.1.0.0/hadoop-mapreduce/.//commons-io-2.4.jar:/usr/iop/4.1.0.0/hadoop-mapreduce/.//jaxb-api-2.2.2.jar:/usr/iop/4.1.0.0/hadoop-mapreduce/.//commons-lang-2.6.jar:/usr/iop/4.1.0.0/hadoop-mapreduce/.//httpcore-4.2.5.jar:/usr/iop/4.1.0.0/hadoop-mapreduce/.//commons-lang3-3.3.2.jar:/usr/iop/4.1.0.0/hadoop-mapreduce/.//htrace-core-3.1.0-incubating.jar:/usr/iop/4.1.0.0/hadoop-mapreduce/.//commons-logging-1.1.3.jar:/usr/iop/4.1.0.0/hadoop-mapreduce/.//httpclient-4.2.5.jar:/usr/iop/4.1.0.0/hadoop-mapreduce/.//commons-math3-3.1.1.jar:/usr/iop/4.1.0.0/hadoop-mapreduce/.//jaxb-impl-2.2.3-1.jar:/usr/iop/4.1.0.0/hadoop-mapreduce/.//commons-net-3.1.jar:/usr/iop/4.1.0.0/hadoop-mapreduce/.//jackson-core-asl-1.9.13.jar:/usr/iop/4.1.0.0/hadoop-mapreduce/.//curator-client-2.7.1.jar:/usr/iop/4.1.0.0/hadoop-mapreduce/.//jackson-annotations-2.2.3.jar:/usr/iop/4.1.0.0/hadoop-mapreduce/.//curator-framework-2.7.1.jar:/usr/iop/4.1.0.0/hadoop-mapreduce/.//jackson-core-2.2.3.jar:/usr/iop/4.1.0.0/hadoop-mapreduce/.//curator-recipes-2.7.1.jar:/usr/iop/4.1.0.0/hadoop-mapreduce/.//jersey-core-1.9.jar:/usr/iop/4.1.0.0/hadoop-mapreduce/.//gson-2.2.4.jar:/usr/iop/4.1.0.0/hadoop-mapreduce/.//jettison-1.1.jar:/usr/iop/4.1.0.0/hadoop-mapreduce/.//guava-11.0.2.jar:/usr/iop/4.1.0.0/hadoop-mapreduce/.//jackson-databind-2.2.3.jar:/usr/iop/4.1.0.0/hadoop-mapreduce/.//hadoop-ant-2.7.1-IBM-11.jar:/usr/iop/4.1.0.0/hadoop-mapreduce/.//jersey-server-1.9.jar:/usr/iop/4.1.0.0/hadoop-mapreduce/.//hadoop-ant.jar:/usr/iop/4.1.0.0/hadoop-mapreduce/.//hadoop-gridmix.jar:/usr/iop/4.1.0.0/hadoop-mapreduce/.//xz-1.0.jar:/usr/iop/4.1.0.0/hadoop-mapreduce/.//hadoop-archives-2.7.1-IBM-11.jar:/usr/iop/4.1.0.0/hadoop-mapreduce/.//jets3t-0.9.0.jar:/usr/iop/4.1.0.0/hadoop-mapreduce/.//hadoop-archives.jar:/usr/iop/4.1.0.0/hadoop-mapreduce/.//jackson-jaxrs-1.9.13.jar:/usr/iop/4.1.0.0/hadoop-mapreduce/.//hadoop-auth-2.7.1-IBM-11.jar:/usr/iop/4.1.0.0/hadoop-mapreduce/.//jetty-6.1.26-ibm.jar:/usr/iop/4.1.0.0/hadoop-mapreduce/.//hadoop-auth.jar:/usr/iop/4.1.0.0/hadoop-mapreduce/.//jackson-mapper-asl-1.9.13.jar:/usr/iop/4.1.0.0/hadoop-mapreduce/.//hadoop-aws-2.7.1-IBM-11.jar:/usr/iop/4.1.0.0/hadoop-mapreduce/.//jsch-0.1.50.jar:/usr/iop/4.1.0.0/hadoop-mapreduce/.//hadoop-aws.jar:/usr/iop/4.1.0.0/hadoop-mapreduce/.//hadoop-mapreduce-client-core.jar:/usr/iop/4.1.0.0/hadoop-mapreduce/.//hadoop-azure-2.7.1-IBM-11.jar:/usr/iop/4.1.0.0/hadoop-mapreduce/.//jetty-util-6.1.26-ibm.jar:/usr/iop/4.1.0.0/hadoop-mapreduce/.//hadoop-azure.jar:/usr/iop/4.1.0.0/hadoop-mapreduce/.//hadoop-mapreduce-client-hs-2.7.1-IBM-11.jar:/usr/iop/4.1.0.0/hadoop-mapreduce/.//hadoop-datajoin-2.7.1-IBM-11.jar:/usr/iop/4.1.0.0/hadoop-mapreduce/.//joda-time-2.9.1.jar:/usr/iop/4.1.0.0/hadoop-mapreduce/.//hadoop-datajoin.jar:/usr/iop/4.1.0.0/hadoop-mapreduce/.//hadoop-mapreduce-client-hs-plugins.jar:/usr/iop/4.1.0.0/hadoop-mapreduce/.//hadoop-distcp-2.7.1-IBM-11.jar:/usr/iop/4.1.0.0/hadoop-mapreduce/.//hadoop-distcp.jar:/usr/iop/4.1.0.0/hadoop-mapreduce/.//hadoop-mapreduce-client-hs.jar:/usr/iop/4.1.0.0/hadoop-mapreduce/.//hadoop-extras-2.7.1-IBM-11.jar:/usr/iop/4.1.0.0/hadoop-mapreduce/.//hadoop-mapreduce-client-app-2.7.1-IBM-11.jar:/usr/iop/4.1.0.0/hadoop-mapreduce/.//hadoop-mapreduce-client-jobclient-tests.jar:/usr/iop/4.1.0.0/hadoop-mapreduce/.//hadoop-mapreduce-client-app.jar:/usr/iop/4.1.0.0/hadoop-mapreduce/.//hadoop-mapreduce-client-common.jar:/usr/iop/4.1.0.0/hadoop-mapreduce/.//hadoop-mapreduce-client-common-2.7.1-IBM-11.jar:/usr/iop/4.1.0.0/hadoop-mapreduce/.//hadoop-mapreduce-examples-2.7.1-IBM-11.jar:/usr/iop/4.1.0.0/hadoop-mapreduce/.//hadoop-mapreduce-client-shuffle.jar:/usr/iop/4.1.0.0/hadoop-mapreduce/.//hadoop-mapreduce-client-hs-plugins-2.7.1-IBM-11.jar:/usr/iop/4.1.0.0/hadoop-mapreduce/.//hadoop-mapreduce-client-jobclient-2.7.1-IBM-11-tests.jar:/usr/iop/4.1.0.0/hadoop-mapreduce/.//hadoop-mapreduce-client-jobclient-2.7.1-IBM-11.jar:/usr/iop/4.1.0.0/hadoop-mapreduce/.//hadoop-mapreduce-client-shuffle-2.7.1-IBM-11.jar:/usr/iop/4.1.0.0/hadoop-mapreduce/.//jsp-api-2.1.jar:/usr/iop/4.1.0.0/hadoop-mapreduce/.//jsr305-3.0.0.jar:/usr/iop/4.1.0.0/hadoop-mapreduce/.//junit-4.11.jar:/usr/iop/4.1.0.0/hadoop-mapreduce/.//log4j-1.2.17.jar:/usr/iop/4.1.0.0/hadoop-mapreduce/.//metrics-core-3.0.1.jar:/usr/iop/4.1.0.0/hadoop-mapreduce/.//mockito-all-1.8.5.jar:/usr/iop/4.1.0.0/hadoop-mapreduce/.//netty-3.6.2.Final.jar:/usr/iop/4.1.0.0/hadoop-mapreduce/.//paranamer-2.3.jar:/usr/iop/4.1.0.0/hadoop-mapreduce/.//protobuf-java-2.5.0.jar:/usr/iop/4.1.0.0/hadoop-mapreduce/.//servlet-api-2.5.jar:/usr/iop/4.1.0.0/hadoop-mapreduce/.//snappy-java-1.0.5-IBM-3.jar:/usr/iop/4.1.0.0/hadoop-mapreduce/.//stax-api-1.0-2.jar:/usr/iop/4.1.0.0/hadoop-mapreduce/.//xmlenc-0.52.jar:/usr/iop/4.1.0.0/hadoop-mapreduce/.//zookeeper-3.4.6_IBM_3.jar:/usr/iop/current/hive-server2/conf/conf.server:/usr/iop/4.1.0.0/hive/lib/accumulo-core-1.6.0.jar:/usr/iop/4.1.0.0/hive/lib/accumulo-fate-1.6.0.jar:/usr/iop/4.1.0.0/hive/lib/accumulo-start-1.6.0.jar:/usr/iop/4.1.0.0/hive/lib/accumulo-trace-1.6.0.jar:/usr/iop/4.1.0.0/hive/lib/activation-1.1.jar:/usr/iop/4.1.0.0/hive/lib/ant-1.9.1.jar:/usr/iop/4.1.0.0/hive/lib/ant-launcher-1.9.1.jar:/usr/iop/4.1.0.0/hive/lib/antlr-2.7.7.jar:/usr/iop/4.1.0.0/hive/lib/antlr-runtime-3.4.jar:/usr/iop/4.1.0.0/hive/lib/apache-log4j-extras-1.2.17.jar:/usr/iop/4.1.0.0/hive/lib/asm-commons-3.1.jar:/usr/iop/4.1.0.0/hive/lib/asm-tree-3.1.jar:/usr/iop/4.1.0.0/hive/lib/avro-1.7.7-IBM-21.jar:/usr/iop/4.1.0.0/hive/lib/bigsheets.jar:/usr/iop/4.1.0.0/hive/lib/bigsheets-pig-0.12.0.jar:/usr/iop/4.1.0.0/hive/lib/bigsheets-serdes-1.0.0.jar:/usr/iop/4.1.0.0/hive/lib/bonecp-0.8.0.RELEASE.jar:/usr/iop/4.1.0.0/hive/lib/calcite-avatica-1.2.0-incubating.jar:/usr/iop/4.1.0.0/hive/lib/calcite-core-1.2.0-incubating.jar:/usr/iop/4.1.0.0/hive/lib/calcite-linq4j-1.2.0-incubating.jar:/usr/iop/4.1.0.0/hive/lib/commons-beanutils-1.8.0.jar:/usr/iop/4.1.0.0/hive/lib/commons-cli-1.2.jar:/usr/iop/4.1.0.0/hive/lib/commons-codec-1.4.jar:/usr/iop/4.1.0.0/hive/lib/commons-collections-3.2.1.jar:/usr/iop/4.1.0.0/hive/lib/commons-compiler-2.7.6.jar:/usr/iop/4.1.0.0/hive/lib/commons-compress-1.4.1.jar:/usr/iop/4.1.0.0/hive/lib/commons-configuration-1.6.jar:/usr/iop/4.1.0.0/hive/lib/commons-dbcp-1.4.jar:/usr/iop/4.1.0.0/hive/lib/commons-digester-1.8.jar:/usr/iop/4.1.0.0/hive/lib/commons-httpclient-3.0.1.jar:/usr/iop/4.1.0.0/hive/lib/commons-io-2.4.jar:/usr/iop/4.1.0.0/hive/lib/commons-lang-2.6.jar:/usr/iop/4.1.0.0/hive/lib/commons-logging-1.1.3.jar:/usr/iop/4.1.0.0/hive/lib/commons-math-2.1.jar:/usr/iop/4.1.0.0/hive/lib/commons-pool-1.5.4.jar:/usr/iop/4.1.0.0/hive/lib/commons-vfs2-2.0.jar:/usr/iop/4.1.0.0/hive/lib/curator-client-2.6.0.jar:/usr/iop/4.1.0.0/hive/lib/curator-framework-2.6.0.jar:/usr/iop/4.1.0.0/hive/lib/curator-recipes-2.6.0.jar:/usr/iop/4.1.0.0/hive/lib/datanucleus-api-jdo-3.2.6.jar:/usr/iop/4.1.0.0/hive/lib/datanucleus-core-3.2.10.jar:/usr/iop/4.1.0.0/hive/lib/datanucleus-rdbms-3.2.9.jar:/usr/iop/4.1.0.0/hive/lib/derby-10.10.2.0.jar:/usr/iop/4.1.0.0/hive/lib/eigenbase-properties-1.1.5.jar:/usr/iop/4.1.0.0/hive/lib/geronimo-annotation_1.0_spec-1.1.1.jar:/usr/iop/4.1.0.0/hive/lib/geronimo-jaspic_1.0_spec-1.0.jar:/usr/iop/4.1.0.0/hive/lib/geronimo-jta_1.1_spec-1.1.1.jar:/usr/iop/4.1.0.0/hive/lib/groovy-all-2.1.6.jar:/usr/iop/4.1.0.0/hive/lib/guava-14.0.1.jar:/usr/iop/4.1.0.0/hive/lib/hamcrest-core-1.1.jar:/usr/iop/4.1.0.0/hive/lib/hive-accumulo-handler-1.2.1-IBM-12.jar:/usr/iop/4.1.0.0/hive/lib/hive-accumulo-handler.jar:/usr/iop/4.1.0.0/hive/lib/hive-ant-1.2.1-IBM-12.jar:/usr/iop/4.1.0.0/hive/lib/hive-ant.jar:/usr/iop/4.1.0.0/hive/lib/hive-beeline-1.2.1-IBM-12.jar:/usr/iop/4.1.0.0/hive/lib/hive-beeline.jar:/usr/iop/4.1.0.0/hive/lib/hive-cli-1.2.1-IBM-12.jar:/usr/iop/4.1.0.0/hive/lib/hive-cli.jar:/usr/iop/4.1.0.0/hive/lib/hive-common-1.2.1-IBM-12.jar:/usr/iop/4.1.0.0/hive/lib/hive-common.jar:/usr/iop/4.1.0.0/hive/lib/hive-contrib-1.2.1-IBM-12.jar:/usr/iop/4.1.0.0/hive/lib/hive-contrib.jar:/usr/iop/4.1.0.0/hive/lib/hive-exec-1.2.1-IBM-12.jar:/usr/iop/4.1.0.0/hive/lib/hive-exec.jar:/usr/iop/4.1.0.0/hive/lib/hive-hbase-handler-1.2.1-IBM-12.jar:/usr/iop/4.1.0.0/hive/lib/hive-hbase-handler.jar:/usr/iop/4.1.0.0/hive/lib/hive-hwi-1.2.1-IBM-12.jar:/usr/iop/4.1.0.0/hive/lib/hive-hwi.jar:/usr/iop/4.1.0.0/hive/lib/hive-jdbc-1.2.1-IBM-12.jar:/usr/iop/4.1.0.0/hive/lib/hive-jdbc-1.2.1-IBM-12-standalone.jar:/usr/iop/4.1.0.0/hive/lib/hive-jdbc.jar:/usr/iop/4.1.0.0/hive/lib/hive-metastore-1.2.1-IBM-12.jar:/usr/iop/4.1.0.0/hive/lib/hive-metastore.jar:/usr/iop/4.1.0.0/hive/lib/hive-serde-1.2.1-IBM-12.jar:/usr/iop/4.1.0.0/hive/lib/hive-serde.jar:/usr/iop/4.1.0.0/hive/lib/hive-service-1.2.1-IBM-12.jar:/usr/iop/4.1.0.0/hive/lib/hive-service.jar:/usr/iop/4.1.0.0/hive/lib/hive-shims-0.20S-1.2.1-IBM-12.jar:/usr/iop/4.1.0.0/hive/lib/hive-shims-0.20S.jar:/usr/iop/4.1.0.0/hive/lib/hive-shims-0.23-1.2.1-IBM-12.jar:/usr/iop/4.1.0.0/hive/lib/hive-shims-0.23.jar:/usr/iop/4.1.0.0/hive/lib/hive-shims-1.2.1-IBM-12.jar:/usr/iop/4.1.0.0/hive/lib/hive-shims-common-1.2.1-IBM-12.jar:/usr/iop/4.1.0.0/hive/lib/hive-shims-common.jar:/usr/iop/4.1.0.0/hive/lib/hive-shims.jar:/usr/iop/4.1.0.0/hive/lib/hive-shims-scheduler-1.2.1-IBM-12.jar:/usr/iop/4.1.0.0/hive/lib/hive-shims-scheduler.jar:/usr/iop/4.1.0.0/hive/lib/hive-testutils-1.2.1-IBM-12.jar:/usr/iop/4.1.0.0/hive/lib/hive-testutils.jar:/usr/iop/4.1.0.0/hive/lib/httpclient-4.4.jar:/usr/iop/4.1.0.0/hive/lib/httpcore-4.4.jar:/usr/iop/4.1.0.0/hive/lib/ivy-2.4.0.jar:/usr/iop/4.1.0.0/hive/lib/janino-2.7.6.jar:/usr/iop/4.1.0.0/hive/lib/jcommander-1.32.jar:/usr/iop/4.1.0.0/hive/lib/jdo-api-3.0.1.jar:/usr/iop/4.1.0.0/hive/lib/jetty-all-7.6.0.v20120127.jar:/usr/iop/4.1.0.0/hive/lib/jetty-all-server-7.6.0.v20120127.jar:/usr/iop/4.1.0.0/hive/lib/jline-2.12.jar:/usr/iop/4.1.0.0/hive/lib/joda-time-2.5.jar:/usr/iop/4.1.0.0/hive/lib/jpam-1.1.jar:/usr/iop/4.1.0.0/hive/lib/json-20090211.jar:/usr/iop/4.1.0.0/hive/lib/jsr305-3.0.0.jar:/usr/iop/4.1.0.0/hive/lib/jta-1.1.jar:/usr/iop/4.1.0.0/hive/lib/junit-4.11.jar:/usr/iop/4.1.0.0/hive/lib/libfb303-0.9.2.jar:/usr/iop/4.1.0.0/hive/lib/libthrift-0.9.2.jar:/usr/iop/4.1.0.0/hive/lib/log4j-1.2.16.jar:/usr/iop/4.1.0.0/hive/lib/mail-1.4.1.jar:/usr/iop/4.1.0.0/hive/lib/maven-scm-api-1.4.jar:/usr/iop/4.1.0.0/hive/lib/maven-scm-provider-svn-commons-1.4.jar:/usr/iop/4.1.0.0/hive/lib/maven-scm-provider-svnexe-1.4.jar:/usr/iop/4.1.0.0/hive/lib/mysql-connector-java.jar:/usr/iop/4.1.0.0/hive/lib/netty-3.7.0.Final.jar:/usr/iop/4.1.0.0/hive/lib/opencsv-2.3.jar:/usr/iop/4.1.0.0/hive/lib/oro-2.0.8.jar:/usr/iop/4.1.0.0/hive/lib/paranamer-2.3.jar:/usr/iop/4.1.0.0/hive/lib/parquet-hadoop-bundle-1.6.0-IBM-7.jar:/usr/iop/4.1.0.0/hive/lib/pentaho-aggdesigner-algorithm-5.1.5-jhyde.jar:/usr/iop/4.1.0.0/hive/lib/piggybank.jar:/usr/iop/4.1.0.0/hive/lib/plexus-utils-1.5.6.jar:/usr/iop/4.1.0.0/hive/lib/regexp-1.3.jar:/usr/iop/4.1.0.0/hive/lib/servlet-api-2.5.jar:/usr/iop/4.1.0.0/hive/lib/snappy-java-1.0.5-ibm-2.jar:/usr/iop/4.1.0.0/hive/lib/ST4-4.0.4.jar:/usr/iop/4.1.0.0/hive/lib/stax-api-1.0.1.jar:/usr/iop/4.1.0.0/hive/lib/stringtemplate-3.2.1.jar:/usr/iop/4.1.0.0/hive/lib/super-csv-2.2.0.jar:/usr/iop/4.1.0.0/hive/lib/tempus-fugit-1.1.jar:/usr/iop/4.1.0.0/hive/lib/velocity-1.5.jar:/usr/iop/4.1.0.0/hive/lib/xz-1.0.jar:/usr/iop/4.1.0.0/hive/lib/zookeeper.jar:/usr/iop/4.1.0.0/spark/lib/spark-assembly-1.5.1_IBM_1-hadoop2.7.1-IBM-11.jar::/usr/iop/current/hbase-client/lib/hbase-client.jar:/usr/iop/current/hbase-client/lib/hbase-common.jar:/usr/iop/current/hbase-client/lib/hbase-hadoop2-compat.jar:/usr/iop/current/hbase-client/lib/hbase-prefix-tree.jar:/usr/iop/current/hbase-client/lib/hbase-protocol.jar:/usr/iop/current/hbase-client/lib/hbase-server.jar:/usr/iop/current/hbase-client/lib/htrace-core-3.1.0-incubating.jar:/usr/iop/current/hive-webhcat/share/hcatalog:/etc/hbase/conf:/usr/share/java/mysql-connector-java.jar:/usr/iop/current/hadoop-mapreduce-client/jackson-xc-1.9.13.jar:/usr/iop/current/hadoop-mapreduce-client/activation-1.1.jar:/usr/iop/current/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient.jar:/usr/iop/current/hadoop-mapreduce-client/apacheds-i18n-2.0.0-M15.jar:/usr/iop/current/hadoop-mapreduce-client/hadoop-mapreduce-client-core-2.7.1-IBM-11.jar:/usr/iop/current/hadoop-mapreduce-client/apacheds-kerberos-codec-2.0.0-M15.jar:/usr/iop/current/hadoop-mapreduce-client/hadoop-mapreduce-examples.jar:/usr/iop/current/hadoop-mapreduce-client/api-asn1-api-1.0.0-M20.jar:/usr/iop/current/hadoop-mapreduce-client/hadoop-openstack-2.7.1-IBM-11.jar:/usr/iop/current/hadoop-mapreduce-client/api-util-1.0.0-M20.jar:/usr/iop/current/hadoop-mapreduce-client/json-simple-1.1.jar:/usr/iop/current/hadoop-mapreduce-client/asm-3.2.jar:/usr/iop/current/hadoop-mapreduce-client/hadoop-sls-2.7.1-IBM-11.jar:/usr/iop/current/hadoop-mapreduce-client/avro-1.7.7-IBM-22.jar:/usr/iop/current/hadoop-mapreduce-client/hadoop-openstack.jar:/usr/iop/current/hadoop-mapreduce-client/aws-java-sdk-1.7.4.jar:/usr/iop/current/hadoop-mapreduce-client/hadoop-rumen-2.7.1-IBM-11.jar:/usr/iop/current/hadoop-mapreduce-client/azure-storage-2.0.0.jar:/usr/iop/current/hadoop-mapreduce-client/hadoop-rumen.jar:/usr/iop/current/hadoop-mapreduce-client/commons-beanutils-1.8.0.jar:/usr/iop/current/hadoop-mapreduce-client/java-xmlbuilder-0.4.jar:/usr/iop/current/hadoop-mapreduce-client/commons-cli-1.2.jar:/usr/iop/current/hadoop-mapreduce-client/hadoop-sls.jar:/usr/iop/current/hadoop-mapreduce-client/commons-codec-1.4.jar:/usr/iop/current/hadoop-mapreduce-client/hadoop-extras.jar:/usr/iop/current/hadoop-mapreduce-client/commons-collections-3.2.1.jar:/usr/iop/current/hadoop-mapreduce-client/hamcrest-core-1.3.jar:/usr/iop/current/hadoop-mapreduce-client/commons-compress-1.4.1.jar:/usr/iop/current/hadoop-mapreduce-client/hadoop-gridmix-2.7.1-IBM-11.jar:/usr/iop/current/hadoop-mapreduce-client/commons-configuration-1.6.jar:/usr/iop/current/hadoop-mapreduce-client/hadoop-streaming-2.7.1-IBM-11.jar:/usr/iop/current/hadoop-mapreduce-client/commons-digester-1.8.jar:/usr/iop/current/hadoop-mapreduce-client/hadoop-streaming.jar:/usr/iop/current/hadoop-mapreduce-client/commons-httpclient-3.1.jar:/usr/iop/current/hadoop-mapreduce-client/jersey-json-1.9.jar:/usr/iop/current/hadoop-mapreduce-client/commons-io-2.4.jar:/usr/iop/current/hadoop-mapreduce-client/jaxb-api-2.2.2.jar:/usr/iop/current/hadoop-mapreduce-client/commons-lang-2.6.jar:/usr/iop/current/hadoop-mapreduce-client/httpcore-4.2.5.jar:/usr/iop/current/hadoop-mapreduce-client/commons-lang3-3.3.2.jar:/usr/iop/current/hadoop-mapreduce-client/htrace-core-3.1.0-incubating.jar:/usr/iop/current/hadoop-mapreduce-client/commons-logging-1.1.3.jar:/usr/iop/current/hadoop-mapreduce-client/httpclient-4.2.5.jar:/usr/iop/current/hadoop-mapreduce-client/commons-math3-3.1.1.jar:/usr/iop/current/hadoop-mapreduce-client/jaxb-impl-2.2.3-1.jar:/usr/iop/current/hadoop-mapreduce-client/commons-net-3.1.jar:/usr/iop/current/hadoop-mapreduce-client/jackson-core-asl-1.9.13.jar:/usr/iop/current/hadoop-mapreduce-client/curator-client-2.7.1.jar:/usr/iop/current/hadoop-mapreduce-client/jackson-annotations-2.2.3.jar:/usr/iop/current/hadoop-mapreduce-client/curator-framework-2.7.1.jar:/usr/iop/current/hadoop-mapreduce-client/jackson-core-2.2.3.jar:/usr/iop/current/hadoop-mapreduce-client/curator-recipes-2.7.1.jar:/usr/iop/current/hadoop-mapreduce-client/jersey-core-1.9.jar:/usr/iop/current/hadoop-mapreduce-client/gson-2.2.4.jar:/usr/iop/current/hadoop-mapreduce-client/jettison-1.1.jar:/usr/iop/current/hadoop-mapreduce-client/guava-11.0.2.jar:/usr/iop/current/hadoop-mapreduce-client/jackson-databind-2.2.3.jar:/usr/iop/current/hadoop-mapreduce-client/hadoop-ant-2.7.1-IBM-11.jar:/usr/iop/current/hadoop-mapreduce-client/jersey-server-1.9.jar:/usr/iop/current/hadoop-mapreduce-client/hadoop-ant.jar:/usr/iop/current/hadoop-mapreduce-client/hadoop-gridmix.jar:/usr/iop/current/hadoop-mapreduce-client/xz-1.0.jar:/usr/iop/current/hadoop-mapreduce-client/hadoop-archives-2.7.1-IBM-11.jar:/usr/iop/current/hadoop-mapreduce-client/jets3t-0.9.0.jar:/usr/iop/current/hadoop-mapreduce-client/hadoop-archives.jar:/usr/iop/current/hadoop-mapreduce-client/jackson-jaxrs-1.9.13.jar:/usr/iop/current/hadoop-mapreduce-client/hadoop-auth-2.7.1-IBM-11.jar:/usr/iop/current/hadoop-mapreduce-client/jetty-6.1.26-ibm.jar:/usr/iop/current/hadoop-mapreduce-client/hadoop-auth.jar:/usr/iop/current/hadoop-mapreduce-client/jackson-mapper-asl-1.9.13.jar:/usr/iop/current/hadoop-mapreduce-client/hadoop-aws-2.7.1-IBM-11.jar:/usr/iop/current/hadoop-mapreduce-client/jsch-0.1.50.jar:/usr/iop/current/hadoop-mapreduce-client/hadoop-aws.jar:/usr/iop/current/hadoop-mapreduce-client/hadoop-mapreduce-client-core.jar:/usr/iop/current/hadoop-mapreduce-client/hadoop-azure-2.7.1-IBM-11.jar:/usr/iop/current/hadoop-mapreduce-client/jetty-util-6.1.26-ibm.jar:/usr/iop/current/hadoop-mapreduce-client/hadoop-azure.jar:/usr/iop/current/hadoop-mapreduce-client/hadoop-mapreduce-client-hs-2.7.1-IBM-11.jar:/usr/iop/current/hadoop-mapreduce-client/hadoop-datajoin-2.7.1-IBM-11.jar:/usr/iop/current/hadoop-mapreduce-client/joda-time-2.9.1.jar:/usr/iop/current/hadoop-mapreduce-client/hadoop-datajoin.jar:/usr/iop/current/hadoop-mapreduce-client/hadoop-mapreduce-client-hs-plugins.jar:/usr/iop/current/hadoop-mapreduce-client/hadoop-distcp-2.7.1-IBM-11.jar:/usr/iop/current/hadoop-mapreduce-client/hadoop-distcp.jar:/usr/iop/current/hadoop-mapreduce-client/hadoop-mapreduce-client-hs.jar:/usr/iop/current/hadoop-mapreduce-client/hadoop-extras-2.7.1-IBM-11.jar:/usr/iop/current/hadoop-mapreduce-client/hadoop-mapreduce-client-app-2.7.1-IBM-11.jar:/usr/iop/current/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient-tests.jar:/usr/iop/current/hadoop-mapreduce-client/hadoop-mapreduce-client-app.jar:/usr/iop/current/hadoop-mapreduce-client/hadoop-mapreduce-client-common.jar:/usr/iop/current/hadoop-mapreduce-client/hadoop-mapreduce-client-common-2.7.1-IBM-11.jar:/usr/iop/current/hadoop-mapreduce-client/hadoop-mapreduce-examples-2.7.1-IBM-11.jar:/usr/iop/current/hadoop-mapreduce-client/hadoop-mapreduce-client-shuffle.jar:/usr/iop/current/hadoop-mapreduce-client/hadoop-mapreduce-client-hs-plugins-2.7.1-IBM-11.jar:/usr/iop/current/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient-2.7.1-IBM-11-tests.jar:/usr/iop/current/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient-2.7.1-IBM-11.jar:/usr/iop/current/hadoop-mapreduce-client/hadoop-mapreduce-client-shuffle-2.7.1-IBM-11.jar:/usr/iop/current/hadoop-mapreduce-client/jsp-api-2.1.jar:/usr/iop/current/hadoop-mapreduce-client/jsr305-3.0.0.jar:/usr/iop/current/hadoop-mapreduce-client/junit-4.11.jar:/usr/iop/current/hadoop-mapreduce-client/log4j-1.2.17.jar:/usr/iop/current/hadoop-mapreduce-client/metrics-core-3.0.1.jar:/usr/iop/current/hadoop-mapreduce-client/mockito-all-1.8.5.jar:/usr/iop/current/hadoop-mapreduce-client/netty-3.6.2.Final.jar:/usr/iop/current/hadoop-mapreduce-client/paranamer-2.3.jar:/usr/iop/current/hadoop-mapreduce-client/protobuf-java-2.5.0.jar:/usr/iop/current/hadoop-mapreduce-client/servlet-api-2.5.jar:/usr/iop/current/hadoop-mapreduce-client/snappy-java-1.0.5-IBM-3.jar:/usr/iop/current/hadoop-mapreduce-client/stax-api-1.0-2.jar:/usr/iop/current/hadoop-mapreduce-client/xmlenc-0.52.jar:/usr/iop/current/hadoop-mapreduce-client/zookeeper-3.4.6_IBM_3.jar STARTUP_MSG: build = git://bi-xlinux-slave19.svl.ibm.com/a/workspace/Bigtop-v4.1-Spark1.5.1-AMD64-RH7/build/hive/rpm/BUILD/apache-hive-1.2.1-IBM-12-src -r 22469571c422d2cd56b04503885461bb8e8a9510; compiled by 'jenkins' on Wed Dec 9 20:22:56 PST 2015 ************************************************************/ 2016-12-16 16:52:24,878 INFO server.HiveServer2 (HiveServer2.java:startHiveServer2(340)) - Starting HiveServer2 2016-12-16 16:52:24,996 INFO common.ServerUtils (ServerUtils.java:cleanUpScratchDir(39)) - Cleaning scratchDir : /tmp/hive 2016-12-16 16:52:25,824 WARN common.ServerUtils (ServerUtils.java:cleanUpScratchDir(45)) - Unable to delete scratchDir : /tmp/hive org.apache.hadoop.security.AccessControlException: Permission denied: user=hive, access=ALL, inode="/tmp/hive":spark:hdfs:drwx------ at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.check(FSPermissionChecker.java:319) at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.checkSubAccess(FSPermissionChecker.java:277) at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.checkPermission(FSPermissionChecker.java:223) at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.checkPermission(FSPermissionChecker.java:190) at org.apache.hadoop.hdfs.server.namenode.FSDirectory.checkPermission(FSDirectory.java:1698) at org.apache.hadoop.hdfs.server.namenode.FSDirDeleteOp.delete(FSDirDeleteOp.java:88) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.delete(FSNamesystem.java:3714) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.delete(NameNodeRpcServer.java:947) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.delete(ClientNamenodeProtocolServerSideTranslatorPB.java:611) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:616) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:969) at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2049) at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2045) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:415) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2043) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:526) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:106) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:73) at org.apache.hadoop.hdfs.DFSClient.delete(DFSClient.java:2054) at org.apache.hadoop.hdfs.DistributedFileSystem$14.doCall(DistributedFileSystem.java:707) at org.apache.hadoop.hdfs.DistributedFileSystem$14.doCall(DistributedFileSystem.java:703) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.delete(DistributedFileSystem.java:703) at org.apache.hadoop.hive.common.ServerUtils.cleanUpScratchDir(ServerUtils.java:41) at org.apache.hive.service.server.HiveServer2.startHiveServer2(HiveServer2.java:346) at org.apache.hive.service.server.HiveServer2.access$700(HiveServer2.java:75) at org.apache.hive.service.server.HiveServer2$StartOptionExecutor.execute(HiveServer2.java:591) at org.apache.hive.service.server.HiveServer2.main(HiveServer2.java:464) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.apache.hadoop.util.RunJar.run(RunJar.java:221) at org.apache.hadoop.util.RunJar.main(RunJar.java:136) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.security.AccessControlException): Permission denied: user=hive, access=ALL, inode="/tmp/hive":spark:hdfs:drwx------ at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.check(FSPermissionChecker.java:319) at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.checkSubAccess(FSPermissionChecker.java:277) at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.checkPermission(FSPermissionChecker.java:223) at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.checkPermission(FSPermissionChecker.java:190) at org.apache.hadoop.hdfs.server.namenode.FSDirectory.checkPermission(FSDirectory.java:1698) at org.apache.hadoop.hdfs.server.namenode.FSDirDeleteOp.delete(FSDirDeleteOp.java:88) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.delete(FSNamesystem.java:3714) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.delete(NameNodeRpcServer.java:947) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.delete(ClientNamenodeProtocolServerSideTranslatorPB.java:611) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:616) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:969) at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2049) at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2045) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:415) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2043) at org.apache.hadoop.ipc.Client.call(Client.java:1476) at org.apache.hadoop.ipc.Client.call(Client.java:1407) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:229) at com.sun.proxy.$Proxy10.delete(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.delete(ClientNamenodeProtocolTranslatorPB.java:540) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:187) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:102) at com.sun.proxy.$Proxy11.delete(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.delete(DFSClient.java:2052) ... 15 more 2016-12-16 16:52:26,028 INFO metastore.HiveMetaStore (HiveMetaStore.java:newRawStore(589)) - 0: Opening raw store with implemenation class:org.apache.hadoop.hive.metastore.ObjectStore 2016-12-16 16:52:26,070 INFO metastore.ObjectStore (ObjectStore.java:initialize(289)) - ObjectStore, initialize called 2016-12-16 16:52:27,038 INFO metastore.ObjectStore (ObjectStore.java:getPMF(376)) - Setting MetaStore object pin classes with hive.metastore.cache.pinobjtypes="Table,Database,Type,FieldSchema,Order" 2016-12-16 16:52:28,556 INFO metastore.MetaStoreDirectSql (MetaStoreDirectSql.java:(141)) - Using direct SQL, underlying DB is MYSQL 2016-12-16 16:52:28,559 INFO metastore.ObjectStore (ObjectStore.java:setConf(272)) - Initialized ObjectStore 2016-12-16 16:52:28,807 INFO metastore.HiveMetaStore (HiveMetaStore.java:createDefaultRoles_core(663)) - Added admin role in metastore 2016-12-16 16:52:28,810 INFO metastore.HiveMetaStore (HiveMetaStore.java:createDefaultRoles_core(672)) - Added public role in metastore 2016-12-16 16:52:28,888 INFO metastore.HiveMetaStore (HiveMetaStore.java:addAdminUsers_core(712)) - No user is added in admin role, since config is empty 2016-12-16 16:52:29,038 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(746)) - 0: get_all_databases 2016-12-16 16:52:29,041 INFO HiveMetaStore.audit (HiveMetaStore.java:logAuditEvent(371)) - ugi=hive ip=unknown-ip-addr cmd=get_all_databases 2016-12-16 16:52:29,058 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(746)) - 0: get_functions: db=bigsql pat=* 2016-12-16 16:52:29,058 INFO HiveMetaStore.audit (HiveMetaStore.java:logAuditEvent(371)) - ugi=hive ip=unknown-ip-addr cmd=get_functions: db=bigsql pat=* 2016-12-16 16:52:29,130 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(746)) - 0: get_functions: db=default pat=* 2016-12-16 16:52:29,130 INFO HiveMetaStore.audit (HiveMetaStore.java:logAuditEvent(371)) - ugi=hive ip=unknown-ip-addr cmd=get_functions: db=default pat=* 2016-12-16 16:52:29,132 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(746)) - 0: get_functions: db=userdb pat=* 2016-12-16 16:52:29,133 INFO HiveMetaStore.audit (HiveMetaStore.java:logAuditEvent(371)) - ugi=hive ip=unknown-ip-addr cmd=get_functions: db=userdb pat=* 2016-12-16 16:52:29,228 INFO session.SessionState (SessionState.java:createPath(641)) - Created local directory: /tmp/92cce445-196c-456d-8983-89b51a984feb_resources 2016-12-16 16:52:29,242 INFO session.SessionState (SessionState.java:createPath(641)) - Created HDFS directory: /tmp/hive/hive/92cce445-196c-456d-8983-89b51a984feb 2016-12-16 16:52:29,244 INFO session.SessionState (SessionState.java:createPath(641)) - Created local directory: /tmp/hive/92cce445-196c-456d-8983-89b51a984feb 2016-12-16 16:52:29,249 INFO session.SessionState (SessionState.java:createPath(641)) - Created HDFS directory: /tmp/hive/hive/92cce445-196c-456d-8983-89b51a984feb/_tmp_space.db 2016-12-16 16:52:29,727 INFO service.CompositeService (SessionManager.java:initOperationLogRootDir(135)) - Operation log root directory is created: /tmp/hive/operation_logs 2016-12-16 16:52:29,736 INFO service.CompositeService (SessionManager.java:createBackgroundOperationPool(90)) - HiveServer2: Background operation thread pool size: 100 2016-12-16 16:52:29,736 INFO service.CompositeService (SessionManager.java:createBackgroundOperationPool(92)) - HiveServer2: Background operation thread wait queue size: 100 2016-12-16 16:52:29,736 INFO service.CompositeService (SessionManager.java:createBackgroundOperationPool(95)) - HiveServer2: Background operation thread keepalive time: 10 seconds 2016-12-16 16:52:29,745 INFO service.AbstractService (AbstractService.java:init(89)) - Service:OperationManager is inited. 2016-12-16 16:52:29,745 INFO service.AbstractService (AbstractService.java:init(89)) - Service:SessionManager is inited. 2016-12-16 16:52:29,745 INFO service.AbstractService (AbstractService.java:init(89)) - Service:CLIService is inited. 2016-12-16 16:52:29,745 INFO service.AbstractService (AbstractService.java:init(89)) - Service:ThriftBinaryCLIService is inited. 2016-12-16 16:52:29,745 INFO service.AbstractService (AbstractService.java:init(89)) - Service:HiveServer2 is inited. 2016-12-16 16:52:29,746 INFO service.AbstractService (AbstractService.java:start(104)) - Service:OperationManager is started. 2016-12-16 16:52:29,746 INFO service.AbstractService (AbstractService.java:start(104)) - Service:SessionManager is started. 2016-12-16 16:52:29,747 INFO service.AbstractService (AbstractService.java:start(104)) - Service:CLIService is started. 2016-12-16 16:52:29,749 INFO metastore.ObjectStore (ObjectStore.java:initialize(289)) - ObjectStore, initialize called 2016-12-16 16:52:29,755 INFO metastore.MetaStoreDirectSql (MetaStoreDirectSql.java:(141)) - Using direct SQL, underlying DB is MYSQL 2016-12-16 16:52:29,755 INFO metastore.ObjectStore (ObjectStore.java:setConf(272)) - Initialized ObjectStore 2016-12-16 16:52:29,756 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(746)) - 0: get_databases: default 2016-12-16 16:52:29,756 INFO HiveMetaStore.audit (HiveMetaStore.java:logAuditEvent(371)) - ugi=hive ip=unknown-ip-addr cmd=get_databases: default 2016-12-16 16:52:29,760 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(746)) - 0: Shutting down the object store... 2016-12-16 16:52:29,760 INFO HiveMetaStore.audit (HiveMetaStore.java:logAuditEvent(371)) - ugi=hive ip=unknown-ip-addr cmd=Shutting down the object store... 2016-12-16 16:52:29,760 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(746)) - 0: Metastore shutdown complete. 2016-12-16 16:52:29,760 INFO HiveMetaStore.audit (HiveMetaStore.java:logAuditEvent(371)) - ugi=hive ip=unknown-ip-addr cmd=Metastore shutdown complete. 2016-12-16 16:52:29,760 INFO service.AbstractService (AbstractService.java:start(104)) - Service:ThriftBinaryCLIService is started. 2016-12-16 16:52:29,761 INFO service.AbstractService (AbstractService.java:start(104)) - Service:HiveServer2 is started. 2016-12-16 16:52:29,781 INFO thrift.ThriftCLIService (ThriftBinaryCLIService.java:run(98)) - Starting ThriftBinaryCLIService on port 10000 with 5...500 worker threads 2016-12-16 16:52:37,217 INFO thrift.ThriftCLIService (ThriftCLIService.java:OpenSession(294)) - Client protocol version: HIVE_CLI_SERVICE_PROTOCOL_V8 2016-12-16 16:52:37,333 INFO session.SessionState (SessionState.java:createPath(641)) - Created local directory: /tmp/c9f68417-fd60-42fd-925c-828dfa55b7e9_resources 2016-12-16 16:52:37,356 INFO session.SessionState (SessionState.java:createPath(641)) - Created HDFS directory: /tmp/hive/anonymous/c9f68417-fd60-42fd-925c-828dfa55b7e9 2016-12-16 16:52:37,359 INFO session.SessionState (SessionState.java:createPath(641)) - Created local directory: /tmp/hive/c9f68417-fd60-42fd-925c-828dfa55b7e9 2016-12-16 16:52:37,368 INFO session.SessionState (SessionState.java:createPath(641)) - Created HDFS directory: /tmp/hive/anonymous/c9f68417-fd60-42fd-925c-828dfa55b7e9/_tmp_space.db 2016-12-16 16:52:37,372 INFO session.HiveSessionImpl (HiveSessionImpl.java:setOperationLogSessionDir(236)) - Operation log session directory is created: /tmp/hive/operation_logs/c9f68417-fd60-42fd-925c-828dfa55b7e9 2016-12-16 16:53:36,331 INFO thrift.ThriftCLIService (ThriftCLIService.java:OpenSession(294)) - Client protocol version: HIVE_CLI_SERVICE_PROTOCOL_V8 2016-12-16 16:53:36,354 INFO session.SessionState (SessionState.java:createPath(641)) - Created local directory: /tmp/89334169-eba7-447d-86fd-1d62708303d9_resources 2016-12-16 16:53:36,360 INFO session.SessionState (SessionState.java:createPath(641)) - Created HDFS directory: /tmp/hive/anonymous/89334169-eba7-447d-86fd-1d62708303d9 2016-12-16 16:53:36,361 INFO session.SessionState (SessionState.java:createPath(641)) - Created local directory: /tmp/hive/89334169-eba7-447d-86fd-1d62708303d9 2016-12-16 16:53:36,375 INFO session.SessionState (SessionState.java:createPath(641)) - Created HDFS directory: /tmp/hive/anonymous/89334169-eba7-447d-86fd-1d62708303d9/_tmp_space.db 2016-12-16 16:53:36,378 INFO session.HiveSessionImpl (HiveSessionImpl.java:setOperationLogSessionDir(236)) - Operation log session directory is created: /tmp/hive/operation_logs/89334169-eba7-447d-86fd-1d62708303d9 2016-12-16 16:54:36,359 INFO thrift.ThriftCLIService (ThriftCLIService.java:OpenSession(294)) - Client protocol version: HIVE_CLI_SERVICE_PROTOCOL_V8 2016-12-16 16:54:36,382 INFO session.SessionState (SessionState.java:createPath(641)) - Created local directory: /tmp/3988d0a9-809e-4a8a-b757-52df36e08c7e_resources 2016-12-16 16:54:36,386 INFO session.SessionState (SessionState.java:createPath(641)) - Created HDFS directory: /tmp/hive/anonymous/3988d0a9-809e-4a8a-b757-52df36e08c7e 2016-12-16 16:54:36,388 INFO session.SessionState (SessionState.java:createPath(641)) - Created local directory: /tmp/hive/3988d0a9-809e-4a8a-b757-52df36e08c7e 2016-12-16 16:54:36,392 INFO session.SessionState (SessionState.java:createPath(641)) - Created HDFS directory: /tmp/hive/anonymous/3988d0a9-809e-4a8a-b757-52df36e08c7e/_tmp_space.db 2016-12-16 16:54:36,394 INFO session.HiveSessionImpl (HiveSessionImpl.java:setOperationLogSessionDir(236)) - Operation log session directory is created: /tmp/hive/operation_logs/3988d0a9-809e-4a8a-b757-52df36e08c7e 2016-12-16 16:55:36,361 INFO thrift.ThriftCLIService (ThriftCLIService.java:OpenSession(294)) - Client protocol version: HIVE_CLI_SERVICE_PROTOCOL_V8 2016-12-16 16:55:36,377 INFO session.SessionState (SessionState.java:createPath(641)) - Created local directory: /tmp/bcc4518b-25a8-46f7-97aa-31f33a3bfe87_resources 2016-12-16 16:55:36,389 INFO session.SessionState (SessionState.java:createPath(641)) - Created HDFS directory: /tmp/hive/anonymous/bcc4518b-25a8-46f7-97aa-31f33a3bfe87 2016-12-16 16:55:36,394 INFO session.SessionState (SessionState.java:createPath(641)) - Created local directory: /tmp/hive/bcc4518b-25a8-46f7-97aa-31f33a3bfe87 2016-12-16 16:55:36,409 INFO session.SessionState (SessionState.java:createPath(641)) - Created HDFS directory: /tmp/hive/anonymous/bcc4518b-25a8-46f7-97aa-31f33a3bfe87/_tmp_space.db 2016-12-16 16:55:36,411 INFO session.HiveSessionImpl (HiveSessionImpl.java:setOperationLogSessionDir(236)) - Operation log session directory is created: /tmp/hive/operation_logs/bcc4518b-25a8-46f7-97aa-31f33a3bfe87 2016-12-16 16:56:36,410 INFO thrift.ThriftCLIService (ThriftCLIService.java:OpenSession(294)) - Client protocol version: HIVE_CLI_SERVICE_PROTOCOL_V8 2016-12-16 16:56:36,427 INFO session.SessionState (SessionState.java:createPath(641)) - Created local directory: /tmp/a4c74656-6fbd-4d4d-b132-6dc33f38b0f0_resources 2016-12-16 16:56:36,440 INFO session.SessionState (SessionState.java:createPath(641)) - Created HDFS directory: /tmp/hive/anonymous/a4c74656-6fbd-4d4d-b132-6dc33f38b0f0 2016-12-16 16:56:36,442 INFO session.SessionState (SessionState.java:createPath(641)) - Created local directory: /tmp/hive/a4c74656-6fbd-4d4d-b132-6dc33f38b0f0 2016-12-16 16:56:36,467 INFO session.SessionState (SessionState.java:createPath(641)) - Created HDFS directory: /tmp/hive/anonymous/a4c74656-6fbd-4d4d-b132-6dc33f38b0f0/_tmp_space.db 2016-12-16 16:56:36,482 INFO session.HiveSessionImpl (HiveSessionImpl.java:setOperationLogSessionDir(236)) - Operation log session directory is created: /tmp/hive/operation_logs/a4c74656-6fbd-4d4d-b132-6dc33f38b0f0 2016-12-16 16:57:18,226 WARN thrift.ThriftCLIService (ThriftCLIService.java:ExecuteStatement(492)) - Error executing statement: org.apache.hive.service.cli.HiveSQLException: Invalid SessionHandle: SessionHandle [85d9e7a7-a516-422c-a6e9-cef0ecfe2f11] at org.apache.hive.service.cli.session.SessionManager.getSession(SessionManager.java:318) at org.apache.hive.service.cli.CLIService.executeStatement(CLIService.java:261) at org.apache.hive.service.cli.thrift.ThriftCLIService.ExecuteStatement(ThriftCLIService.java:486) at org.apache.hive.service.cli.thrift.TCLIService$Processor$ExecuteStatement.getResult(TCLIService.java:1313) at org.apache.hive.service.cli.thrift.TCLIService$Processor$ExecuteStatement.getResult(TCLIService.java:1298) at org.apache.thrift.ProcessFunction.process(ProcessFunction.java:39) at org.apache.thrift.TBaseProcessor.process(TBaseProcessor.java:39) at org.apache.hive.service.auth.TSetIpAddressProcessor.process(TSetIpAddressProcessor.java:56) at org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:285) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:745) 2016-12-16 16:57:20,796 INFO thrift.ThriftCLIService (ThriftCLIService.java:OpenSession(294)) - Client protocol version: HIVE_CLI_SERVICE_PROTOCOL_V6 2016-12-16 16:57:20,807 INFO session.SessionState (SessionState.java:createPath(641)) - Created local directory: /tmp/08a94645-954e-42ac-ac1f-88d84adae950_resources 2016-12-16 16:57:20,811 INFO session.SessionState (SessionState.java:createPath(641)) - Created HDFS directory: /tmp/hive/admin/08a94645-954e-42ac-ac1f-88d84adae950 2016-12-16 16:57:20,813 INFO session.SessionState (SessionState.java:createPath(641)) - Created local directory: /tmp/hive/08a94645-954e-42ac-ac1f-88d84adae950 2016-12-16 16:57:20,817 INFO session.SessionState (SessionState.java:createPath(641)) - Created HDFS directory: /tmp/hive/admin/08a94645-954e-42ac-ac1f-88d84adae950/_tmp_space.db 2016-12-16 16:57:20,818 INFO session.HiveSessionImpl (HiveSessionImpl.java:setOperationLogSessionDir(236)) - Operation log session directory is created: /tmp/hive/operation_logs/08a94645-954e-42ac-ac1f-88d84adae950 2016-12-16 16:57:20,849 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 16:57:20,888 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 16:57:20,893 INFO parse.ParseDriver (ParseDriver.java:parse(185)) - Parsing command: show databases like '*' 2016-12-16 16:57:21,816 INFO parse.ParseDriver (ParseDriver.java:parse(209)) - Parse Completed 2016-12-16 16:57:21,817 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 16:57:21,821 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 16:57:21,878 INFO ql.Driver (Driver.java:compile(436)) - Semantic Analysis Completed 2016-12-16 16:57:21,879 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 16:57:22,098 INFO exec.ListSinkOperator (Operator.java:initialize(332)) - Initializing operator OP[0] 2016-12-16 16:57:22,099 INFO exec.ListSinkOperator (Operator.java:initialize(372)) - Initialization Done 0 OP 2016-12-16 16:57:22,099 INFO exec.ListSinkOperator (Operator.java:initializeChildren(429)) - Operator 0 OP initialized 2016-12-16 16:57:22,110 INFO ql.Driver (Driver.java:getSchema(240)) - Returning Hive schema: Schema(fieldSchemas:[FieldSchema(name:database_name, type:string, comment:from deserializer)], properties:null) 2016-12-16 16:57:22,110 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 16:57:22,115 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 16:57:22,116 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 16:57:22,116 INFO ql.Driver (Driver.java:checkConcurrency(160)) - Concurrency mode is disabled, not creating a lock manager 2016-12-16 16:57:22,116 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 16:57:22,116 INFO ql.Driver (Driver.java:execute(1328)) - Starting command(queryId=hive_20161216165720_ed87768f-ffb8-445d-add0-35c0f73e348d): show databases like '*' 2016-12-16 16:57:22,504 INFO impl.TimelineClientImpl (TimelineClientImpl.java:serviceInit(296)) - Timeline service address: http://ibm-biginsight.com:8188/ws/v1/timeline/ 2016-12-16 16:57:22,505 INFO hooks.ATSHook (ATSHook.java:(84)) - Created ATS Hook 2016-12-16 16:57:22,505 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 16:57:22,507 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 16:57:22,510 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 16:57:22,510 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 16:57:22,510 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 16:57:22,516 INFO ql.Driver (Driver.java:launchTask(1651)) - Starting task [Stage-0:DDL] in serial mode 2016-12-16 16:57:22,517 INFO exec.DDLTask (DDLTask.java:showDatabases(2220)) - pattern: * 2016-12-16 16:57:22,517 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(746)) - 1: get_databases: * 2016-12-16 16:57:22,518 INFO HiveMetaStore.audit (HiveMetaStore.java:logAuditEvent(371)) - ugi=admin ip=unknown-ip-addr cmd=get_databases: * 2016-12-16 16:57:22,518 INFO metastore.HiveMetaStore (HiveMetaStore.java:newRawStore(589)) - 1: Opening raw store with implemenation class:org.apache.hadoop.hive.metastore.ObjectStore 2016-12-16 16:57:22,520 INFO metastore.ObjectStore (ObjectStore.java:initialize(289)) - ObjectStore, initialize called 2016-12-16 16:57:22,527 INFO metastore.MetaStoreDirectSql (MetaStoreDirectSql.java:(141)) - Using direct SQL, underlying DB is MYSQL 2016-12-16 16:57:22,527 INFO metastore.ObjectStore (ObjectStore.java:setConf(272)) - Initialized ObjectStore 2016-12-16 16:57:22,531 INFO exec.DDLTask (DDLTask.java:showDatabases(2225)) - results : 3 2016-12-16 16:57:22,536 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 16:57:22,537 INFO hooks.ATSHook (ATSHook.java:(84)) - Created ATS Hook 2016-12-16 16:57:22,537 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 16:57:22,537 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 16:57:22,538 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 16:57:22,539 INFO ql.Driver (SessionState.java:printInfo(954)) - OK 2016-12-16 16:57:22,539 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 16:57:22,539 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 16:57:22,539 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 16:57:22,588 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(249)) - Total input paths to process : 1 2016-12-16 16:57:22,849 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 16:57:22,850 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 16:57:22,850 INFO parse.ParseDriver (ParseDriver.java:parse(185)) - Parsing command: use bigsql 2016-12-16 16:57:22,852 INFO parse.ParseDriver (ParseDriver.java:parse(209)) - Parse Completed 2016-12-16 16:57:22,853 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 16:57:22,853 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 16:57:22,853 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(746)) - 1: get_database: bigsql 2016-12-16 16:57:22,854 INFO HiveMetaStore.audit (HiveMetaStore.java:logAuditEvent(371)) - ugi=admin ip=unknown-ip-addr cmd=get_database: bigsql 2016-12-16 16:57:22,861 INFO metadata.HiveUtils (HiveUtils.java:getMetaStoreAuthorizeProviderManagers(353)) - Adding metastore authorization provider: org.apache.hadoop.hive.ql.security.authorization.StorageBasedAuthorizationProvider 2016-12-16 16:57:22,887 ERROR metastore.RetryingHMSHandler (RetryingHMSHandler.java:invoke(155)) - MetaException(message:org.apache.hadoop.security.AccessControlException: Permission denied: user=admin, access=EXECUTE, inode="/apps/hive/warehouse/bigsql.db":hive:hadoop:drwxrwx--- at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.check(FSPermissionChecker.java:319) at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.checkTraverse(FSPermissionChecker.java:259) at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.checkPermission(FSPermissionChecker.java:205) at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.checkPermission(FSPermissionChecker.java:190) at org.apache.hadoop.hdfs.server.namenode.FSDirectory.checkPermission(FSDirectory.java:1698) at org.apache.hadoop.hdfs.server.namenode.FSDirStatAndListingOp.getFileInfo(FSDirStatAndListingOp.java:108) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getFileInfo(FSNamesystem.java:3857) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getFileInfo(NameNodeRpcServer.java:1006) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getFileInfo(ClientNamenodeProtocolServerSideTranslatorPB.java:843) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:616) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:969) at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2049) at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2045) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:415) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2043) ) at org.apache.hadoop.hive.ql.security.authorization.AuthorizationPreEventListener.metaException(AuthorizationPreEventListener.java:411) at org.apache.hadoop.hive.ql.security.authorization.AuthorizationPreEventListener.authorizeReadDatabase(AuthorizationPreEventListener.java:210) at org.apache.hadoop.hive.ql.security.authorization.AuthorizationPreEventListener.onEvent(AuthorizationPreEventListener.java:152) at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.firePreEvent(HiveMetaStore.java:1992) at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.get_database(HiveMetaStore.java:931) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.apache.hadoop.hive.metastore.RetryingHMSHandler.invoke(RetryingHMSHandler.java:107) at com.sun.proxy.$Proxy16.get_database(Unknown Source) at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.getDatabase(HiveMetaStoreClient.java:1170) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.invoke(RetryingMetaStoreClient.java:156) at com.sun.proxy.$Proxy17.getDatabase(Unknown Source) at org.apache.hadoop.hive.ql.metadata.Hive.getDatabase(Hive.java:1301) at org.apache.hadoop.hive.ql.parse.BaseSemanticAnalyzer.getDatabase(BaseSemanticAnalyzer.java:1384) at org.apache.hadoop.hive.ql.parse.DDLSemanticAnalyzer.analyzeSwitchDatabase(DDLSemanticAnalyzer.java:825) at org.apache.hadoop.hive.ql.parse.DDLSemanticAnalyzer.analyzeInternal(DDLSemanticAnalyzer.java:444) at org.apache.hadoop.hive.ql.parse.BaseSemanticAnalyzer.analyze(BaseSemanticAnalyzer.java:227) at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:424) at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:308) at org.apache.hadoop.hive.ql.Driver.compileInternal(Driver.java:1122) at org.apache.hadoop.hive.ql.Driver.compileAndRespond(Driver.java:1116) at org.apache.hive.service.cli.operation.SQLOperation.prepare(SQLOperation.java:110) at org.apache.hive.service.cli.operation.SQLOperation.runInternal(SQLOperation.java:181) at org.apache.hive.service.cli.operation.Operation.run(Operation.java:257) at org.apache.hive.service.cli.session.HiveSessionImpl.executeStatementInternal(HiveSessionImpl.java:388) at org.apache.hive.service.cli.session.HiveSessionImpl.executeStatement(HiveSessionImpl.java:369) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.apache.hive.service.cli.session.HiveSessionProxy.invoke(HiveSessionProxy.java:78) at org.apache.hive.service.cli.session.HiveSessionProxy.access$000(HiveSessionProxy.java:36) at org.apache.hive.service.cli.session.HiveSessionProxy$1.run(HiveSessionProxy.java:63) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:415) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657) at org.apache.hive.service.cli.session.HiveSessionProxy.invoke(HiveSessionProxy.java:59) at com.sun.proxy.$Proxy21.executeStatement(Unknown Source) at org.apache.hive.service.cli.CLIService.executeStatement(CLIService.java:261) at org.apache.hive.service.cli.thrift.ThriftCLIService.ExecuteStatement(ThriftCLIService.java:486) at org.apache.hive.service.cli.thrift.TCLIService$Processor$ExecuteStatement.getResult(TCLIService.java:1313) at org.apache.hive.service.cli.thrift.TCLIService$Processor$ExecuteStatement.getResult(TCLIService.java:1298) at org.apache.thrift.ProcessFunction.process(ProcessFunction.java:39) at org.apache.thrift.TBaseProcessor.process(TBaseProcessor.java:39) at org.apache.hive.service.auth.TSetIpAddressProcessor.process(TSetIpAddressProcessor.java:56) at org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:285) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:745) Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: org.apache.hadoop.security.AccessControlException: Permission denied: user=admin, access=EXECUTE, inode="/apps/hive/warehouse/bigsql.db":hive:hadoop:drwxrwx--- at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.check(FSPermissionChecker.java:319) at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.checkTraverse(FSPermissionChecker.java:259) at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.checkPermission(FSPermissionChecker.java:205) at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.checkPermission(FSPermissionChecker.java:190) at org.apache.hadoop.hdfs.server.namenode.FSDirectory.checkPermission(FSDirectory.java:1698) at org.apache.hadoop.hdfs.server.namenode.FSDirStatAndListingOp.getFileInfo(FSDirStatAndListingOp.java:108) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getFileInfo(FSNamesystem.java:3857) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getFileInfo(NameNodeRpcServer.java:1006) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getFileInfo(ClientNamenodeProtocolServerSideTranslatorPB.java:843) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:616) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:969) at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2049) at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2045) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:415) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2043) at org.apache.hadoop.hive.ql.security.authorization.StorageBasedAuthorizationProvider.hiveException(StorageBasedAuthorizationProvider.java:427) at org.apache.hadoop.hive.ql.security.authorization.StorageBasedAuthorizationProvider.authorize(StorageBasedAuthorizationProvider.java:346) at org.apache.hadoop.hive.ql.security.authorization.StorageBasedAuthorizationProvider.authorize(StorageBasedAuthorizationProvider.java:152) at org.apache.hadoop.hive.ql.security.authorization.AuthorizationPreEventListener.authorizeReadDatabase(AuthorizationPreEventListener.java:204) ... 53 more Caused by: org.apache.hadoop.security.AccessControlException: Permission denied: user=admin, access=EXECUTE, inode="/apps/hive/warehouse/bigsql.db":hive:hadoop:drwxrwx--- at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.check(FSPermissionChecker.java:319) at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.checkTraverse(FSPermissionChecker.java:259) at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.checkPermission(FSPermissionChecker.java:205) at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.checkPermission(FSPermissionChecker.java:190) at org.apache.hadoop.hdfs.server.namenode.FSDirectory.checkPermission(FSDirectory.java:1698) at org.apache.hadoop.hdfs.server.namenode.FSDirStatAndListingOp.getFileInfo(FSDirStatAndListingOp.java:108) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getFileInfo(FSNamesystem.java:3857) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getFileInfo(NameNodeRpcServer.java:1006) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getFileInfo(ClientNamenodeProtocolServerSideTranslatorPB.java:843) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:616) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:969) at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2049) at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2045) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:415) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2043) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:526) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:106) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:73) at org.apache.hadoop.hdfs.DFSClient.getFileInfo(DFSClient.java:2118) at org.apache.hadoop.hdfs.DistributedFileSystem$22.doCall(DistributedFileSystem.java:1305) at org.apache.hadoop.hdfs.DistributedFileSystem$22.doCall(DistributedFileSystem.java:1301) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getFileStatus(DistributedFileSystem.java:1301) at org.apache.hadoop.hive.common.FileUtils.getFileStatusOrNull(FileUtils.java:757) at org.apache.hadoop.hive.ql.security.authorization.StorageBasedAuthorizationProvider.checkPermissions(StorageBasedAuthorizationProvider.java:364) at org.apache.hadoop.hive.ql.security.authorization.StorageBasedAuthorizationProvider.authorize(StorageBasedAuthorizationProvider.java:339) ... 55 more Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.security.AccessControlException): Permission denied: user=admin, access=EXECUTE, inode="/apps/hive/warehouse/bigsql.db":hive:hadoop:drwxrwx--- at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.check(FSPermissionChecker.java:319) at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.checkTraverse(FSPermissionChecker.java:259) at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.checkPermission(FSPermissionChecker.java:205) at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.checkPermission(FSPermissionChecker.java:190) at org.apache.hadoop.hdfs.server.namenode.FSDirectory.checkPermission(FSDirectory.java:1698) at org.apache.hadoop.hdfs.server.namenode.FSDirStatAndListingOp.getFileInfo(FSDirStatAndListingOp.java:108) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getFileInfo(FSNamesystem.java:3857) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getFileInfo(NameNodeRpcServer.java:1006) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getFileInfo(ClientNamenodeProtocolServerSideTranslatorPB.java:843) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:616) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:969) at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2049) at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2045) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:415) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2043) at org.apache.hadoop.ipc.Client.call(Client.java:1476) at org.apache.hadoop.ipc.Client.call(Client.java:1407) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:229) at com.sun.proxy.$Proxy10.getFileInfo(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getFileInfo(ClientNamenodeProtocolTranslatorPB.java:771) at sun.reflect.GeneratedMethodAccessor7.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:187) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:102) at com.sun.proxy.$Proxy11.getFileInfo(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getFileInfo(DFSClient.java:2116) ... 62 more 2016-12-16 16:57:22,891 ERROR ql.Driver (SessionState.java:printError(963)) - FAILED: SemanticException MetaException(message:org.apache.hadoop.security.AccessControlException: Permission denied: user=admin, access=EXECUTE, inode="/apps/hive/warehouse/bigsql.db":hive:hadoop:drwxrwx--- at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.check(FSPermissionChecker.java:319) at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.checkTraverse(FSPermissionChecker.java:259) at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.checkPermission(FSPermissionChecker.java:205) at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.checkPermission(FSPermissionChecker.java:190) at org.apache.hadoop.hdfs.server.namenode.FSDirectory.checkPermission(FSDirectory.java:1698) at org.apache.hadoop.hdfs.server.namenode.FSDirStatAndListingOp.getFileInfo(FSDirStatAndListingOp.java:108) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getFileInfo(FSNamesystem.java:3857) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getFileInfo(NameNodeRpcServer.java:1006) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getFileInfo(ClientNamenodeProtocolServerSideTranslatorPB.java:843) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:616) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:969) at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2049) at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2045) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:415) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2043) ) org.apache.hadoop.hive.ql.parse.SemanticException: MetaException(message:org.apache.hadoop.security.AccessControlException: Permission denied: user=admin, access=EXECUTE, inode="/apps/hive/warehouse/bigsql.db":hive:hadoop:drwxrwx--- at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.check(FSPermissionChecker.java:319) at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.checkTraverse(FSPermissionChecker.java:259) at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.checkPermission(FSPermissionChecker.java:205) at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.checkPermission(FSPermissionChecker.java:190) at org.apache.hadoop.hdfs.server.namenode.FSDirectory.checkPermission(FSDirectory.java:1698) at org.apache.hadoop.hdfs.server.namenode.FSDirStatAndListingOp.getFileInfo(FSDirStatAndListingOp.java:108) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getFileInfo(FSNamesystem.java:3857) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getFileInfo(NameNodeRpcServer.java:1006) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getFileInfo(ClientNamenodeProtocolServerSideTranslatorPB.java:843) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:616) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:969) at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2049) at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2045) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:415) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2043) ) at org.apache.hadoop.hive.ql.parse.BaseSemanticAnalyzer.getDatabase(BaseSemanticAnalyzer.java:1386) at org.apache.hadoop.hive.ql.parse.DDLSemanticAnalyzer.analyzeSwitchDatabase(DDLSemanticAnalyzer.java:825) at org.apache.hadoop.hive.ql.parse.DDLSemanticAnalyzer.analyzeInternal(DDLSemanticAnalyzer.java:444) at org.apache.hadoop.hive.ql.parse.BaseSemanticAnalyzer.analyze(BaseSemanticAnalyzer.java:227) at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:424) at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:308) at org.apache.hadoop.hive.ql.Driver.compileInternal(Driver.java:1122) at org.apache.hadoop.hive.ql.Driver.compileAndRespond(Driver.java:1116) at org.apache.hive.service.cli.operation.SQLOperation.prepare(SQLOperation.java:110) at org.apache.hive.service.cli.operation.SQLOperation.runInternal(SQLOperation.java:181) at org.apache.hive.service.cli.operation.Operation.run(Operation.java:257) at org.apache.hive.service.cli.session.HiveSessionImpl.executeStatementInternal(HiveSessionImpl.java:388) at org.apache.hive.service.cli.session.HiveSessionImpl.executeStatement(HiveSessionImpl.java:369) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.apache.hive.service.cli.session.HiveSessionProxy.invoke(HiveSessionProxy.java:78) at org.apache.hive.service.cli.session.HiveSessionProxy.access$000(HiveSessionProxy.java:36) at org.apache.hive.service.cli.session.HiveSessionProxy$1.run(HiveSessionProxy.java:63) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:415) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657) at org.apache.hive.service.cli.session.HiveSessionProxy.invoke(HiveSessionProxy.java:59) at com.sun.proxy.$Proxy21.executeStatement(Unknown Source) at org.apache.hive.service.cli.CLIService.executeStatement(CLIService.java:261) at org.apache.hive.service.cli.thrift.ThriftCLIService.ExecuteStatement(ThriftCLIService.java:486) at org.apache.hive.service.cli.thrift.TCLIService$Processor$ExecuteStatement.getResult(TCLIService.java:1313) at org.apache.hive.service.cli.thrift.TCLIService$Processor$ExecuteStatement.getResult(TCLIService.java:1298) at org.apache.thrift.ProcessFunction.process(ProcessFunction.java:39) at org.apache.thrift.TBaseProcessor.process(TBaseProcessor.java:39) at org.apache.hive.service.auth.TSetIpAddressProcessor.process(TSetIpAddressProcessor.java:56) at org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:285) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:745) Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: MetaException(message:org.apache.hadoop.security.AccessControlException: Permission denied: user=admin, access=EXECUTE, inode="/apps/hive/warehouse/bigsql.db":hive:hadoop:drwxrwx--- at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.check(FSPermissionChecker.java:319) at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.checkTraverse(FSPermissionChecker.java:259) at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.checkPermission(FSPermissionChecker.java:205) at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.checkPermission(FSPermissionChecker.java:190) at org.apache.hadoop.hdfs.server.namenode.FSDirectory.checkPermission(FSDirectory.java:1698) at org.apache.hadoop.hdfs.server.namenode.FSDirStatAndListingOp.getFileInfo(FSDirStatAndListingOp.java:108) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getFileInfo(FSNamesystem.java:3857) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getFileInfo(NameNodeRpcServer.java:1006) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getFileInfo(ClientNamenodeProtocolServerSideTranslatorPB.java:843) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:616) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:969) at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2049) at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2045) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:415) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2043) ) at org.apache.hadoop.hive.ql.metadata.Hive.getDatabase(Hive.java:1305) at org.apache.hadoop.hive.ql.parse.BaseSemanticAnalyzer.getDatabase(BaseSemanticAnalyzer.java:1384) ... 35 more Caused by: MetaException(message:org.apache.hadoop.security.AccessControlException: Permission denied: user=admin, access=EXECUTE, inode="/apps/hive/warehouse/bigsql.db":hive:hadoop:drwxrwx--- at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.check(FSPermissionChecker.java:319) at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.checkTraverse(FSPermissionChecker.java:259) at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.checkPermission(FSPermissionChecker.java:205) at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.checkPermission(FSPermissionChecker.java:190) at org.apache.hadoop.hdfs.server.namenode.FSDirectory.checkPermission(FSDirectory.java:1698) at org.apache.hadoop.hdfs.server.namenode.FSDirStatAndListingOp.getFileInfo(FSDirStatAndListingOp.java:108) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getFileInfo(FSNamesystem.java:3857) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getFileInfo(NameNodeRpcServer.java:1006) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getFileInfo(ClientNamenodeProtocolServerSideTranslatorPB.java:843) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:616) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:969) at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2049) at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2045) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:415) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2043) ) at org.apache.hadoop.hive.ql.security.authorization.AuthorizationPreEventListener.metaException(AuthorizationPreEventListener.java:411) at org.apache.hadoop.hive.ql.security.authorization.AuthorizationPreEventListener.authorizeReadDatabase(AuthorizationPreEventListener.java:210) at org.apache.hadoop.hive.ql.security.authorization.AuthorizationPreEventListener.onEvent(AuthorizationPreEventListener.java:152) at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.firePreEvent(HiveMetaStore.java:1992) at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.get_database(HiveMetaStore.java:931) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.apache.hadoop.hive.metastore.RetryingHMSHandler.invoke(RetryingHMSHandler.java:107) at com.sun.proxy.$Proxy16.get_database(Unknown Source) at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.getDatabase(HiveMetaStoreClient.java:1170) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.invoke(RetryingMetaStoreClient.java:156) at com.sun.proxy.$Proxy17.getDatabase(Unknown Source) at org.apache.hadoop.hive.ql.metadata.Hive.getDatabase(Hive.java:1301) ... 36 more Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: org.apache.hadoop.security.AccessControlException: Permission denied: user=admin, access=EXECUTE, inode="/apps/hive/warehouse/bigsql.db":hive:hadoop:drwxrwx--- at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.check(FSPermissionChecker.java:319) at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.checkTraverse(FSPermissionChecker.java:259) at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.checkPermission(FSPermissionChecker.java:205) at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.checkPermission(FSPermissionChecker.java:190) at org.apache.hadoop.hdfs.server.namenode.FSDirectory.checkPermission(FSDirectory.java:1698) at org.apache.hadoop.hdfs.server.namenode.FSDirStatAndListingOp.getFileInfo(FSDirStatAndListingOp.java:108) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getFileInfo(FSNamesystem.java:3857) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getFileInfo(NameNodeRpcServer.java:1006) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getFileInfo(ClientNamenodeProtocolServerSideTranslatorPB.java:843) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:616) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:969) at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2049) at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2045) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:415) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2043) at org.apache.hadoop.hive.ql.security.authorization.StorageBasedAuthorizationProvider.hiveException(StorageBasedAuthorizationProvider.java:427) at org.apache.hadoop.hive.ql.security.authorization.StorageBasedAuthorizationProvider.authorize(StorageBasedAuthorizationProvider.java:346) at org.apache.hadoop.hive.ql.security.authorization.StorageBasedAuthorizationProvider.authorize(StorageBasedAuthorizationProvider.java:152) at org.apache.hadoop.hive.ql.security.authorization.AuthorizationPreEventListener.authorizeReadDatabase(AuthorizationPreEventListener.java:204) ... 53 more Caused by: org.apache.hadoop.security.AccessControlException: Permission denied: user=admin, access=EXECUTE, inode="/apps/hive/warehouse/bigsql.db":hive:hadoop:drwxrwx--- at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.check(FSPermissionChecker.java:319) at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.checkTraverse(FSPermissionChecker.java:259) at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.checkPermission(FSPermissionChecker.java:205) at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.checkPermission(FSPermissionChecker.java:190) at org.apache.hadoop.hdfs.server.namenode.FSDirectory.checkPermission(FSDirectory.java:1698) at org.apache.hadoop.hdfs.server.namenode.FSDirStatAndListingOp.getFileInfo(FSDirStatAndListingOp.java:108) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getFileInfo(FSNamesystem.java:3857) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getFileInfo(NameNodeRpcServer.java:1006) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getFileInfo(ClientNamenodeProtocolServerSideTranslatorPB.java:843) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:616) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:969) at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2049) at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2045) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:415) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2043) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:526) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:106) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:73) at org.apache.hadoop.hdfs.DFSClient.getFileInfo(DFSClient.java:2118) at org.apache.hadoop.hdfs.DistributedFileSystem$22.doCall(DistributedFileSystem.java:1305) at org.apache.hadoop.hdfs.DistributedFileSystem$22.doCall(DistributedFileSystem.java:1301) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getFileStatus(DistributedFileSystem.java:1301) at org.apache.hadoop.hive.common.FileUtils.getFileStatusOrNull(FileUtils.java:757) at org.apache.hadoop.hive.ql.security.authorization.StorageBasedAuthorizationProvider.checkPermissions(StorageBasedAuthorizationProvider.java:364) at org.apache.hadoop.hive.ql.security.authorization.StorageBasedAuthorizationProvider.authorize(StorageBasedAuthorizationProvider.java:339) ... 55 more Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.security.AccessControlException): Permission denied: user=admin, access=EXECUTE, inode="/apps/hive/warehouse/bigsql.db":hive:hadoop:drwxrwx--- at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.check(FSPermissionChecker.java:319) at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.checkTraverse(FSPermissionChecker.java:259) at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.checkPermission(FSPermissionChecker.java:205) at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.checkPermission(FSPermissionChecker.java:190) at org.apache.hadoop.hdfs.server.namenode.FSDirectory.checkPermission(FSDirectory.java:1698) at org.apache.hadoop.hdfs.server.namenode.FSDirStatAndListingOp.getFileInfo(FSDirStatAndListingOp.java:108) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getFileInfo(FSNamesystem.java:3857) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getFileInfo(NameNodeRpcServer.java:1006) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getFileInfo(ClientNamenodeProtocolServerSideTranslatorPB.java:843) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:616) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:969) at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2049) at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2045) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:415) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2043) at org.apache.hadoop.ipc.Client.call(Client.java:1476) at org.apache.hadoop.ipc.Client.call(Client.java:1407) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:229) at com.sun.proxy.$Proxy10.getFileInfo(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getFileInfo(ClientNamenodeProtocolTranslatorPB.java:771) at sun.reflect.GeneratedMethodAccessor7.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:187) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:102) at com.sun.proxy.$Proxy11.getFileInfo(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getFileInfo(DFSClient.java:2116) ... 62 more 2016-12-16 16:57:22,891 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 16:57:22,891 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 16:57:22,892 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 16:57:22,892 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 16:57:22,892 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 16:57:22,892 WARN thrift.ThriftCLIService (ThriftCLIService.java:ExecuteStatement(492)) - Error executing statement: org.apache.hive.service.cli.HiveSQLException: Error while compiling statement: FAILED: SemanticException MetaException(message:org.apache.hadoop.security.AccessControlException: Permission denied: user=admin, access=EXECUTE, inode="/apps/hive/warehouse/bigsql.db":hive:hadoop:drwxrwx--- at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.check(FSPermissionChecker.java:319) at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.checkTraverse(FSPermissionChecker.java:259) at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.checkPermission(FSPermissionChecker.java:205) at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.checkPermission(FSPermissionChecker.java:190) at org.apache.hadoop.hdfs.server.namenode.FSDirectory.checkPermission(FSDirectory.java:1698) at org.apache.hadoop.hdfs.server.namenode.FSDirStatAndListingOp.getFileInfo(FSDirStatAndListingOp.java:108) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getFileInfo(FSNamesystem.java:3857) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getFileInfo(NameNodeRpcServer.java:1006) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getFileInfo(ClientNamenodeProtocolServerSideTranslatorPB.java:843) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:616) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:969) at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2049) at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2045) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:415) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2043) ) at org.apache.hive.service.cli.operation.Operation.toSQLException(Operation.java:315) at org.apache.hive.service.cli.operation.SQLOperation.prepare(SQLOperation.java:112) at org.apache.hive.service.cli.operation.SQLOperation.runInternal(SQLOperation.java:181) at org.apache.hive.service.cli.operation.Operation.run(Operation.java:257) at org.apache.hive.service.cli.session.HiveSessionImpl.executeStatementInternal(HiveSessionImpl.java:388) at org.apache.hive.service.cli.session.HiveSessionImpl.executeStatement(HiveSessionImpl.java:369) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.apache.hive.service.cli.session.HiveSessionProxy.invoke(HiveSessionProxy.java:78) at org.apache.hive.service.cli.session.HiveSessionProxy.access$000(HiveSessionProxy.java:36) at org.apache.hive.service.cli.session.HiveSessionProxy$1.run(HiveSessionProxy.java:63) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:415) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657) at org.apache.hive.service.cli.session.HiveSessionProxy.invoke(HiveSessionProxy.java:59) at com.sun.proxy.$Proxy21.executeStatement(Unknown Source) at org.apache.hive.service.cli.CLIService.executeStatement(CLIService.java:261) at org.apache.hive.service.cli.thrift.ThriftCLIService.ExecuteStatement(ThriftCLIService.java:486) at org.apache.hive.service.cli.thrift.TCLIService$Processor$ExecuteStatement.getResult(TCLIService.java:1313) at org.apache.hive.service.cli.thrift.TCLIService$Processor$ExecuteStatement.getResult(TCLIService.java:1298) at org.apache.thrift.ProcessFunction.process(ProcessFunction.java:39) at org.apache.thrift.TBaseProcessor.process(TBaseProcessor.java:39) at org.apache.hive.service.auth.TSetIpAddressProcessor.process(TSetIpAddressProcessor.java:56) at org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:285) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:745) Caused by: org.apache.hadoop.hive.ql.parse.SemanticException: MetaException(message:org.apache.hadoop.security.AccessControlException: Permission denied: user=admin, access=EXECUTE, inode="/apps/hive/warehouse/bigsql.db":hive:hadoop:drwxrwx--- at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.check(FSPermissionChecker.java:319) at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.checkTraverse(FSPermissionChecker.java:259) at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.checkPermission(FSPermissionChecker.java:205) at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.checkPermission(FSPermissionChecker.java:190) at org.apache.hadoop.hdfs.server.namenode.FSDirectory.checkPermission(FSDirectory.java:1698) at org.apache.hadoop.hdfs.server.namenode.FSDirStatAndListingOp.getFileInfo(FSDirStatAndListingOp.java:108) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getFileInfo(FSNamesystem.java:3857) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getFileInfo(NameNodeRpcServer.java:1006) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getFileInfo(ClientNamenodeProtocolServerSideTranslatorPB.java:843) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:616) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:969) at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2049) at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2045) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:415) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2043) ) at org.apache.hadoop.hive.ql.parse.BaseSemanticAnalyzer.getDatabase(BaseSemanticAnalyzer.java:1386) at org.apache.hadoop.hive.ql.parse.DDLSemanticAnalyzer.analyzeSwitchDatabase(DDLSemanticAnalyzer.java:825) at org.apache.hadoop.hive.ql.parse.DDLSemanticAnalyzer.analyzeInternal(DDLSemanticAnalyzer.java:444) at org.apache.hadoop.hive.ql.parse.BaseSemanticAnalyzer.analyze(BaseSemanticAnalyzer.java:227) at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:424) at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:308) at org.apache.hadoop.hive.ql.Driver.compileInternal(Driver.java:1122) at org.apache.hadoop.hive.ql.Driver.compileAndRespond(Driver.java:1116) at org.apache.hive.service.cli.operation.SQLOperation.prepare(SQLOperation.java:110) ... 27 more Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: MetaException(message:org.apache.hadoop.security.AccessControlException: Permission denied: user=admin, access=EXECUTE, inode="/apps/hive/warehouse/bigsql.db":hive:hadoop:drwxrwx--- at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.check(FSPermissionChecker.java:319) at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.checkTraverse(FSPermissionChecker.java:259) at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.checkPermission(FSPermissionChecker.java:205) at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.checkPermission(FSPermissionChecker.java:190) at org.apache.hadoop.hdfs.server.namenode.FSDirectory.checkPermission(FSDirectory.java:1698) at org.apache.hadoop.hdfs.server.namenode.FSDirStatAndListingOp.getFileInfo(FSDirStatAndListingOp.java:108) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getFileInfo(FSNamesystem.java:3857) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getFileInfo(NameNodeRpcServer.java:1006) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getFileInfo(ClientNamenodeProtocolServerSideTranslatorPB.java:843) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:616) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:969) at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2049) at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2045) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:415) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2043) ) at org.apache.hadoop.hive.ql.metadata.Hive.getDatabase(Hive.java:1305) at org.apache.hadoop.hive.ql.parse.BaseSemanticAnalyzer.getDatabase(BaseSemanticAnalyzer.java:1384) ... 35 more Caused by: MetaException(message:org.apache.hadoop.security.AccessControlException: Permission denied: user=admin, access=EXECUTE, inode="/apps/hive/warehouse/bigsql.db":hive:hadoop:drwxrwx--- at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.check(FSPermissionChecker.java:319) at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.checkTraverse(FSPermissionChecker.java:259) at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.checkPermission(FSPermissionChecker.java:205) at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.checkPermission(FSPermissionChecker.java:190) at org.apache.hadoop.hdfs.server.namenode.FSDirectory.checkPermission(FSDirectory.java:1698) at org.apache.hadoop.hdfs.server.namenode.FSDirStatAndListingOp.getFileInfo(FSDirStatAndListingOp.java:108) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getFileInfo(FSNamesystem.java:3857) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getFileInfo(NameNodeRpcServer.java:1006) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getFileInfo(ClientNamenodeProtocolServerSideTranslatorPB.java:843) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:616) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:969) at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2049) at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2045) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:415) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2043) ) at org.apache.hadoop.hive.ql.security.authorization.AuthorizationPreEventListener.metaException(AuthorizationPreEventListener.java:411) at org.apache.hadoop.hive.ql.security.authorization.AuthorizationPreEventListener.authorizeReadDatabase(AuthorizationPreEventListener.java:210) at org.apache.hadoop.hive.ql.security.authorization.AuthorizationPreEventListener.onEvent(AuthorizationPreEventListener.java:152) at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.firePreEvent(HiveMetaStore.java:1992) at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.get_database(HiveMetaStore.java:931) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.apache.hadoop.hive.metastore.RetryingHMSHandler.invoke(RetryingHMSHandler.java:107) at com.sun.proxy.$Proxy16.get_database(Unknown Source) at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.getDatabase(HiveMetaStoreClient.java:1170) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.invoke(RetryingMetaStoreClient.java:156) at com.sun.proxy.$Proxy17.getDatabase(Unknown Source) at org.apache.hadoop.hive.ql.metadata.Hive.getDatabase(Hive.java:1301) ... 36 more Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: org.apache.hadoop.security.AccessControlException: Permission denied: user=admin, access=EXECUTE, inode="/apps/hive/warehouse/bigsql.db":hive:hadoop:drwxrwx--- at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.check(FSPermissionChecker.java:319) at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.checkTraverse(FSPermissionChecker.java:259) at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.checkPermission(FSPermissionChecker.java:205) at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.checkPermission(FSPermissionChecker.java:190) at org.apache.hadoop.hdfs.server.namenode.FSDirectory.checkPermission(FSDirectory.java:1698) at org.apache.hadoop.hdfs.server.namenode.FSDirStatAndListingOp.getFileInfo(FSDirStatAndListingOp.java:108) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getFileInfo(FSNamesystem.java:3857) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getFileInfo(NameNodeRpcServer.java:1006) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getFileInfo(ClientNamenodeProtocolServerSideTranslatorPB.java:843) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:616) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:969) at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2049) at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2045) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:415) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2043) at org.apache.hadoop.hive.ql.security.authorization.StorageBasedAuthorizationProvider.hiveException(StorageBasedAuthorizationProvider.java:427) at org.apache.hadoop.hive.ql.security.authorization.StorageBasedAuthorizationProvider.authorize(StorageBasedAuthorizationProvider.java:346) at org.apache.hadoop.hive.ql.security.authorization.StorageBasedAuthorizationProvider.authorize(StorageBasedAuthorizationProvider.java:152) at org.apache.hadoop.hive.ql.security.authorization.AuthorizationPreEventListener.authorizeReadDatabase(AuthorizationPreEventListener.java:204) ... 53 more Caused by: org.apache.hadoop.security.AccessControlException: Permission denied: user=admin, access=EXECUTE, inode="/apps/hive/warehouse/bigsql.db":hive:hadoop:drwxrwx--- at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.check(FSPermissionChecker.java:319) at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.checkTraverse(FSPermissionChecker.java:259) at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.checkPermission(FSPermissionChecker.java:205) at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.checkPermission(FSPermissionChecker.java:190) at org.apache.hadoop.hdfs.server.namenode.FSDirectory.checkPermission(FSDirectory.java:1698) at org.apache.hadoop.hdfs.server.namenode.FSDirStatAndListingOp.getFileInfo(FSDirStatAndListingOp.java:108) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getFileInfo(FSNamesystem.java:3857) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getFileInfo(NameNodeRpcServer.java:1006) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getFileInfo(ClientNamenodeProtocolServerSideTranslatorPB.java:843) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:616) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:969) at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2049) at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2045) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:415) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2043) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:526) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:106) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:73) at org.apache.hadoop.hdfs.DFSClient.getFileInfo(DFSClient.java:2118) at org.apache.hadoop.hdfs.DistributedFileSystem$22.doCall(DistributedFileSystem.java:1305) at org.apache.hadoop.hdfs.DistributedFileSystem$22.doCall(DistributedFileSystem.java:1301) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getFileStatus(DistributedFileSystem.java:1301) at org.apache.hadoop.hive.common.FileUtils.getFileStatusOrNull(FileUtils.java:757) at org.apache.hadoop.hive.ql.security.authorization.StorageBasedAuthorizationProvider.checkPermissions(StorageBasedAuthorizationProvider.java:364) at org.apache.hadoop.hive.ql.security.authorization.StorageBasedAuthorizationProvider.authorize(StorageBasedAuthorizationProvider.java:339) ... 55 more Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.security.AccessControlException): Permission denied: user=admin, access=EXECUTE, inode="/apps/hive/warehouse/bigsql.db":hive:hadoop:drwxrwx--- at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.check(FSPermissionChecker.java:319) at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.checkTraverse(FSPermissionChecker.java:259) at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.checkPermission(FSPermissionChecker.java:205) at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.checkPermission(FSPermissionChecker.java:190) at org.apache.hadoop.hdfs.server.namenode.FSDirectory.checkPermission(FSDirectory.java:1698) at org.apache.hadoop.hdfs.server.namenode.FSDirStatAndListingOp.getFileInfo(FSDirStatAndListingOp.java:108) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getFileInfo(FSNamesystem.java:3857) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getFileInfo(NameNodeRpcServer.java:1006) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getFileInfo(ClientNamenodeProtocolServerSideTranslatorPB.java:843) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:616) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:969) at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2049) at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2045) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:415) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2043) at org.apache.hadoop.ipc.Client.call(Client.java:1476) at org.apache.hadoop.ipc.Client.call(Client.java:1407) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:229) at com.sun.proxy.$Proxy10.getFileInfo(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getFileInfo(ClientNamenodeProtocolTranslatorPB.java:771) at sun.reflect.GeneratedMethodAccessor7.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:187) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:102) at com.sun.proxy.$Proxy11.getFileInfo(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getFileInfo(DFSClient.java:2116) ... 62 more 2016-12-16 16:57:36,250 INFO thrift.ThriftCLIService (ThriftCLIService.java:OpenSession(294)) - Client protocol version: HIVE_CLI_SERVICE_PROTOCOL_V8 2016-12-16 16:57:36,270 INFO session.SessionState (SessionState.java:createPath(641)) - Created local directory: /tmp/e9deb6a8-4511-47a5-b3bb-a7a59ad0a514_resources 2016-12-16 16:57:36,278 INFO session.SessionState (SessionState.java:createPath(641)) - Created HDFS directory: /tmp/hive/anonymous/e9deb6a8-4511-47a5-b3bb-a7a59ad0a514 2016-12-16 16:57:36,280 INFO session.SessionState (SessionState.java:createPath(641)) - Created local directory: /tmp/hive/e9deb6a8-4511-47a5-b3bb-a7a59ad0a514 2016-12-16 16:57:36,287 INFO session.SessionState (SessionState.java:createPath(641)) - Created HDFS directory: /tmp/hive/anonymous/e9deb6a8-4511-47a5-b3bb-a7a59ad0a514/_tmp_space.db 2016-12-16 16:57:36,290 INFO session.HiveSessionImpl (HiveSessionImpl.java:setOperationLogSessionDir(236)) - Operation log session directory is created: /tmp/hive/operation_logs/e9deb6a8-4511-47a5-b3bb-a7a59ad0a514 2016-12-16 16:58:36,278 INFO thrift.ThriftCLIService (ThriftCLIService.java:OpenSession(294)) - Client protocol version: HIVE_CLI_SERVICE_PROTOCOL_V8 2016-12-16 16:58:36,292 INFO session.SessionState (SessionState.java:createPath(641)) - Created local directory: /tmp/370931db-5aee-49fb-915d-f22e1072a911_resources 2016-12-16 16:58:36,297 INFO session.SessionState (SessionState.java:createPath(641)) - Created HDFS directory: /tmp/hive/anonymous/370931db-5aee-49fb-915d-f22e1072a911 2016-12-16 16:58:36,299 INFO session.SessionState (SessionState.java:createPath(641)) - Created local directory: /tmp/hive/370931db-5aee-49fb-915d-f22e1072a911 2016-12-16 16:58:36,303 INFO session.SessionState (SessionState.java:createPath(641)) - Created HDFS directory: /tmp/hive/anonymous/370931db-5aee-49fb-915d-f22e1072a911/_tmp_space.db 2016-12-16 16:58:36,306 INFO session.HiveSessionImpl (HiveSessionImpl.java:setOperationLogSessionDir(236)) - Operation log session directory is created: /tmp/hive/operation_logs/370931db-5aee-49fb-915d-f22e1072a911 2016-12-16 16:59:36,217 INFO thrift.ThriftCLIService (ThriftCLIService.java:OpenSession(294)) - Client protocol version: HIVE_CLI_SERVICE_PROTOCOL_V8 2016-12-16 16:59:36,233 INFO session.SessionState (SessionState.java:createPath(641)) - Created local directory: /tmp/263f5487-2599-4c01-8f3b-473d9e0bd4c8_resources 2016-12-16 16:59:36,236 INFO session.SessionState (SessionState.java:createPath(641)) - Created HDFS directory: /tmp/hive/anonymous/263f5487-2599-4c01-8f3b-473d9e0bd4c8 2016-12-16 16:59:36,238 INFO session.SessionState (SessionState.java:createPath(641)) - Created local directory: /tmp/hive/263f5487-2599-4c01-8f3b-473d9e0bd4c8 2016-12-16 16:59:36,242 INFO session.SessionState (SessionState.java:createPath(641)) - Created HDFS directory: /tmp/hive/anonymous/263f5487-2599-4c01-8f3b-473d9e0bd4c8/_tmp_space.db 2016-12-16 16:59:36,244 INFO session.HiveSessionImpl (HiveSessionImpl.java:setOperationLogSessionDir(236)) - Operation log session directory is created: /tmp/hive/operation_logs/263f5487-2599-4c01-8f3b-473d9e0bd4c8 2016-12-16 16:59:56,796 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 16:59:56,797 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 16:59:56,797 INFO parse.ParseDriver (ParseDriver.java:parse(185)) - Parsing command: show databases like '*' 2016-12-16 16:59:56,798 INFO parse.ParseDriver (ParseDriver.java:parse(209)) - Parse Completed 2016-12-16 16:59:56,798 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 16:59:56,798 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 16:59:56,799 INFO ql.Driver (Driver.java:compile(436)) - Semantic Analysis Completed 2016-12-16 16:59:56,799 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 16:59:56,801 INFO exec.ListSinkOperator (Operator.java:initialize(332)) - Initializing operator OP[1] 2016-12-16 16:59:56,801 INFO exec.ListSinkOperator (Operator.java:initialize(372)) - Initialization Done 1 OP 2016-12-16 16:59:56,801 INFO exec.ListSinkOperator (Operator.java:initializeChildren(429)) - Operator 1 OP initialized 2016-12-16 16:59:56,801 INFO ql.Driver (Driver.java:getSchema(240)) - Returning Hive schema: Schema(fieldSchemas:[FieldSchema(name:database_name, type:string, comment:from deserializer)], properties:null) 2016-12-16 16:59:56,801 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 16:59:56,802 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 16:59:56,802 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 16:59:56,802 INFO ql.Driver (Driver.java:checkConcurrency(160)) - Concurrency mode is disabled, not creating a lock manager 2016-12-16 16:59:56,802 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 16:59:56,802 INFO ql.Driver (Driver.java:execute(1328)) - Starting command(queryId=hive_20161216165956_f2d11f51-b0eb-4b7b-aaf3-1747bb13eb0a): show databases like '*' 2016-12-16 16:59:56,802 INFO hooks.ATSHook (ATSHook.java:(84)) - Created ATS Hook 2016-12-16 16:59:56,803 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 16:59:56,803 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 16:59:56,803 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 16:59:56,803 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 16:59:56,803 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 16:59:56,804 INFO ql.Driver (Driver.java:launchTask(1651)) - Starting task [Stage-0:DDL] in serial mode 2016-12-16 16:59:56,804 INFO exec.DDLTask (DDLTask.java:showDatabases(2220)) - pattern: * 2016-12-16 16:59:56,804 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(746)) - 1: get_databases: * 2016-12-16 16:59:56,805 INFO HiveMetaStore.audit (HiveMetaStore.java:logAuditEvent(371)) - ugi=admin ip=unknown-ip-addr cmd=get_databases: * 2016-12-16 16:59:56,808 INFO exec.DDLTask (DDLTask.java:showDatabases(2225)) - results : 3 2016-12-16 16:59:56,809 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 16:59:56,810 INFO hooks.ATSHook (ATSHook.java:(84)) - Created ATS Hook 2016-12-16 16:59:56,810 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 16:59:56,810 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 16:59:56,811 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 16:59:56,811 INFO ql.Driver (SessionState.java:printInfo(954)) - OK 2016-12-16 16:59:56,811 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 16:59:56,811 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 16:59:56,811 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 16:59:56,814 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(249)) - Total input paths to process : 1 2016-12-16 16:59:56,974 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 16:59:56,974 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 16:59:56,975 INFO parse.ParseDriver (ParseDriver.java:parse(185)) - Parsing command: use bigsql 2016-12-16 16:59:56,975 INFO parse.ParseDriver (ParseDriver.java:parse(209)) - Parse Completed 2016-12-16 16:59:56,975 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 16:59:56,975 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 16:59:56,976 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(746)) - 1: get_database: bigsql 2016-12-16 16:59:56,976 INFO HiveMetaStore.audit (HiveMetaStore.java:logAuditEvent(371)) - ugi=admin ip=unknown-ip-addr cmd=get_database: bigsql 2016-12-16 16:59:57,005 INFO ql.Driver (Driver.java:compile(436)) - Semantic Analysis Completed 2016-12-16 16:59:57,005 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 16:59:57,005 INFO ql.Driver (Driver.java:getSchema(240)) - Returning Hive schema: Schema(fieldSchemas:null, properties:null) 2016-12-16 16:59:57,006 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 16:59:57,006 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 16:59:57,006 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 16:59:57,006 INFO ql.Driver (Driver.java:checkConcurrency(160)) - Concurrency mode is disabled, not creating a lock manager 2016-12-16 16:59:57,006 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 16:59:57,007 INFO ql.Driver (Driver.java:execute(1328)) - Starting command(queryId=hive_20161216165956_f99bb9f4-5315-4e95-81e2-a8a2f74d1511): use bigsql 2016-12-16 16:59:57,007 INFO hooks.ATSHook (ATSHook.java:(84)) - Created ATS Hook 2016-12-16 16:59:57,007 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 16:59:57,008 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 16:59:57,008 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 16:59:57,008 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 16:59:57,008 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 16:59:57,009 INFO ql.Driver (Driver.java:launchTask(1651)) - Starting task [Stage-0:DDL] in serial mode 2016-12-16 16:59:57,009 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(746)) - 1: get_database: bigsql 2016-12-16 16:59:57,010 INFO HiveMetaStore.audit (HiveMetaStore.java:logAuditEvent(371)) - ugi=admin ip=unknown-ip-addr cmd=get_database: bigsql 2016-12-16 16:59:57,020 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(746)) - 1: get_database: bigsql 2016-12-16 16:59:57,021 INFO HiveMetaStore.audit (HiveMetaStore.java:logAuditEvent(371)) - ugi=admin ip=unknown-ip-addr cmd=get_database: bigsql 2016-12-16 16:59:57,030 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 16:59:57,031 INFO hooks.ATSHook (ATSHook.java:(84)) - Created ATS Hook 2016-12-16 16:59:57,031 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 16:59:57,031 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 16:59:57,031 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 16:59:57,032 INFO ql.Driver (SessionState.java:printInfo(954)) - OK 2016-12-16 16:59:57,032 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 16:59:57,032 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 16:59:57,032 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 16:59:57,034 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 16:59:57,035 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 16:59:57,035 INFO parse.ParseDriver (ParseDriver.java:parse(185)) - Parsing command: show tables like '*' 2016-12-16 16:59:57,036 INFO parse.ParseDriver (ParseDriver.java:parse(209)) - Parse Completed 2016-12-16 16:59:57,036 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 16:59:57,036 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 16:59:57,038 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(746)) - 1: get_database: bigsql 2016-12-16 16:59:57,039 INFO HiveMetaStore.audit (HiveMetaStore.java:logAuditEvent(371)) - ugi=admin ip=unknown-ip-addr cmd=get_database: bigsql 2016-12-16 16:59:57,048 INFO ql.Driver (Driver.java:compile(436)) - Semantic Analysis Completed 2016-12-16 16:59:57,049 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 16:59:57,050 INFO exec.ListSinkOperator (Operator.java:initialize(332)) - Initializing operator OP[2] 2016-12-16 16:59:57,050 INFO exec.ListSinkOperator (Operator.java:initialize(372)) - Initialization Done 2 OP 2016-12-16 16:59:57,050 INFO exec.ListSinkOperator (Operator.java:initializeChildren(429)) - Operator 2 OP initialized 2016-12-16 16:59:57,051 INFO ql.Driver (Driver.java:getSchema(240)) - Returning Hive schema: Schema(fieldSchemas:[FieldSchema(name:tab_name, type:string, comment:from deserializer)], properties:null) 2016-12-16 16:59:57,051 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 16:59:57,051 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 16:59:57,051 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 16:59:57,052 INFO ql.Driver (Driver.java:checkConcurrency(160)) - Concurrency mode is disabled, not creating a lock manager 2016-12-16 16:59:57,052 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 16:59:57,052 INFO ql.Driver (Driver.java:execute(1328)) - Starting command(queryId=hive_20161216165957_57cc6d59-53ff-40f8-a20e-d17ef7381234): show tables like '*' 2016-12-16 16:59:57,052 INFO hooks.ATSHook (ATSHook.java:(84)) - Created ATS Hook 2016-12-16 16:59:57,052 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 16:59:57,053 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 16:59:57,053 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 16:59:57,053 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 16:59:57,053 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 16:59:57,054 INFO ql.Driver (Driver.java:launchTask(1651)) - Starting task [Stage-0:DDL] in serial mode 2016-12-16 16:59:57,055 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(746)) - 1: get_database: bigsql 2016-12-16 16:59:57,055 INFO HiveMetaStore.audit (HiveMetaStore.java:logAuditEvent(371)) - ugi=admin ip=unknown-ip-addr cmd=get_database: bigsql 2016-12-16 16:59:57,067 INFO exec.DDLTask (DDLTask.java:showTables(2265)) - pattern: * 2016-12-16 16:59:57,068 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(746)) - 1: get_tables: db=bigsql pat=* 2016-12-16 16:59:57,068 INFO HiveMetaStore.audit (HiveMetaStore.java:logAuditEvent(371)) - ugi=admin ip=unknown-ip-addr cmd=get_tables: db=bigsql pat=* 2016-12-16 16:59:57,075 INFO exec.DDLTask (DDLTask.java:showTables(2267)) - results : 7 2016-12-16 16:59:57,078 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 16:59:57,078 INFO hooks.ATSHook (ATSHook.java:(84)) - Created ATS Hook 2016-12-16 16:59:57,078 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 16:59:57,079 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 16:59:57,080 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 16:59:57,080 INFO ql.Driver (SessionState.java:printInfo(954)) - OK 2016-12-16 16:59:57,080 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 16:59:57,080 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 16:59:57,081 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 16:59:57,084 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(249)) - Total input paths to process : 1 2016-12-16 17:00:36,318 INFO thrift.ThriftCLIService (ThriftCLIService.java:OpenSession(294)) - Client protocol version: HIVE_CLI_SERVICE_PROTOCOL_V8 2016-12-16 17:00:36,333 INFO session.SessionState (SessionState.java:createPath(641)) - Created local directory: /tmp/c8a2ba2d-559f-4349-ad57-634a1399241d_resources 2016-12-16 17:00:36,338 INFO session.SessionState (SessionState.java:createPath(641)) - Created HDFS directory: /tmp/hive/anonymous/c8a2ba2d-559f-4349-ad57-634a1399241d 2016-12-16 17:00:36,340 INFO session.SessionState (SessionState.java:createPath(641)) - Created local directory: /tmp/hive/c8a2ba2d-559f-4349-ad57-634a1399241d 2016-12-16 17:00:36,344 INFO session.SessionState (SessionState.java:createPath(641)) - Created HDFS directory: /tmp/hive/anonymous/c8a2ba2d-559f-4349-ad57-634a1399241d/_tmp_space.db 2016-12-16 17:00:36,346 INFO session.HiveSessionImpl (HiveSessionImpl.java:setOperationLogSessionDir(236)) - Operation log session directory is created: /tmp/hive/operation_logs/c8a2ba2d-559f-4349-ad57-634a1399241d 2016-12-16 17:01:36,238 INFO thrift.ThriftCLIService (ThriftCLIService.java:OpenSession(294)) - Client protocol version: HIVE_CLI_SERVICE_PROTOCOL_V8 2016-12-16 17:01:36,250 INFO session.SessionState (SessionState.java:createPath(641)) - Created local directory: /tmp/c198292b-8fcd-4789-909f-116d16a8ceae_resources 2016-12-16 17:01:36,254 INFO session.SessionState (SessionState.java:createPath(641)) - Created HDFS directory: /tmp/hive/anonymous/c198292b-8fcd-4789-909f-116d16a8ceae 2016-12-16 17:01:36,255 INFO session.SessionState (SessionState.java:createPath(641)) - Created local directory: /tmp/hive/c198292b-8fcd-4789-909f-116d16a8ceae 2016-12-16 17:01:36,259 INFO session.SessionState (SessionState.java:createPath(641)) - Created HDFS directory: /tmp/hive/anonymous/c198292b-8fcd-4789-909f-116d16a8ceae/_tmp_space.db 2016-12-16 17:01:36,261 INFO session.HiveSessionImpl (HiveSessionImpl.java:setOperationLogSessionDir(236)) - Operation log session directory is created: /tmp/hive/operation_logs/c198292b-8fcd-4789-909f-116d16a8ceae 2016-12-16 17:02:36,284 INFO thrift.ThriftCLIService (ThriftCLIService.java:OpenSession(294)) - Client protocol version: HIVE_CLI_SERVICE_PROTOCOL_V8 2016-12-16 17:02:36,310 INFO session.SessionState (SessionState.java:createPath(641)) - Created local directory: /tmp/61bc0eb2-e87b-4cba-98bd-c51124a35fd6_resources 2016-12-16 17:02:36,315 INFO session.SessionState (SessionState.java:createPath(641)) - Created HDFS directory: /tmp/hive/anonymous/61bc0eb2-e87b-4cba-98bd-c51124a35fd6 2016-12-16 17:02:36,317 INFO session.SessionState (SessionState.java:createPath(641)) - Created local directory: /tmp/hive/61bc0eb2-e87b-4cba-98bd-c51124a35fd6 2016-12-16 17:02:36,323 INFO session.SessionState (SessionState.java:createPath(641)) - Created HDFS directory: /tmp/hive/anonymous/61bc0eb2-e87b-4cba-98bd-c51124a35fd6/_tmp_space.db 2016-12-16 17:02:36,329 INFO session.HiveSessionImpl (HiveSessionImpl.java:setOperationLogSessionDir(236)) - Operation log session directory is created: /tmp/hive/operation_logs/61bc0eb2-e87b-4cba-98bd-c51124a35fd6 2016-12-16 17:03:36,246 INFO thrift.ThriftCLIService (ThriftCLIService.java:OpenSession(294)) - Client protocol version: HIVE_CLI_SERVICE_PROTOCOL_V8 2016-12-16 17:03:36,265 INFO session.SessionState (SessionState.java:createPath(641)) - Created local directory: /tmp/c97d55b8-2481-4ee9-84a2-a9ee5c2673f0_resources 2016-12-16 17:03:36,269 INFO session.SessionState (SessionState.java:createPath(641)) - Created HDFS directory: /tmp/hive/anonymous/c97d55b8-2481-4ee9-84a2-a9ee5c2673f0 2016-12-16 17:03:36,271 INFO session.SessionState (SessionState.java:createPath(641)) - Created local directory: /tmp/hive/c97d55b8-2481-4ee9-84a2-a9ee5c2673f0 2016-12-16 17:03:36,276 INFO session.SessionState (SessionState.java:createPath(641)) - Created HDFS directory: /tmp/hive/anonymous/c97d55b8-2481-4ee9-84a2-a9ee5c2673f0/_tmp_space.db 2016-12-16 17:03:36,278 INFO session.HiveSessionImpl (HiveSessionImpl.java:setOperationLogSessionDir(236)) - Operation log session directory is created: /tmp/hive/operation_logs/c97d55b8-2481-4ee9-84a2-a9ee5c2673f0 2016-12-16 17:04:17,075 INFO thrift.ThriftCLIService (ThriftCLIService.java:OpenSession(294)) - Client protocol version: HIVE_CLI_SERVICE_PROTOCOL_V6 2016-12-16 17:04:17,079 INFO metastore.ObjectStore (ObjectStore.java:initialize(289)) - ObjectStore, initialize called 2016-12-16 17:04:17,086 INFO metastore.MetaStoreDirectSql (MetaStoreDirectSql.java:(141)) - Using direct SQL, underlying DB is MYSQL 2016-12-16 17:04:17,087 INFO metastore.ObjectStore (ObjectStore.java:setConf(272)) - Initialized ObjectStore 2016-12-16 17:04:17,097 INFO session.SessionState (SessionState.java:createPath(641)) - Created local directory: /tmp/b88387a8-1824-43e4-ac20-a3b99c72921a_resources 2016-12-16 17:04:17,101 INFO session.SessionState (SessionState.java:createPath(641)) - Created HDFS directory: /tmp/hive/admin/b88387a8-1824-43e4-ac20-a3b99c72921a 2016-12-16 17:04:17,103 INFO session.SessionState (SessionState.java:createPath(641)) - Created local directory: /tmp/hive/b88387a8-1824-43e4-ac20-a3b99c72921a 2016-12-16 17:04:17,106 INFO session.SessionState (SessionState.java:createPath(641)) - Created HDFS directory: /tmp/hive/admin/b88387a8-1824-43e4-ac20-a3b99c72921a/_tmp_space.db 2016-12-16 17:04:17,108 INFO session.HiveSessionImpl (HiveSessionImpl.java:setOperationLogSessionDir(236)) - Operation log session directory is created: /tmp/hive/operation_logs/b88387a8-1824-43e4-ac20-a3b99c72921a 2016-12-16 17:04:17,109 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 17:04:17,110 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 17:04:17,110 INFO parse.ParseDriver (ParseDriver.java:parse(185)) - Parsing command: use bigsql 2016-12-16 17:04:17,111 INFO parse.ParseDriver (ParseDriver.java:parse(209)) - Parse Completed 2016-12-16 17:04:17,111 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 17:04:17,111 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 17:04:17,111 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(746)) - 1: get_database: bigsql 2016-12-16 17:04:17,112 INFO HiveMetaStore.audit (HiveMetaStore.java:logAuditEvent(371)) - ugi=admin ip=unknown-ip-addr cmd=get_database: bigsql 2016-12-16 17:04:17,126 INFO ql.Driver (Driver.java:compile(436)) - Semantic Analysis Completed 2016-12-16 17:04:17,126 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 17:04:17,126 INFO ql.Driver (Driver.java:getSchema(240)) - Returning Hive schema: Schema(fieldSchemas:null, properties:null) 2016-12-16 17:04:17,126 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 17:04:17,126 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 17:04:17,127 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 17:04:17,127 INFO ql.Driver (Driver.java:checkConcurrency(160)) - Concurrency mode is disabled, not creating a lock manager 2016-12-16 17:04:17,127 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 17:04:17,127 INFO ql.Driver (Driver.java:execute(1328)) - Starting command(queryId=hive_20161216170417_b865097e-08e9-4656-8e6a-c296c4d6688c): use bigsql 2016-12-16 17:04:17,127 INFO hooks.ATSHook (ATSHook.java:(84)) - Created ATS Hook 2016-12-16 17:04:17,127 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 17:04:17,128 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 17:04:17,128 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 17:04:17,128 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 17:04:17,128 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 17:04:17,129 INFO ql.Driver (Driver.java:launchTask(1651)) - Starting task [Stage-0:DDL] in serial mode 2016-12-16 17:04:17,129 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(746)) - 1: get_database: bigsql 2016-12-16 17:04:17,130 INFO HiveMetaStore.audit (HiveMetaStore.java:logAuditEvent(371)) - ugi=admin ip=unknown-ip-addr cmd=get_database: bigsql 2016-12-16 17:04:17,138 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(746)) - 1: get_database: bigsql 2016-12-16 17:04:17,138 INFO HiveMetaStore.audit (HiveMetaStore.java:logAuditEvent(371)) - ugi=admin ip=unknown-ip-addr cmd=get_database: bigsql 2016-12-16 17:04:17,146 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 17:04:17,146 INFO hooks.ATSHook (ATSHook.java:(84)) - Created ATS Hook 2016-12-16 17:04:17,147 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 17:04:17,147 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 17:04:17,147 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 17:04:17,147 INFO ql.Driver (SessionState.java:printInfo(954)) - OK 2016-12-16 17:04:17,148 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 17:04:17,148 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 17:04:17,148 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 17:04:17,154 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 17:04:17,155 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 17:04:17,155 INFO parse.ParseDriver (ParseDriver.java:parse(185)) - Parsing command: show databases 2016-12-16 17:04:17,156 INFO parse.ParseDriver (ParseDriver.java:parse(209)) - Parse Completed 2016-12-16 17:04:17,156 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 17:04:17,156 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 17:04:17,157 INFO ql.Driver (Driver.java:compile(436)) - Semantic Analysis Completed 2016-12-16 17:04:17,158 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 17:04:17,159 INFO exec.ListSinkOperator (Operator.java:initialize(332)) - Initializing operator OP[3] 2016-12-16 17:04:17,159 INFO exec.ListSinkOperator (Operator.java:initialize(372)) - Initialization Done 3 OP 2016-12-16 17:04:17,159 INFO exec.ListSinkOperator (Operator.java:initializeChildren(429)) - Operator 3 OP initialized 2016-12-16 17:04:17,160 INFO ql.Driver (Driver.java:getSchema(240)) - Returning Hive schema: Schema(fieldSchemas:[FieldSchema(name:database_name, type:string, comment:from deserializer)], properties:null) 2016-12-16 17:04:17,160 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 17:04:17,163 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 17:04:17,164 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 17:04:17,164 INFO ql.Driver (Driver.java:checkConcurrency(160)) - Concurrency mode is disabled, not creating a lock manager 2016-12-16 17:04:17,164 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 17:04:17,164 INFO ql.Driver (Driver.java:execute(1328)) - Starting command(queryId=hive_20161216170417_9a59d263-4393-4126-88bd-ea36d00ba77f): show databases 2016-12-16 17:04:17,165 INFO hooks.ATSHook (ATSHook.java:(84)) - Created ATS Hook 2016-12-16 17:04:17,165 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 17:04:17,165 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 17:04:17,165 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 17:04:17,165 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 17:04:17,166 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 17:04:17,166 INFO ql.Driver (Driver.java:launchTask(1651)) - Starting task [Stage-0:DDL] in serial mode 2016-12-16 17:04:17,167 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(746)) - 2: get_all_databases 2016-12-16 17:04:17,168 INFO HiveMetaStore.audit (HiveMetaStore.java:logAuditEvent(371)) - ugi=admin ip=unknown-ip-addr cmd=get_all_databases 2016-12-16 17:04:17,168 INFO metastore.HiveMetaStore (HiveMetaStore.java:newRawStore(589)) - 2: Opening raw store with implemenation class:org.apache.hadoop.hive.metastore.ObjectStore 2016-12-16 17:04:17,173 INFO metastore.ObjectStore (ObjectStore.java:initialize(289)) - ObjectStore, initialize called 2016-12-16 17:04:17,179 INFO metastore.MetaStoreDirectSql (MetaStoreDirectSql.java:(141)) - Using direct SQL, underlying DB is MYSQL 2016-12-16 17:04:17,179 INFO metastore.ObjectStore (ObjectStore.java:setConf(272)) - Initialized ObjectStore 2016-12-16 17:04:17,182 INFO exec.DDLTask (DDLTask.java:showDatabases(2225)) - results : 3 2016-12-16 17:04:17,184 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 17:04:17,184 INFO hooks.ATSHook (ATSHook.java:(84)) - Created ATS Hook 2016-12-16 17:04:17,184 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 17:04:17,184 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 17:04:17,185 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 17:04:17,185 INFO ql.Driver (SessionState.java:printInfo(954)) - OK 2016-12-16 17:04:17,185 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 17:04:17,185 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 17:04:17,185 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 17:04:17,920 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(249)) - Total input paths to process : 1 2016-12-16 17:04:36,496 INFO thrift.ThriftCLIService (ThriftCLIService.java:OpenSession(294)) - Client protocol version: HIVE_CLI_SERVICE_PROTOCOL_V8 2016-12-16 17:04:36,522 INFO session.SessionState (SessionState.java:createPath(641)) - Created local directory: /tmp/6c04a531-9ec9-47be-a4ef-3cace44986f5_resources 2016-12-16 17:04:36,530 INFO session.SessionState (SessionState.java:createPath(641)) - Created HDFS directory: /tmp/hive/anonymous/6c04a531-9ec9-47be-a4ef-3cace44986f5 2016-12-16 17:04:36,533 INFO session.SessionState (SessionState.java:createPath(641)) - Created local directory: /tmp/hive/6c04a531-9ec9-47be-a4ef-3cace44986f5 2016-12-16 17:04:36,540 INFO session.SessionState (SessionState.java:createPath(641)) - Created HDFS directory: /tmp/hive/anonymous/6c04a531-9ec9-47be-a4ef-3cace44986f5/_tmp_space.db 2016-12-16 17:04:36,542 INFO session.HiveSessionImpl (HiveSessionImpl.java:setOperationLogSessionDir(236)) - Operation log session directory is created: /tmp/hive/operation_logs/6c04a531-9ec9-47be-a4ef-3cace44986f5 2016-12-16 17:04:37,420 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 17:04:37,420 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 17:04:37,421 INFO parse.ParseDriver (ParseDriver.java:parse(185)) - Parsing command: use bigsql 2016-12-16 17:04:37,421 INFO parse.ParseDriver (ParseDriver.java:parse(209)) - Parse Completed 2016-12-16 17:04:37,421 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 17:04:37,421 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 17:04:37,422 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(746)) - 1: get_database: bigsql 2016-12-16 17:04:37,422 INFO HiveMetaStore.audit (HiveMetaStore.java:logAuditEvent(371)) - ugi=admin ip=unknown-ip-addr cmd=get_database: bigsql 2016-12-16 17:04:37,432 INFO ql.Driver (Driver.java:compile(436)) - Semantic Analysis Completed 2016-12-16 17:04:37,432 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 17:04:37,432 INFO ql.Driver (Driver.java:getSchema(240)) - Returning Hive schema: Schema(fieldSchemas:null, properties:null) 2016-12-16 17:04:37,432 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 17:04:37,432 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 17:04:37,433 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 17:04:37,433 INFO ql.Driver (Driver.java:checkConcurrency(160)) - Concurrency mode is disabled, not creating a lock manager 2016-12-16 17:04:37,433 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 17:04:37,433 INFO ql.Driver (Driver.java:execute(1328)) - Starting command(queryId=hive_20161216170437_c6c54e96-7adf-46d2-8ac1-60f14d5beb2f): use bigsql 2016-12-16 17:04:37,433 INFO hooks.ATSHook (ATSHook.java:(84)) - Created ATS Hook 2016-12-16 17:04:37,434 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 17:04:37,434 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 17:04:37,434 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 17:04:37,434 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 17:04:37,434 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 17:04:37,435 INFO ql.Driver (Driver.java:launchTask(1651)) - Starting task [Stage-0:DDL] in serial mode 2016-12-16 17:04:37,435 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(746)) - 1: get_database: bigsql 2016-12-16 17:04:37,435 INFO HiveMetaStore.audit (HiveMetaStore.java:logAuditEvent(371)) - ugi=admin ip=unknown-ip-addr cmd=get_database: bigsql 2016-12-16 17:04:37,444 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(746)) - 1: get_database: bigsql 2016-12-16 17:04:37,445 INFO HiveMetaStore.audit (HiveMetaStore.java:logAuditEvent(371)) - ugi=admin ip=unknown-ip-addr cmd=get_database: bigsql 2016-12-16 17:04:37,455 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 17:04:37,456 INFO hooks.ATSHook (ATSHook.java:(84)) - Created ATS Hook 2016-12-16 17:04:37,456 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 17:04:37,456 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 17:04:37,456 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 17:04:37,457 INFO ql.Driver (SessionState.java:printInfo(954)) - OK 2016-12-16 17:04:37,457 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 17:04:37,457 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 17:04:37,457 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 17:04:37,471 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 17:04:37,472 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 17:04:37,472 INFO parse.ParseDriver (ParseDriver.java:parse(185)) - Parsing command: insert into drivers(driverid,name,ssn,location,certified,wageplan) values(1,'test',234555,'test','test','test') 2016-12-16 17:04:37,483 INFO parse.ParseDriver (ParseDriver.java:parse(209)) - Parse Completed 2016-12-16 17:04:37,484 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 17:04:37,484 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 17:04:37,514 INFO parse.CalcitePlanner (SemanticAnalyzer.java:analyzeInternal(10127)) - Starting Semantic Analysis 2016-12-16 17:04:37,515 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(746)) - 1: get_table : db=bigsql tbl=drivers 2016-12-16 17:04:37,516 INFO HiveMetaStore.audit (HiveMetaStore.java:logAuditEvent(371)) - ugi=admin ip=unknown-ip-addr cmd=get_table : db=bigsql tbl=drivers 2016-12-16 17:04:37,634 ERROR hdfs.KeyProviderCache (KeyProviderCache.java:createKeyProviderURI(87)) - Could not find uri with key [dfs.encryption.key.provider.uri] to create a keyProvider !! 2016-12-16 17:04:37,888 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(746)) - 1: get_table : db=bigsql tbl=drivers 2016-12-16 17:04:37,888 INFO HiveMetaStore.audit (HiveMetaStore.java:logAuditEvent(371)) - ugi=admin ip=unknown-ip-addr cmd=get_table : db=bigsql tbl=drivers 2016-12-16 17:04:37,916 INFO parse.CalcitePlanner (SemanticAnalyzer.java:genResolvedParseTree(10074)) - Completed phase 1 of Semantic Analysis 2016-12-16 17:04:37,917 INFO parse.CalcitePlanner (SemanticAnalyzer.java:getMetaData(1552)) - Get metadata for source tables 2016-12-16 17:04:37,918 INFO parse.CalcitePlanner (SemanticAnalyzer.java:getMetaData(1704)) - Get metadata for subqueries 2016-12-16 17:04:37,919 INFO parse.CalcitePlanner (SemanticAnalyzer.java:getMetaData(1728)) - Get metadata for destination tables 2016-12-16 17:04:37,921 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(746)) - 1: get_table : db=bigsql tbl=drivers 2016-12-16 17:04:37,921 INFO HiveMetaStore.audit (HiveMetaStore.java:logAuditEvent(371)) - ugi=admin ip=unknown-ip-addr cmd=get_table : db=bigsql tbl=drivers 2016-12-16 17:04:37,949 INFO parse.CalcitePlanner (SemanticAnalyzer.java:genResolvedParseTree(10078)) - Completed getting MetaData in Semantic Analysis 2016-12-16 17:04:37,957 INFO parse.BaseSemanticAnalyzer (CalcitePlanner.java:canCBOHandleAst(388)) - Not invoking CBO because the statement has too few joins 2016-12-16 17:04:37,979 INFO common.FileUtils (FileUtils.java:mkdir(501)) - Creating directory if it doesn't exist: hdfs://ibm-biginsight.com:8020/apps/hive/warehouse/bigsql.db/drivers/.hive-staging_hive_2016-12-16_17-04-37_472_2567377284308216122-1 2016-12-16 17:04:38,136 INFO parse.CalcitePlanner (SemanticAnalyzer.java:genFileSinkPlan(6653)) - Set stats collection dir : hdfs://ibm-biginsight.com:8020/apps/hive/warehouse/bigsql.db/drivers/.hive-staging_hive_2016-12-16_17-04-37_472_2567377284308216122-1/-ext-10001 2016-12-16 17:04:38,414 INFO ppd.OpProcFactory (OpProcFactory.java:process(655)) - Processing for FS(7) 2016-12-16 17:04:38,415 INFO ppd.OpProcFactory (OpProcFactory.java:process(655)) - Processing for SEL(6) 2016-12-16 17:04:38,415 INFO ppd.OpProcFactory (OpProcFactory.java:process(655)) - Processing for SEL(5) 2016-12-16 17:04:38,415 INFO ppd.OpProcFactory (OpProcFactory.java:process(382)) - Processing for TS(4) 2016-12-16 17:04:38,562 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 17:04:38,564 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 17:04:38,567 INFO optimizer.GenMRFileSink1 (GenMRFileSink1.java:process(103)) - using CombineHiveInputformat for the merge job 2016-12-16 17:04:38,611 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(746)) - 1: get_indexes : db=bigsql tbl=values__tmp__table__1 2016-12-16 17:04:38,612 INFO HiveMetaStore.audit (HiveMetaStore.java:logAuditEvent(371)) - ugi=admin ip=unknown-ip-addr cmd=get_indexes : db=bigsql tbl=values__tmp__table__1 2016-12-16 17:04:38,694 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(746)) - 1: get_indexes : db=bigsql tbl=values__tmp__table__1 2016-12-16 17:04:38,694 INFO HiveMetaStore.audit (HiveMetaStore.java:logAuditEvent(371)) - ugi=admin ip=unknown-ip-addr cmd=get_indexes : db=bigsql tbl=values__tmp__table__1 2016-12-16 17:04:38,703 INFO physical.NullScanTaskDispatcher (NullScanTaskDispatcher.java:dispatch(175)) - Looking for table scans where optimization is applicable 2016-12-16 17:04:38,703 INFO physical.NullScanTaskDispatcher (NullScanTaskDispatcher.java:dispatch(199)) - Found 0 null table scans 2016-12-16 17:04:38,704 INFO physical.NullScanTaskDispatcher (NullScanTaskDispatcher.java:dispatch(175)) - Looking for table scans where optimization is applicable 2016-12-16 17:04:38,705 INFO physical.NullScanTaskDispatcher (NullScanTaskDispatcher.java:dispatch(199)) - Found 0 null table scans 2016-12-16 17:04:38,706 INFO physical.NullScanTaskDispatcher (NullScanTaskDispatcher.java:dispatch(175)) - Looking for table scans where optimization is applicable 2016-12-16 17:04:38,706 INFO physical.NullScanTaskDispatcher (NullScanTaskDispatcher.java:dispatch(199)) - Found 0 null table scans 2016-12-16 17:04:38,710 INFO physical.Vectorizer (Vectorizer.java:validateMapWork(369)) - Validating MapWork... 2016-12-16 17:04:38,710 INFO physical.Vectorizer (Vectorizer.java:validateMapWork(397)) - Input format: org.apache.hadoop.mapred.TextInputFormat, doesn't provide vectorized input 2016-12-16 17:04:38,711 INFO parse.CalcitePlanner (SemanticAnalyzer.java:analyzeInternal(10213)) - Completed plan generation 2016-12-16 17:04:38,711 INFO ql.Driver (Driver.java:compile(436)) - Semantic Analysis Completed 2016-12-16 17:04:38,711 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 17:04:38,711 INFO ql.Driver (Driver.java:getSchema(240)) - Returning Hive schema: Schema(fieldSchemas:[FieldSchema(name:_col0, type:int, comment:null), FieldSchema(name:_col1, type:string, comment:null), FieldSchema(name:_col2, type:bigint, comment:null), FieldSchema(name:_col3, type:string, comment:null), FieldSchema(name:_col4, type:string, comment:null), FieldSchema(name:_col5, type:string, comment:null)], properties:null) 2016-12-16 17:04:38,712 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 17:04:38,713 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 17:04:38,713 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 17:04:38,713 INFO ql.Driver (Driver.java:checkConcurrency(160)) - Concurrency mode is disabled, not creating a lock manager 2016-12-16 17:04:38,713 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 17:04:38,713 INFO ql.Driver (Driver.java:execute(1328)) - Starting command(queryId=hive_20161216170437_3e08e094-aa62-45a1-ab5e-cdfdf0c8d61b): insert into drivers(driverid,name,ssn,location,certified,wageplan) values(1,'test',234555,'test','test','test') 2016-12-16 17:04:38,714 INFO hooks.ATSHook (ATSHook.java:(84)) - Created ATS Hook 2016-12-16 17:04:38,714 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 17:04:38,714 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 17:04:38,715 INFO ql.Driver (SessionState.java:printInfo(954)) - Query ID = hive_20161216170437_3e08e094-aa62-45a1-ab5e-cdfdf0c8d61b 2016-12-16 17:04:38,715 INFO ql.Driver (SessionState.java:printInfo(954)) - Total jobs = 3 2016-12-16 17:04:38,716 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 17:04:38,716 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 17:04:38,717 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 17:04:38,739 INFO ql.Driver (SessionState.java:printInfo(954)) - Launching Job 1 out of 3 2016-12-16 17:04:38,742 INFO ql.Driver (Driver.java:launchTask(1651)) - Starting task [Stage-1:MAPRED] in serial mode 2016-12-16 17:04:38,742 INFO exec.Task (SessionState.java:printInfo(954)) - Number of reduce tasks is set to 0 since there's no reduce operator 2016-12-16 17:04:38,747 INFO hooks.ATSHook (ATSHook.java:createPreHookEvent(149)) - Received pre-hook notification for :hive_20161216170437_3e08e094-aa62-45a1-ab5e-cdfdf0c8d61b 2016-12-16 17:04:38,751 INFO ql.Context (Context.java:getMRScratchDir(330)) - New scratch dir is hdfs://ibm-biginsight.com:8020/tmp/hive/admin/b88387a8-1824-43e4-ac20-a3b99c72921a/hive_2016-12-16_17-04-37_472_2567377284308216122-2 2016-12-16 17:04:38,762 INFO mr.ExecDriver (ExecDriver.java:execute(288)) - Using org.apache.hadoop.hive.ql.io.CombineHiveInputFormat 2016-12-16 17:04:38,771 INFO mr.ExecDriver (ExecDriver.java:execute(310)) - adding libjars: file:///usr/iop/current/hbase-client/lib/hbase-client.jar,file:///usr/iop/current/hbase-client/lib/hbase-common.jar,file:///usr/iop/current/hbase-client/lib/hbase-hadoop2-compat.jar,file:///usr/iop/current/hbase-client/lib/hbase-prefix-tree.jar,file:///usr/iop/current/hbase-client/lib/hbase-protocol.jar,file:///usr/iop/current/hbase-client/lib/hbase-server.jar,file:///usr/iop/current/hbase-client/lib/htrace-core-3.1.0-incubating.jar,file:///usr/iop/current/hive-webhcat/share/hcatalog 2016-12-16 17:04:38,773 INFO exec.Utilities (Utilities.java:getInputPaths(3398)) - Processing alias values__tmp__table__1 2016-12-16 17:04:38,773 INFO exec.Utilities (Utilities.java:getInputPaths(3415)) - Adding input file hdfs://ibm-biginsight.com:8020/tmp/hive/admin/b88387a8-1824-43e4-ac20-a3b99c72921a/_tmp_space.db/Values__Tmp__Table__1 2016-12-16 17:04:38,773 INFO exec.Utilities (Utilities.java:isEmptyPath(2699)) - Content Summary not cached for hdfs://ibm-biginsight.com:8020/tmp/hive/admin/b88387a8-1824-43e4-ac20-a3b99c72921a/_tmp_space.db/Values__Tmp__Table__1 2016-12-16 17:04:38,786 INFO ql.Context (Context.java:getMRScratchDir(330)) - New scratch dir is hdfs://ibm-biginsight.com:8020/tmp/hive/admin/b88387a8-1824-43e4-ac20-a3b99c72921a/hive_2016-12-16_17-04-37_472_2567377284308216122-2 2016-12-16 17:04:38,804 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 17:04:38,804 INFO exec.Utilities (Utilities.java:serializePlan(939)) - Serializing MapWork via kryo 2016-12-16 17:04:39,040 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 17:04:39,061 ERROR mr.ExecDriver (ExecDriver.java:execute(400)) - yarn 2016-12-16 17:04:39,349 INFO impl.TimelineClientImpl (TimelineClientImpl.java:serviceInit(296)) - Timeline service address: http://ibm-biginsight.com:8188/ws/v1/timeline/ 2016-12-16 17:04:39,357 INFO client.RMProxy (RMProxy.java:createRMProxy(98)) - Connecting to ResourceManager at ibm-biginsight.com/10.10.15.15:8050 2016-12-16 17:04:39,537 INFO fs.FSStatsPublisher (FSStatsPublisher.java:init(49)) - created : hdfs://ibm-biginsight.com:8020/apps/hive/warehouse/bigsql.db/drivers/.hive-staging_hive_2016-12-16_17-04-37_472_2567377284308216122-1/-ext-10001 2016-12-16 17:04:39,714 INFO impl.TimelineClientImpl (TimelineClientImpl.java:serviceInit(296)) - Timeline service address: http://ibm-biginsight.com:8188/ws/v1/timeline/ 2016-12-16 17:04:39,715 INFO client.RMProxy (RMProxy.java:createRMProxy(98)) - Connecting to ResourceManager at ibm-biginsight.com/10.10.15.15:8050 2016-12-16 17:04:39,721 INFO exec.Utilities (Utilities.java:getBaseWork(391)) - PLAN PATH = hdfs://ibm-biginsight.com:8020/tmp/hive/admin/b88387a8-1824-43e4-ac20-a3b99c72921a/hive_2016-12-16_17-04-37_472_2567377284308216122-2/-mr-10004/f9bc5036-4484-40a6-9bac-af1a2f8455fd/map.xml 2016-12-16 17:04:39,721 INFO exec.Utilities (Utilities.java:getBaseWork(391)) - PLAN PATH = hdfs://ibm-biginsight.com:8020/tmp/hive/admin/b88387a8-1824-43e4-ac20-a3b99c72921a/hive_2016-12-16_17-04-37_472_2567377284308216122-2/-mr-10004/f9bc5036-4484-40a6-9bac-af1a2f8455fd/reduce.xml 2016-12-16 17:04:39,721 INFO exec.Utilities (Utilities.java:getBaseWork(401)) - ***************non-local mode*************** 2016-12-16 17:04:39,721 INFO exec.Utilities (Utilities.java:getBaseWork(405)) - local path = hdfs://ibm-biginsight.com:8020/tmp/hive/admin/b88387a8-1824-43e4-ac20-a3b99c72921a/hive_2016-12-16_17-04-37_472_2567377284308216122-2/-mr-10004/f9bc5036-4484-40a6-9bac-af1a2f8455fd/reduce.xml 2016-12-16 17:04:39,722 INFO exec.Utilities (Utilities.java:getBaseWork(417)) - Open file to read in plan: hdfs://ibm-biginsight.com:8020/tmp/hive/admin/b88387a8-1824-43e4-ac20-a3b99c72921a/hive_2016-12-16_17-04-37_472_2567377284308216122-2/-mr-10004/f9bc5036-4484-40a6-9bac-af1a2f8455fd/reduce.xml 2016-12-16 17:04:39,731 INFO exec.Utilities (Utilities.java:getBaseWork(457)) - File not found: File does not exist: /tmp/hive/admin/b88387a8-1824-43e4-ac20-a3b99c72921a/hive_2016-12-16_17-04-37_472_2567377284308216122-2/-mr-10004/f9bc5036-4484-40a6-9bac-af1a2f8455fd/reduce.xml at org.apache.hadoop.hdfs.server.namenode.INodeFile.valueOf(INodeFile.java:71) at org.apache.hadoop.hdfs.server.namenode.INodeFile.valueOf(INodeFile.java:61) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getBlockLocationsInt(FSNamesystem.java:1815) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getBlockLocations(FSNamesystem.java:1786) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getBlockLocations(FSNamesystem.java:1699) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getBlockLocations(NameNodeRpcServer.java:587) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getBlockLocations(ClientNamenodeProtocolServerSideTranslatorPB.java:365) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:616) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:969) at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2049) at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2045) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:415) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2043) 2016-12-16 17:04:39,731 INFO exec.Utilities (Utilities.java:getBaseWork(458)) - No plan file found: hdfs://ibm-biginsight.com:8020/tmp/hive/admin/b88387a8-1824-43e4-ac20-a3b99c72921a/hive_2016-12-16_17-04-37_472_2567377284308216122-2/-mr-10004/f9bc5036-4484-40a6-9bac-af1a2f8455fd/reduce.xml 2016-12-16 17:04:39,797 WARN mapreduce.JobResourceUploader (JobResourceUploader.java:uploadFiles(64)) - Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this. 2016-12-16 17:04:40,824 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 17:04:40,824 INFO exec.Utilities (Utilities.java:getBaseWork(391)) - PLAN PATH = hdfs://ibm-biginsight.com:8020/tmp/hive/admin/b88387a8-1824-43e4-ac20-a3b99c72921a/hive_2016-12-16_17-04-37_472_2567377284308216122-2/-mr-10004/f9bc5036-4484-40a6-9bac-af1a2f8455fd/map.xml 2016-12-16 17:04:40,825 INFO io.CombineHiveInputFormat (CombineHiveInputFormat.java:getSplits(517)) - Total number of paths: 1, launching 1 threads to check non-combinable ones. 2016-12-16 17:04:40,849 INFO io.CombineHiveInputFormat (CombineHiveInputFormat.java:getCombineSplits(439)) - CombineHiveInputSplit creating pool for hdfs://ibm-biginsight.com:8020/tmp/hive/admin/b88387a8-1824-43e4-ac20-a3b99c72921a/_tmp_space.db/Values__Tmp__Table__1; using filter path hdfs://ibm-biginsight.com:8020/tmp/hive/admin/b88387a8-1824-43e4-ac20-a3b99c72921a/_tmp_space.db/Values__Tmp__Table__1 2016-12-16 17:04:40,862 INFO input.FileInputFormat (FileInputFormat.java:listStatus(283)) - Total input paths to process : 1 2016-12-16 17:04:40,867 INFO input.CombineFileInputFormat (CombineFileInputFormat.java:createSplits(413)) - DEBUG: Terminated node allocation with : CompletedNodes: 1, size left: 0 2016-12-16 17:04:40,869 INFO io.CombineHiveInputFormat (CombineHiveInputFormat.java:getCombineSplits(494)) - number of splits 1 2016-12-16 17:04:40,870 INFO io.CombineHiveInputFormat (CombineHiveInputFormat.java:getSplits(587)) - Number of all splits 1 2016-12-16 17:04:40,870 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 17:04:40,894 INFO hdfs.DFSClient (DFSOutputStream.java:createBlockOutputStream(1343)) - Exception in createBlockOutputStream java.io.EOFException: Premature EOF: no length prefix available at org.apache.hadoop.hdfs.protocolPB.PBHelper.vintPrefixed(PBHelper.java:2280) at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.createBlockOutputStream(DFSOutputStream.java:1317) at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.nextBlockOutputStream(DFSOutputStream.java:1237) at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.run(DFSOutputStream.java:449) 2016-12-16 17:04:40,895 INFO hdfs.DFSClient (DFSOutputStream.java:nextBlockOutputStream(1240)) - Abandoning BP-9404319-10.10.15.15-1469004622981:blk_1073751123_10309 2016-12-16 17:04:40,901 INFO hdfs.DFSClient (DFSOutputStream.java:nextBlockOutputStream(1244)) - Excluding datanode DatanodeInfoWithStorage[10.10.15.15:50010,DS-633660c3-ffa0-4a37-b59d-3d7899a861db,DISK] 2016-12-16 17:04:40,913 WARN hdfs.DFSClient (DFSOutputStream.java:run(558)) - DataStreamer Exception org.apache.hadoop.ipc.RemoteException(java.io.IOException): File /user/admin/.staging/job_1481877887579_0002/job.split could only be replicated to 0 nodes instead of minReplication (=1). There are 1 datanode(s) running and 1 node(s) are excluded in this operation. at org.apache.hadoop.hdfs.server.blockmanagement.BlockManager.chooseTarget4NewBlock(BlockManager.java:1550) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getNewBlockTargets(FSNamesystem.java:3106) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAdditionalBlock(FSNamesystem.java:3030) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.addBlock(NameNodeRpcServer.java:723) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.addBlock(ClientNamenodeProtocolServerSideTranslatorPB.java:492) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:616) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:969) at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2049) at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2045) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:415) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2043) at org.apache.hadoop.ipc.Client.call(Client.java:1476) at org.apache.hadoop.ipc.Client.call(Client.java:1407) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:229) at com.sun.proxy.$Proxy10.addBlock(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.addBlock(ClientNamenodeProtocolTranslatorPB.java:418) at sun.reflect.GeneratedMethodAccessor18.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:187) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:102) at com.sun.proxy.$Proxy11.addBlock(Unknown Source) at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.locateFollowingBlock(DFSOutputStream.java:1430) at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.nextBlockOutputStream(DFSOutputStream.java:1226) at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.run(DFSOutputStream.java:449) 2016-12-16 17:04:40,914 INFO mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(249)) - Cleaning up the staging area /user/admin/.staging/job_1481877887579_0002 2016-12-16 17:04:40,923 ERROR exec.Task (SessionState.java:printError(963)) - Job Submission failed with exception 'org.apache.hadoop.ipc.RemoteException(File /user/admin/.staging/job_1481877887579_0002/job.split could only be replicated to 0 nodes instead of minReplication (=1). There are 1 datanode(s) running and 1 node(s) are excluded in this operation. at org.apache.hadoop.hdfs.server.blockmanagement.BlockManager.chooseTarget4NewBlock(BlockManager.java:1550) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getNewBlockTargets(FSNamesystem.java:3106) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAdditionalBlock(FSNamesystem.java:3030) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.addBlock(NameNodeRpcServer.java:723) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.addBlock(ClientNamenodeProtocolServerSideTranslatorPB.java:492) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:616) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:969) at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2049) at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2045) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:415) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2043) )' org.apache.hadoop.ipc.RemoteException(java.io.IOException): File /user/admin/.staging/job_1481877887579_0002/job.split could only be replicated to 0 nodes instead of minReplication (=1). There are 1 datanode(s) running and 1 node(s) are excluded in this operation. at org.apache.hadoop.hdfs.server.blockmanagement.BlockManager.chooseTarget4NewBlock(BlockManager.java:1550) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getNewBlockTargets(FSNamesystem.java:3106) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAdditionalBlock(FSNamesystem.java:3030) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.addBlock(NameNodeRpcServer.java:723) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.addBlock(ClientNamenodeProtocolServerSideTranslatorPB.java:492) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:616) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:969) at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2049) at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2045) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:415) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2043) at org.apache.hadoop.ipc.Client.call(Client.java:1476) at org.apache.hadoop.ipc.Client.call(Client.java:1407) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:229) at com.sun.proxy.$Proxy10.addBlock(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.addBlock(ClientNamenodeProtocolTranslatorPB.java:418) at sun.reflect.GeneratedMethodAccessor18.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:187) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:102) at com.sun.proxy.$Proxy11.addBlock(Unknown Source) at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.locateFollowingBlock(DFSOutputStream.java:1430) at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.nextBlockOutputStream(DFSOutputStream.java:1226) at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.run(DFSOutputStream.java:449) 2016-12-16 17:04:40,937 INFO hooks.ATSHook (ATSHook.java:(84)) - Created ATS Hook 2016-12-16 17:04:40,937 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 17:04:40,938 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 17:04:40,938 INFO hooks.ATSHook (ATSHook.java:createPostHookEvent(178)) - Received post-hook notification for :hive_20161216170437_3e08e094-aa62-45a1-ab5e-cdfdf0c8d61b 2016-12-16 17:04:40,938 ERROR ql.Driver (SessionState.java:printError(963)) - FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.mr.MapRedTask 2016-12-16 17:04:40,941 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 17:04:40,941 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 17:04:40,941 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 17:04:40,943 ERROR operation.Operation (SQLOperation.java:run(209)) - Error running hive query: org.apache.hive.service.cli.HiveSQLException: Error while processing statement: FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.mr.MapRedTask at org.apache.hive.service.cli.operation.Operation.toSQLException(Operation.java:315) at org.apache.hive.service.cli.operation.SQLOperation.runQuery(SQLOperation.java:156) at org.apache.hive.service.cli.operation.SQLOperation.access$100(SQLOperation.java:71) at org.apache.hive.service.cli.operation.SQLOperation$1$1.run(SQLOperation.java:206) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:415) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657) at org.apache.hive.service.cli.operation.SQLOperation$1.run(SQLOperation.java:218) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) at java.util.concurrent.FutureTask.run(FutureTask.java:262) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:745) 2016-12-16 17:05:11,704 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 17:05:11,705 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 17:05:11,705 INFO parse.ParseDriver (ParseDriver.java:parse(185)) - Parsing command: use default 2016-12-16 17:05:11,705 INFO parse.ParseDriver (ParseDriver.java:parse(209)) - Parse Completed 2016-12-16 17:05:11,705 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 17:05:11,706 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 17:05:11,706 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(746)) - 1: get_database: default 2016-12-16 17:05:11,706 INFO HiveMetaStore.audit (HiveMetaStore.java:logAuditEvent(371)) - ugi=admin ip=unknown-ip-addr cmd=get_database: default 2016-12-16 17:05:11,716 INFO ql.Driver (Driver.java:compile(436)) - Semantic Analysis Completed 2016-12-16 17:05:11,716 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 17:05:11,717 INFO ql.Driver (Driver.java:getSchema(240)) - Returning Hive schema: Schema(fieldSchemas:null, properties:null) 2016-12-16 17:05:11,717 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 17:05:11,717 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 17:05:11,717 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 17:05:11,717 INFO ql.Driver (Driver.java:checkConcurrency(160)) - Concurrency mode is disabled, not creating a lock manager 2016-12-16 17:05:11,717 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 17:05:11,718 INFO ql.Driver (Driver.java:execute(1328)) - Starting command(queryId=hive_20161216170511_de47fda9-e7b7-4669-b37a-3dab9c0aebba): use default 2016-12-16 17:05:11,718 INFO hooks.ATSHook (ATSHook.java:(84)) - Created ATS Hook 2016-12-16 17:05:11,718 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 17:05:11,718 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 17:05:11,719 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 17:05:11,719 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 17:05:11,719 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 17:05:11,719 INFO ql.Driver (Driver.java:launchTask(1651)) - Starting task [Stage-0:DDL] in serial mode 2016-12-16 17:05:11,719 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(746)) - 1: get_database: default 2016-12-16 17:05:11,720 INFO HiveMetaStore.audit (HiveMetaStore.java:logAuditEvent(371)) - ugi=admin ip=unknown-ip-addr cmd=get_database: default 2016-12-16 17:05:11,728 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(746)) - 1: get_database: default 2016-12-16 17:05:11,728 INFO HiveMetaStore.audit (HiveMetaStore.java:logAuditEvent(371)) - ugi=admin ip=unknown-ip-addr cmd=get_database: default 2016-12-16 17:05:11,736 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 17:05:11,736 INFO hooks.ATSHook (ATSHook.java:(84)) - Created ATS Hook 2016-12-16 17:05:11,737 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 17:05:11,737 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 17:05:11,737 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 17:05:11,738 INFO ql.Driver (SessionState.java:printInfo(954)) - OK 2016-12-16 17:05:11,738 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 17:05:11,738 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 17:05:11,738 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 17:05:11,739 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 17:05:11,740 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 17:05:11,740 INFO parse.ParseDriver (ParseDriver.java:parse(185)) - Parsing command: show tables like '*' 2016-12-16 17:05:11,740 INFO parse.ParseDriver (ParseDriver.java:parse(209)) - Parse Completed 2016-12-16 17:05:11,740 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 17:05:11,741 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 17:05:11,742 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(746)) - 1: get_database: default 2016-12-16 17:05:11,743 INFO HiveMetaStore.audit (HiveMetaStore.java:logAuditEvent(371)) - ugi=admin ip=unknown-ip-addr cmd=get_database: default 2016-12-16 17:05:11,750 INFO ql.Driver (Driver.java:compile(436)) - Semantic Analysis Completed 2016-12-16 17:05:11,750 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 17:05:11,751 INFO exec.ListSinkOperator (Operator.java:initialize(332)) - Initializing operator OP[10] 2016-12-16 17:05:11,751 INFO exec.ListSinkOperator (Operator.java:initialize(372)) - Initialization Done 10 OP 2016-12-16 17:05:11,751 INFO exec.ListSinkOperator (Operator.java:initializeChildren(429)) - Operator 10 OP initialized 2016-12-16 17:05:11,752 INFO ql.Driver (Driver.java:getSchema(240)) - Returning Hive schema: Schema(fieldSchemas:[FieldSchema(name:tab_name, type:string, comment:from deserializer)], properties:null) 2016-12-16 17:05:11,752 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 17:05:11,752 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 17:05:11,753 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 17:05:11,753 INFO ql.Driver (Driver.java:checkConcurrency(160)) - Concurrency mode is disabled, not creating a lock manager 2016-12-16 17:05:11,753 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 17:05:11,753 INFO ql.Driver (Driver.java:execute(1328)) - Starting command(queryId=hive_20161216170511_77f3773d-d1d2-43e0-a08e-f10b610c580b): show tables like '*' 2016-12-16 17:05:11,753 INFO hooks.ATSHook (ATSHook.java:(84)) - Created ATS Hook 2016-12-16 17:05:11,753 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 17:05:11,754 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 17:05:11,754 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 17:05:11,754 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 17:05:11,754 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 17:05:11,754 INFO ql.Driver (Driver.java:launchTask(1651)) - Starting task [Stage-0:DDL] in serial mode 2016-12-16 17:05:11,755 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(746)) - 1: get_database: default 2016-12-16 17:05:11,755 INFO HiveMetaStore.audit (HiveMetaStore.java:logAuditEvent(371)) - ugi=admin ip=unknown-ip-addr cmd=get_database: default 2016-12-16 17:05:11,762 INFO exec.DDLTask (DDLTask.java:showTables(2265)) - pattern: * 2016-12-16 17:05:11,762 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(746)) - 1: get_tables: db=default pat=* 2016-12-16 17:05:11,763 INFO HiveMetaStore.audit (HiveMetaStore.java:logAuditEvent(371)) - ugi=admin ip=unknown-ip-addr cmd=get_tables: db=default pat=* 2016-12-16 17:05:11,765 INFO exec.DDLTask (DDLTask.java:showTables(2267)) - results : 7 2016-12-16 17:05:11,766 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 17:05:11,766 INFO hooks.ATSHook (ATSHook.java:(84)) - Created ATS Hook 2016-12-16 17:05:11,767 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 17:05:11,767 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 17:05:11,767 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 17:05:11,767 INFO ql.Driver (SessionState.java:printInfo(954)) - OK 2016-12-16 17:05:11,768 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 17:05:11,768 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 17:05:11,768 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 17:05:11,770 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(249)) - Total input paths to process : 1 2016-12-16 17:05:36,305 INFO thrift.ThriftCLIService (ThriftCLIService.java:OpenSession(294)) - Client protocol version: HIVE_CLI_SERVICE_PROTOCOL_V8 2016-12-16 17:05:36,319 INFO session.SessionState (SessionState.java:createPath(641)) - Created local directory: /tmp/059521d8-8ef3-49ae-b1d8-bc3405bfa097_resources 2016-12-16 17:05:36,323 INFO session.SessionState (SessionState.java:createPath(641)) - Created HDFS directory: /tmp/hive/anonymous/059521d8-8ef3-49ae-b1d8-bc3405bfa097 2016-12-16 17:05:36,325 INFO session.SessionState (SessionState.java:createPath(641)) - Created local directory: /tmp/hive/059521d8-8ef3-49ae-b1d8-bc3405bfa097 2016-12-16 17:05:36,328 INFO session.SessionState (SessionState.java:createPath(641)) - Created HDFS directory: /tmp/hive/anonymous/059521d8-8ef3-49ae-b1d8-bc3405bfa097/_tmp_space.db 2016-12-16 17:05:36,330 INFO session.HiveSessionImpl (HiveSessionImpl.java:setOperationLogSessionDir(236)) - Operation log session directory is created: /tmp/hive/operation_logs/059521d8-8ef3-49ae-b1d8-bc3405bfa097 2016-12-16 17:06:36,239 INFO thrift.ThriftCLIService (ThriftCLIService.java:OpenSession(294)) - Client protocol version: HIVE_CLI_SERVICE_PROTOCOL_V8 2016-12-16 17:06:36,255 INFO session.SessionState (SessionState.java:createPath(641)) - Created local directory: /tmp/7857c620-3679-4f85-a9b5-71e9d53c6e8b_resources 2016-12-16 17:06:36,264 INFO session.SessionState (SessionState.java:createPath(641)) - Created HDFS directory: /tmp/hive/anonymous/7857c620-3679-4f85-a9b5-71e9d53c6e8b 2016-12-16 17:06:36,267 INFO session.SessionState (SessionState.java:createPath(641)) - Created local directory: /tmp/hive/7857c620-3679-4f85-a9b5-71e9d53c6e8b 2016-12-16 17:06:36,271 INFO session.SessionState (SessionState.java:createPath(641)) - Created HDFS directory: /tmp/hive/anonymous/7857c620-3679-4f85-a9b5-71e9d53c6e8b/_tmp_space.db 2016-12-16 17:06:36,273 INFO session.HiveSessionImpl (HiveSessionImpl.java:setOperationLogSessionDir(236)) - Operation log session directory is created: /tmp/hive/operation_logs/7857c620-3679-4f85-a9b5-71e9d53c6e8b 2016-12-16 17:07:36,314 INFO thrift.ThriftCLIService (ThriftCLIService.java:OpenSession(294)) - Client protocol version: HIVE_CLI_SERVICE_PROTOCOL_V8 2016-12-16 17:07:36,325 INFO session.SessionState (SessionState.java:createPath(641)) - Created local directory: /tmp/884e5eb0-f577-4535-9e81-bb10afa918d9_resources 2016-12-16 17:07:36,330 INFO session.SessionState (SessionState.java:createPath(641)) - Created HDFS directory: /tmp/hive/anonymous/884e5eb0-f577-4535-9e81-bb10afa918d9 2016-12-16 17:07:36,331 INFO session.SessionState (SessionState.java:createPath(641)) - Created local directory: /tmp/hive/884e5eb0-f577-4535-9e81-bb10afa918d9 2016-12-16 17:07:36,336 INFO session.SessionState (SessionState.java:createPath(641)) - Created HDFS directory: /tmp/hive/anonymous/884e5eb0-f577-4535-9e81-bb10afa918d9/_tmp_space.db 2016-12-16 17:07:36,338 INFO session.HiveSessionImpl (HiveSessionImpl.java:setOperationLogSessionDir(236)) - Operation log session directory is created: /tmp/hive/operation_logs/884e5eb0-f577-4535-9e81-bb10afa918d9 2016-12-16 17:08:36,198 INFO thrift.ThriftCLIService (ThriftCLIService.java:OpenSession(294)) - Client protocol version: HIVE_CLI_SERVICE_PROTOCOL_V8 2016-12-16 17:08:36,215 INFO session.SessionState (SessionState.java:createPath(641)) - Created local directory: /tmp/df8b0484-024e-46d8-b297-82863dfc40c0_resources 2016-12-16 17:08:36,226 INFO session.SessionState (SessionState.java:createPath(641)) - Created HDFS directory: /tmp/hive/anonymous/df8b0484-024e-46d8-b297-82863dfc40c0 2016-12-16 17:08:36,228 INFO session.SessionState (SessionState.java:createPath(641)) - Created local directory: /tmp/hive/df8b0484-024e-46d8-b297-82863dfc40c0 2016-12-16 17:08:36,236 INFO session.SessionState (SessionState.java:createPath(641)) - Created HDFS directory: /tmp/hive/anonymous/df8b0484-024e-46d8-b297-82863dfc40c0/_tmp_space.db 2016-12-16 17:08:36,239 INFO session.HiveSessionImpl (HiveSessionImpl.java:setOperationLogSessionDir(236)) - Operation log session directory is created: /tmp/hive/operation_logs/df8b0484-024e-46d8-b297-82863dfc40c0 2016-12-16 17:09:36,145 INFO thrift.ThriftCLIService (ThriftCLIService.java:OpenSession(294)) - Client protocol version: HIVE_CLI_SERVICE_PROTOCOL_V8 2016-12-16 17:09:36,158 INFO session.SessionState (SessionState.java:createPath(641)) - Created local directory: /tmp/3814f3e3-fc5c-4c62-bd74-b7396bb1cdf9_resources 2016-12-16 17:09:36,163 INFO session.SessionState (SessionState.java:createPath(641)) - Created HDFS directory: /tmp/hive/anonymous/3814f3e3-fc5c-4c62-bd74-b7396bb1cdf9 2016-12-16 17:09:36,165 INFO session.SessionState (SessionState.java:createPath(641)) - Created local directory: /tmp/hive/3814f3e3-fc5c-4c62-bd74-b7396bb1cdf9 2016-12-16 17:09:36,168 INFO session.SessionState (SessionState.java:createPath(641)) - Created HDFS directory: /tmp/hive/anonymous/3814f3e3-fc5c-4c62-bd74-b7396bb1cdf9/_tmp_space.db 2016-12-16 17:09:36,171 INFO session.HiveSessionImpl (HiveSessionImpl.java:setOperationLogSessionDir(236)) - Operation log session directory is created: /tmp/hive/operation_logs/3814f3e3-fc5c-4c62-bd74-b7396bb1cdf9 2016-12-16 17:10:37,061 INFO thrift.ThriftCLIService (ThriftCLIService.java:OpenSession(294)) - Client protocol version: HIVE_CLI_SERVICE_PROTOCOL_V8 2016-12-16 17:10:37,077 INFO session.SessionState (SessionState.java:createPath(641)) - Created local directory: /tmp/4c7027ff-3c67-43bf-9061-fa7e5946289c_resources 2016-12-16 17:10:37,084 INFO session.SessionState (SessionState.java:createPath(641)) - Created HDFS directory: /tmp/hive/anonymous/4c7027ff-3c67-43bf-9061-fa7e5946289c 2016-12-16 17:10:37,086 INFO session.SessionState (SessionState.java:createPath(641)) - Created local directory: /tmp/hive/4c7027ff-3c67-43bf-9061-fa7e5946289c 2016-12-16 17:10:37,091 INFO session.SessionState (SessionState.java:createPath(641)) - Created HDFS directory: /tmp/hive/anonymous/4c7027ff-3c67-43bf-9061-fa7e5946289c/_tmp_space.db 2016-12-16 17:10:37,094 INFO session.HiveSessionImpl (HiveSessionImpl.java:setOperationLogSessionDir(236)) - Operation log session directory is created: /tmp/hive/operation_logs/4c7027ff-3c67-43bf-9061-fa7e5946289c 2016-12-16 17:11:36,343 INFO thrift.ThriftCLIService (ThriftCLIService.java:OpenSession(294)) - Client protocol version: HIVE_CLI_SERVICE_PROTOCOL_V8 2016-12-16 17:11:36,357 INFO session.SessionState (SessionState.java:createPath(641)) - Created local directory: /tmp/5e9f859c-1a64-4bba-b011-6afcf5528bfb_resources 2016-12-16 17:11:36,362 INFO session.SessionState (SessionState.java:createPath(641)) - Created HDFS directory: /tmp/hive/anonymous/5e9f859c-1a64-4bba-b011-6afcf5528bfb 2016-12-16 17:11:36,364 INFO session.SessionState (SessionState.java:createPath(641)) - Created local directory: /tmp/hive/5e9f859c-1a64-4bba-b011-6afcf5528bfb 2016-12-16 17:11:36,371 INFO session.SessionState (SessionState.java:createPath(641)) - Created HDFS directory: /tmp/hive/anonymous/5e9f859c-1a64-4bba-b011-6afcf5528bfb/_tmp_space.db 2016-12-16 17:11:36,374 INFO session.HiveSessionImpl (HiveSessionImpl.java:setOperationLogSessionDir(236)) - Operation log session directory is created: /tmp/hive/operation_logs/5e9f859c-1a64-4bba-b011-6afcf5528bfb 2016-12-16 17:12:36,282 INFO thrift.ThriftCLIService (ThriftCLIService.java:OpenSession(294)) - Client protocol version: HIVE_CLI_SERVICE_PROTOCOL_V8 2016-12-16 17:12:36,298 INFO session.SessionState (SessionState.java:createPath(641)) - Created local directory: /tmp/5787adba-f297-4010-80de-3c08b3e76adc_resources 2016-12-16 17:12:36,302 INFO session.SessionState (SessionState.java:createPath(641)) - Created HDFS directory: /tmp/hive/anonymous/5787adba-f297-4010-80de-3c08b3e76adc 2016-12-16 17:12:36,303 INFO session.SessionState (SessionState.java:createPath(641)) - Created local directory: /tmp/hive/5787adba-f297-4010-80de-3c08b3e76adc 2016-12-16 17:12:36,309 INFO session.SessionState (SessionState.java:createPath(641)) - Created HDFS directory: /tmp/hive/anonymous/5787adba-f297-4010-80de-3c08b3e76adc/_tmp_space.db 2016-12-16 17:12:36,312 INFO session.HiveSessionImpl (HiveSessionImpl.java:setOperationLogSessionDir(236)) - Operation log session directory is created: /tmp/hive/operation_logs/5787adba-f297-4010-80de-3c08b3e76adc 2016-12-16 17:13:36,243 INFO thrift.ThriftCLIService (ThriftCLIService.java:OpenSession(294)) - Client protocol version: HIVE_CLI_SERVICE_PROTOCOL_V8 2016-12-16 17:13:36,258 INFO session.SessionState (SessionState.java:createPath(641)) - Created local directory: /tmp/37384300-9131-4765-8c6e-3541a45e02a4_resources 2016-12-16 17:13:36,262 INFO session.SessionState (SessionState.java:createPath(641)) - Created HDFS directory: /tmp/hive/anonymous/37384300-9131-4765-8c6e-3541a45e02a4 2016-12-16 17:13:36,264 INFO session.SessionState (SessionState.java:createPath(641)) - Created local directory: /tmp/hive/37384300-9131-4765-8c6e-3541a45e02a4 2016-12-16 17:13:36,268 INFO session.SessionState (SessionState.java:createPath(641)) - Created HDFS directory: /tmp/hive/anonymous/37384300-9131-4765-8c6e-3541a45e02a4/_tmp_space.db 2016-12-16 17:13:36,269 INFO session.HiveSessionImpl (HiveSessionImpl.java:setOperationLogSessionDir(236)) - Operation log session directory is created: /tmp/hive/operation_logs/37384300-9131-4765-8c6e-3541a45e02a4 2016-12-16 17:14:08,301 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 17:14:08,302 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 17:14:08,302 INFO parse.ParseDriver (ParseDriver.java:parse(185)) - Parsing command: show databases like '*' 2016-12-16 17:14:08,303 INFO parse.ParseDriver (ParseDriver.java:parse(209)) - Parse Completed 2016-12-16 17:14:08,303 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 17:14:08,303 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 17:14:08,304 INFO ql.Driver (Driver.java:compile(436)) - Semantic Analysis Completed 2016-12-16 17:14:08,304 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 17:14:08,305 INFO exec.ListSinkOperator (Operator.java:initialize(332)) - Initializing operator OP[11] 2016-12-16 17:14:08,305 INFO exec.ListSinkOperator (Operator.java:initialize(372)) - Initialization Done 11 OP 2016-12-16 17:14:08,305 INFO exec.ListSinkOperator (Operator.java:initializeChildren(429)) - Operator 11 OP initialized 2016-12-16 17:14:08,306 INFO ql.Driver (Driver.java:getSchema(240)) - Returning Hive schema: Schema(fieldSchemas:[FieldSchema(name:database_name, type:string, comment:from deserializer)], properties:null) 2016-12-16 17:14:08,306 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 17:14:08,306 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 17:14:08,306 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 17:14:08,306 INFO ql.Driver (Driver.java:checkConcurrency(160)) - Concurrency mode is disabled, not creating a lock manager 2016-12-16 17:14:08,307 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 17:14:08,307 INFO ql.Driver (Driver.java:execute(1328)) - Starting command(queryId=hive_20161216171408_8bf18a07-d764-48b7-a4de-91a08ebb518a): show databases like '*' 2016-12-16 17:14:08,307 INFO hooks.ATSHook (ATSHook.java:(84)) - Created ATS Hook 2016-12-16 17:14:08,307 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 17:14:08,307 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 17:14:08,308 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 17:14:08,308 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 17:14:08,308 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 17:14:08,308 INFO ql.Driver (Driver.java:launchTask(1651)) - Starting task [Stage-0:DDL] in serial mode 2016-12-16 17:14:08,308 INFO exec.DDLTask (DDLTask.java:showDatabases(2220)) - pattern: * 2016-12-16 17:14:08,308 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(746)) - 1: get_databases: * 2016-12-16 17:14:08,309 INFO HiveMetaStore.audit (HiveMetaStore.java:logAuditEvent(371)) - ugi=admin ip=unknown-ip-addr cmd=get_databases: * 2016-12-16 17:14:08,312 INFO exec.DDLTask (DDLTask.java:showDatabases(2225)) - results : 3 2016-12-16 17:14:08,313 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 17:14:08,313 INFO hooks.ATSHook (ATSHook.java:(84)) - Created ATS Hook 2016-12-16 17:14:08,313 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 17:14:08,313 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 17:14:08,314 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 17:14:08,314 INFO ql.Driver (SessionState.java:printInfo(954)) - OK 2016-12-16 17:14:08,314 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 17:14:08,314 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 17:14:08,314 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 17:14:08,317 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(249)) - Total input paths to process : 1 2016-12-16 17:14:08,526 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 17:14:08,527 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 17:14:08,527 INFO parse.ParseDriver (ParseDriver.java:parse(185)) - Parsing command: use bigsql 2016-12-16 17:14:08,527 INFO parse.ParseDriver (ParseDriver.java:parse(209)) - Parse Completed 2016-12-16 17:14:08,528 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 17:14:08,528 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 17:14:08,528 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(746)) - 1: get_database: bigsql 2016-12-16 17:14:08,528 INFO HiveMetaStore.audit (HiveMetaStore.java:logAuditEvent(371)) - ugi=admin ip=unknown-ip-addr cmd=get_database: bigsql 2016-12-16 17:14:08,541 INFO ql.Driver (Driver.java:compile(436)) - Semantic Analysis Completed 2016-12-16 17:14:08,541 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 17:14:08,541 INFO ql.Driver (Driver.java:getSchema(240)) - Returning Hive schema: Schema(fieldSchemas:null, properties:null) 2016-12-16 17:14:08,541 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 17:14:08,542 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 17:14:08,542 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 17:14:08,542 INFO ql.Driver (Driver.java:checkConcurrency(160)) - Concurrency mode is disabled, not creating a lock manager 2016-12-16 17:14:08,542 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 17:14:08,542 INFO ql.Driver (Driver.java:execute(1328)) - Starting command(queryId=hive_20161216171408_c40e9ed9-fac3-4745-8da2-3476d1475c83): use bigsql 2016-12-16 17:14:08,542 INFO hooks.ATSHook (ATSHook.java:(84)) - Created ATS Hook 2016-12-16 17:14:08,542 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 17:14:08,543 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 17:14:08,543 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 17:14:08,543 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 17:14:08,543 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 17:14:08,543 INFO ql.Driver (Driver.java:launchTask(1651)) - Starting task [Stage-0:DDL] in serial mode 2016-12-16 17:14:08,544 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(746)) - 1: get_database: bigsql 2016-12-16 17:14:08,544 INFO HiveMetaStore.audit (HiveMetaStore.java:logAuditEvent(371)) - ugi=admin ip=unknown-ip-addr cmd=get_database: bigsql 2016-12-16 17:14:08,551 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(746)) - 1: get_database: bigsql 2016-12-16 17:14:08,551 INFO HiveMetaStore.audit (HiveMetaStore.java:logAuditEvent(371)) - ugi=admin ip=unknown-ip-addr cmd=get_database: bigsql 2016-12-16 17:14:08,558 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 17:14:08,559 INFO hooks.ATSHook (ATSHook.java:(84)) - Created ATS Hook 2016-12-16 17:14:08,559 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 17:14:08,559 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 17:14:08,559 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 17:14:08,560 INFO ql.Driver (SessionState.java:printInfo(954)) - OK 2016-12-16 17:14:08,560 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 17:14:08,560 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 17:14:08,560 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 17:14:08,561 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 17:14:08,562 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 17:14:08,562 INFO parse.ParseDriver (ParseDriver.java:parse(185)) - Parsing command: show tables like '*' 2016-12-16 17:14:08,563 INFO parse.ParseDriver (ParseDriver.java:parse(209)) - Parse Completed 2016-12-16 17:14:08,563 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 17:14:08,563 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 17:14:08,564 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(746)) - 1: get_database: bigsql 2016-12-16 17:14:08,565 INFO HiveMetaStore.audit (HiveMetaStore.java:logAuditEvent(371)) - ugi=admin ip=unknown-ip-addr cmd=get_database: bigsql 2016-12-16 17:14:08,572 INFO ql.Driver (Driver.java:compile(436)) - Semantic Analysis Completed 2016-12-16 17:14:08,573 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 17:14:08,574 INFO exec.ListSinkOperator (Operator.java:initialize(332)) - Initializing operator OP[12] 2016-12-16 17:14:08,574 INFO exec.ListSinkOperator (Operator.java:initialize(372)) - Initialization Done 12 OP 2016-12-16 17:14:08,575 INFO exec.ListSinkOperator (Operator.java:initializeChildren(429)) - Operator 12 OP initialized 2016-12-16 17:14:08,575 INFO ql.Driver (Driver.java:getSchema(240)) - Returning Hive schema: Schema(fieldSchemas:[FieldSchema(name:tab_name, type:string, comment:from deserializer)], properties:null) 2016-12-16 17:14:08,575 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 17:14:08,575 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 17:14:08,576 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 17:14:08,576 INFO ql.Driver (Driver.java:checkConcurrency(160)) - Concurrency mode is disabled, not creating a lock manager 2016-12-16 17:14:08,576 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 17:14:08,576 INFO ql.Driver (Driver.java:execute(1328)) - Starting command(queryId=hive_20161216171408_703a4efb-0057-40fb-a7af-28dbb812cd0f): show tables like '*' 2016-12-16 17:14:08,576 INFO hooks.ATSHook (ATSHook.java:(84)) - Created ATS Hook 2016-12-16 17:14:08,577 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 17:14:08,577 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 17:14:08,577 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 17:14:08,577 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 17:14:08,578 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 17:14:08,578 INFO ql.Driver (Driver.java:launchTask(1651)) - Starting task [Stage-0:DDL] in serial mode 2016-12-16 17:14:08,578 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(746)) - 1: get_database: bigsql 2016-12-16 17:14:08,578 INFO HiveMetaStore.audit (HiveMetaStore.java:logAuditEvent(371)) - ugi=admin ip=unknown-ip-addr cmd=get_database: bigsql 2016-12-16 17:14:08,586 INFO exec.DDLTask (DDLTask.java:showTables(2265)) - pattern: * 2016-12-16 17:14:08,586 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(746)) - 1: get_tables: db=bigsql pat=* 2016-12-16 17:14:08,587 INFO HiveMetaStore.audit (HiveMetaStore.java:logAuditEvent(371)) - ugi=admin ip=unknown-ip-addr cmd=get_tables: db=bigsql pat=* 2016-12-16 17:14:08,590 INFO exec.DDLTask (DDLTask.java:showTables(2267)) - results : 7 2016-12-16 17:14:08,591 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 17:14:08,591 INFO hooks.ATSHook (ATSHook.java:(84)) - Created ATS Hook 2016-12-16 17:14:08,591 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 17:14:08,592 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 17:14:08,592 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 17:14:08,592 INFO ql.Driver (SessionState.java:printInfo(954)) - OK 2016-12-16 17:14:08,592 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 17:14:08,593 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 17:14:08,593 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 17:14:08,596 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(249)) - Total input paths to process : 1 2016-12-16 17:14:36,232 INFO thrift.ThriftCLIService (ThriftCLIService.java:OpenSession(294)) - Client protocol version: HIVE_CLI_SERVICE_PROTOCOL_V8 2016-12-16 17:14:36,243 INFO session.SessionState (SessionState.java:createPath(641)) - Created local directory: /tmp/4ceca98a-43a2-436d-856e-7fcd622f902a_resources 2016-12-16 17:14:36,249 INFO session.SessionState (SessionState.java:createPath(641)) - Created HDFS directory: /tmp/hive/anonymous/4ceca98a-43a2-436d-856e-7fcd622f902a 2016-12-16 17:14:36,253 INFO session.SessionState (SessionState.java:createPath(641)) - Created local directory: /tmp/hive/4ceca98a-43a2-436d-856e-7fcd622f902a 2016-12-16 17:14:36,257 INFO session.SessionState (SessionState.java:createPath(641)) - Created HDFS directory: /tmp/hive/anonymous/4ceca98a-43a2-436d-856e-7fcd622f902a/_tmp_space.db 2016-12-16 17:14:36,259 INFO session.HiveSessionImpl (HiveSessionImpl.java:setOperationLogSessionDir(236)) - Operation log session directory is created: /tmp/hive/operation_logs/4ceca98a-43a2-436d-856e-7fcd622f902a 2016-12-16 17:15:36,258 INFO thrift.ThriftCLIService (ThriftCLIService.java:OpenSession(294)) - Client protocol version: HIVE_CLI_SERVICE_PROTOCOL_V8 2016-12-16 17:15:36,270 INFO session.SessionState (SessionState.java:createPath(641)) - Created local directory: /tmp/233d3d9f-013d-4054-8793-895e6c4547d3_resources 2016-12-16 17:15:36,275 INFO session.SessionState (SessionState.java:createPath(641)) - Created HDFS directory: /tmp/hive/anonymous/233d3d9f-013d-4054-8793-895e6c4547d3 2016-12-16 17:15:36,276 INFO session.SessionState (SessionState.java:createPath(641)) - Created local directory: /tmp/hive/233d3d9f-013d-4054-8793-895e6c4547d3 2016-12-16 17:15:36,283 INFO session.SessionState (SessionState.java:createPath(641)) - Created HDFS directory: /tmp/hive/anonymous/233d3d9f-013d-4054-8793-895e6c4547d3/_tmp_space.db 2016-12-16 17:15:36,285 INFO session.HiveSessionImpl (HiveSessionImpl.java:setOperationLogSessionDir(236)) - Operation log session directory is created: /tmp/hive/operation_logs/233d3d9f-013d-4054-8793-895e6c4547d3 2016-12-16 17:16:36,305 INFO thrift.ThriftCLIService (ThriftCLIService.java:OpenSession(294)) - Client protocol version: HIVE_CLI_SERVICE_PROTOCOL_V8 2016-12-16 17:16:36,319 INFO session.SessionState (SessionState.java:createPath(641)) - Created local directory: /tmp/0afd2a82-2f5a-4bf8-9028-310e095638e0_resources 2016-12-16 17:16:36,326 INFO session.SessionState (SessionState.java:createPath(641)) - Created HDFS directory: /tmp/hive/anonymous/0afd2a82-2f5a-4bf8-9028-310e095638e0 2016-12-16 17:16:36,328 INFO session.SessionState (SessionState.java:createPath(641)) - Created local directory: /tmp/hive/0afd2a82-2f5a-4bf8-9028-310e095638e0 2016-12-16 17:16:36,334 INFO session.SessionState (SessionState.java:createPath(641)) - Created HDFS directory: /tmp/hive/anonymous/0afd2a82-2f5a-4bf8-9028-310e095638e0/_tmp_space.db 2016-12-16 17:16:36,337 INFO session.HiveSessionImpl (HiveSessionImpl.java:setOperationLogSessionDir(236)) - Operation log session directory is created: /tmp/hive/operation_logs/0afd2a82-2f5a-4bf8-9028-310e095638e0 2016-12-16 17:17:36,271 INFO thrift.ThriftCLIService (ThriftCLIService.java:OpenSession(294)) - Client protocol version: HIVE_CLI_SERVICE_PROTOCOL_V8 2016-12-16 17:17:36,286 INFO session.SessionState (SessionState.java:createPath(641)) - Created local directory: /tmp/b185d02a-3e9d-40fc-85c9-0b6ec5a1b152_resources 2016-12-16 17:17:36,292 INFO session.SessionState (SessionState.java:createPath(641)) - Created HDFS directory: /tmp/hive/anonymous/b185d02a-3e9d-40fc-85c9-0b6ec5a1b152 2016-12-16 17:17:36,294 INFO session.SessionState (SessionState.java:createPath(641)) - Created local directory: /tmp/hive/b185d02a-3e9d-40fc-85c9-0b6ec5a1b152 2016-12-16 17:17:36,299 INFO session.SessionState (SessionState.java:createPath(641)) - Created HDFS directory: /tmp/hive/anonymous/b185d02a-3e9d-40fc-85c9-0b6ec5a1b152/_tmp_space.db 2016-12-16 17:17:36,301 INFO session.HiveSessionImpl (HiveSessionImpl.java:setOperationLogSessionDir(236)) - Operation log session directory is created: /tmp/hive/operation_logs/b185d02a-3e9d-40fc-85c9-0b6ec5a1b152 2016-12-16 17:18:36,266 INFO thrift.ThriftCLIService (ThriftCLIService.java:OpenSession(294)) - Client protocol version: HIVE_CLI_SERVICE_PROTOCOL_V8 2016-12-16 17:18:36,286 INFO session.SessionState (SessionState.java:createPath(641)) - Created local directory: /tmp/e6190f23-9d1f-4da5-a361-5cc40c374b86_resources 2016-12-16 17:18:36,290 INFO session.SessionState (SessionState.java:createPath(641)) - Created HDFS directory: /tmp/hive/anonymous/e6190f23-9d1f-4da5-a361-5cc40c374b86 2016-12-16 17:18:36,292 INFO session.SessionState (SessionState.java:createPath(641)) - Created local directory: /tmp/hive/e6190f23-9d1f-4da5-a361-5cc40c374b86 2016-12-16 17:18:36,296 INFO session.SessionState (SessionState.java:createPath(641)) - Created HDFS directory: /tmp/hive/anonymous/e6190f23-9d1f-4da5-a361-5cc40c374b86/_tmp_space.db 2016-12-16 17:18:36,298 INFO session.HiveSessionImpl (HiveSessionImpl.java:setOperationLogSessionDir(236)) - Operation log session directory is created: /tmp/hive/operation_logs/e6190f23-9d1f-4da5-a361-5cc40c374b86 2016-12-16 17:19:36,291 INFO thrift.ThriftCLIService (ThriftCLIService.java:OpenSession(294)) - Client protocol version: HIVE_CLI_SERVICE_PROTOCOL_V8 2016-12-16 17:19:36,310 INFO session.SessionState (SessionState.java:createPath(641)) - Created local directory: /tmp/b0e1d471-1ed2-4275-8d8a-83129120c9cc_resources 2016-12-16 17:19:36,316 INFO session.SessionState (SessionState.java:createPath(641)) - Created HDFS directory: /tmp/hive/anonymous/b0e1d471-1ed2-4275-8d8a-83129120c9cc 2016-12-16 17:19:36,318 INFO session.SessionState (SessionState.java:createPath(641)) - Created local directory: /tmp/hive/b0e1d471-1ed2-4275-8d8a-83129120c9cc 2016-12-16 17:19:36,321 INFO session.SessionState (SessionState.java:createPath(641)) - Created HDFS directory: /tmp/hive/anonymous/b0e1d471-1ed2-4275-8d8a-83129120c9cc/_tmp_space.db 2016-12-16 17:19:36,323 INFO session.HiveSessionImpl (HiveSessionImpl.java:setOperationLogSessionDir(236)) - Operation log session directory is created: /tmp/hive/operation_logs/b0e1d471-1ed2-4275-8d8a-83129120c9cc 2016-12-16 17:20:36,327 INFO thrift.ThriftCLIService (ThriftCLIService.java:OpenSession(294)) - Client protocol version: HIVE_CLI_SERVICE_PROTOCOL_V8 2016-12-16 17:20:36,353 INFO session.SessionState (SessionState.java:createPath(641)) - Created local directory: /tmp/17c0e08f-9f17-48de-9894-3cc9705b6204_resources 2016-12-16 17:20:36,357 INFO session.SessionState (SessionState.java:createPath(641)) - Created HDFS directory: /tmp/hive/anonymous/17c0e08f-9f17-48de-9894-3cc9705b6204 2016-12-16 17:20:36,359 INFO session.SessionState (SessionState.java:createPath(641)) - Created local directory: /tmp/hive/17c0e08f-9f17-48de-9894-3cc9705b6204 2016-12-16 17:20:36,365 INFO session.SessionState (SessionState.java:createPath(641)) - Created HDFS directory: /tmp/hive/anonymous/17c0e08f-9f17-48de-9894-3cc9705b6204/_tmp_space.db 2016-12-16 17:20:36,367 INFO session.HiveSessionImpl (HiveSessionImpl.java:setOperationLogSessionDir(236)) - Operation log session directory is created: /tmp/hive/operation_logs/17c0e08f-9f17-48de-9894-3cc9705b6204 2016-12-16 17:21:36,227 INFO thrift.ThriftCLIService (ThriftCLIService.java:OpenSession(294)) - Client protocol version: HIVE_CLI_SERVICE_PROTOCOL_V8 2016-12-16 17:21:36,238 INFO session.SessionState (SessionState.java:createPath(641)) - Created local directory: /tmp/b09e8437-70ea-4682-9ebe-034cf5597e1b_resources 2016-12-16 17:21:36,244 INFO session.SessionState (SessionState.java:createPath(641)) - Created HDFS directory: /tmp/hive/anonymous/b09e8437-70ea-4682-9ebe-034cf5597e1b 2016-12-16 17:21:36,247 INFO session.SessionState (SessionState.java:createPath(641)) - Created local directory: /tmp/hive/b09e8437-70ea-4682-9ebe-034cf5597e1b 2016-12-16 17:21:36,251 INFO session.SessionState (SessionState.java:createPath(641)) - Created HDFS directory: /tmp/hive/anonymous/b09e8437-70ea-4682-9ebe-034cf5597e1b/_tmp_space.db 2016-12-16 17:21:36,254 INFO session.HiveSessionImpl (HiveSessionImpl.java:setOperationLogSessionDir(236)) - Operation log session directory is created: /tmp/hive/operation_logs/b09e8437-70ea-4682-9ebe-034cf5597e1b 2016-12-16 17:22:05,992 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 17:22:05,993 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 17:22:05,993 INFO parse.ParseDriver (ParseDriver.java:parse(185)) - Parsing command: show databases like '*' 2016-12-16 17:22:05,993 INFO parse.ParseDriver (ParseDriver.java:parse(209)) - Parse Completed 2016-12-16 17:22:05,993 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 17:22:05,994 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 17:22:05,995 INFO ql.Driver (Driver.java:compile(436)) - Semantic Analysis Completed 2016-12-16 17:22:05,995 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 17:22:05,996 INFO exec.ListSinkOperator (Operator.java:initialize(332)) - Initializing operator OP[13] 2016-12-16 17:22:05,996 INFO exec.ListSinkOperator (Operator.java:initialize(372)) - Initialization Done 13 OP 2016-12-16 17:22:05,997 INFO exec.ListSinkOperator (Operator.java:initializeChildren(429)) - Operator 13 OP initialized 2016-12-16 17:22:05,997 INFO ql.Driver (Driver.java:getSchema(240)) - Returning Hive schema: Schema(fieldSchemas:[FieldSchema(name:database_name, type:string, comment:from deserializer)], properties:null) 2016-12-16 17:22:05,997 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 17:22:05,998 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 17:22:05,998 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 17:22:05,998 INFO ql.Driver (Driver.java:checkConcurrency(160)) - Concurrency mode is disabled, not creating a lock manager 2016-12-16 17:22:05,998 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 17:22:05,999 INFO ql.Driver (Driver.java:execute(1328)) - Starting command(queryId=hive_20161216172205_dc718e9b-568b-4547-8dd8-487e8497fcad): show databases like '*' 2016-12-16 17:22:05,999 INFO hooks.ATSHook (ATSHook.java:(84)) - Created ATS Hook 2016-12-16 17:22:05,999 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 17:22:06,000 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 17:22:06,000 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 17:22:06,000 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 17:22:06,000 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 17:22:06,001 INFO ql.Driver (Driver.java:launchTask(1651)) - Starting task [Stage-0:DDL] in serial mode 2016-12-16 17:22:06,001 INFO exec.DDLTask (DDLTask.java:showDatabases(2220)) - pattern: * 2016-12-16 17:22:06,001 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(746)) - 1: get_databases: * 2016-12-16 17:22:06,001 INFO HiveMetaStore.audit (HiveMetaStore.java:logAuditEvent(371)) - ugi=admin ip=unknown-ip-addr cmd=get_databases: * 2016-12-16 17:22:06,005 INFO exec.DDLTask (DDLTask.java:showDatabases(2225)) - results : 3 2016-12-16 17:22:06,006 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 17:22:06,006 INFO hooks.ATSHook (ATSHook.java:(84)) - Created ATS Hook 2016-12-16 17:22:06,006 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 17:22:06,007 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 17:22:06,007 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 17:22:06,007 INFO ql.Driver (SessionState.java:printInfo(954)) - OK 2016-12-16 17:22:06,008 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 17:22:06,008 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 17:22:06,008 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 17:22:06,011 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(249)) - Total input paths to process : 1 2016-12-16 17:22:06,250 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 17:22:06,251 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 17:22:06,251 INFO parse.ParseDriver (ParseDriver.java:parse(185)) - Parsing command: use bigsql 2016-12-16 17:22:06,252 INFO parse.ParseDriver (ParseDriver.java:parse(209)) - Parse Completed 2016-12-16 17:22:06,252 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 17:22:06,252 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 17:22:06,253 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(746)) - 1: get_database: bigsql 2016-12-16 17:22:06,253 INFO HiveMetaStore.audit (HiveMetaStore.java:logAuditEvent(371)) - ugi=admin ip=unknown-ip-addr cmd=get_database: bigsql 2016-12-16 17:22:06,265 INFO ql.Driver (Driver.java:compile(436)) - Semantic Analysis Completed 2016-12-16 17:22:06,265 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 17:22:06,265 INFO ql.Driver (Driver.java:getSchema(240)) - Returning Hive schema: Schema(fieldSchemas:null, properties:null) 2016-12-16 17:22:06,265 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 17:22:06,266 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 17:22:06,266 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 17:22:06,266 INFO ql.Driver (Driver.java:checkConcurrency(160)) - Concurrency mode is disabled, not creating a lock manager 2016-12-16 17:22:06,266 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 17:22:06,266 INFO ql.Driver (Driver.java:execute(1328)) - Starting command(queryId=hive_20161216172206_a95eec4a-2073-4120-9ab7-7a2644eed100): use bigsql 2016-12-16 17:22:06,267 INFO hooks.ATSHook (ATSHook.java:(84)) - Created ATS Hook 2016-12-16 17:22:06,267 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 17:22:06,268 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 17:22:06,268 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 17:22:06,268 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 17:22:06,268 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 17:22:06,269 INFO ql.Driver (Driver.java:launchTask(1651)) - Starting task [Stage-0:DDL] in serial mode 2016-12-16 17:22:06,269 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(746)) - 1: get_database: bigsql 2016-12-16 17:22:06,269 INFO HiveMetaStore.audit (HiveMetaStore.java:logAuditEvent(371)) - ugi=admin ip=unknown-ip-addr cmd=get_database: bigsql 2016-12-16 17:22:06,278 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(746)) - 1: get_database: bigsql 2016-12-16 17:22:06,278 INFO HiveMetaStore.audit (HiveMetaStore.java:logAuditEvent(371)) - ugi=admin ip=unknown-ip-addr cmd=get_database: bigsql 2016-12-16 17:22:06,286 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 17:22:06,286 INFO hooks.ATSHook (ATSHook.java:(84)) - Created ATS Hook 2016-12-16 17:22:06,286 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 17:22:06,287 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 17:22:06,287 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 17:22:06,287 INFO ql.Driver (SessionState.java:printInfo(954)) - OK 2016-12-16 17:22:06,287 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 17:22:06,287 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 17:22:06,288 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 17:22:06,289 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 17:22:06,290 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 17:22:06,291 INFO parse.ParseDriver (ParseDriver.java:parse(185)) - Parsing command: show tables like '*' 2016-12-16 17:22:06,291 INFO parse.ParseDriver (ParseDriver.java:parse(209)) - Parse Completed 2016-12-16 17:22:06,291 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 17:22:06,291 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 17:22:06,293 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(746)) - 1: get_database: bigsql 2016-12-16 17:22:06,293 INFO HiveMetaStore.audit (HiveMetaStore.java:logAuditEvent(371)) - ugi=admin ip=unknown-ip-addr cmd=get_database: bigsql 2016-12-16 17:22:06,302 INFO ql.Driver (Driver.java:compile(436)) - Semantic Analysis Completed 2016-12-16 17:22:06,302 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 17:22:06,303 INFO exec.ListSinkOperator (Operator.java:initialize(332)) - Initializing operator OP[14] 2016-12-16 17:22:06,303 INFO exec.ListSinkOperator (Operator.java:initialize(372)) - Initialization Done 14 OP 2016-12-16 17:22:06,304 INFO exec.ListSinkOperator (Operator.java:initializeChildren(429)) - Operator 14 OP initialized 2016-12-16 17:22:06,304 INFO ql.Driver (Driver.java:getSchema(240)) - Returning Hive schema: Schema(fieldSchemas:[FieldSchema(name:tab_name, type:string, comment:from deserializer)], properties:null) 2016-12-16 17:22:06,304 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 17:22:06,304 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 17:22:06,304 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 17:22:06,304 INFO ql.Driver (Driver.java:checkConcurrency(160)) - Concurrency mode is disabled, not creating a lock manager 2016-12-16 17:22:06,305 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 17:22:06,305 INFO ql.Driver (Driver.java:execute(1328)) - Starting command(queryId=hive_20161216172206_9320ee7e-40a7-43dc-9f56-66ff5d38453a): show tables like '*' 2016-12-16 17:22:06,305 INFO hooks.ATSHook (ATSHook.java:(84)) - Created ATS Hook 2016-12-16 17:22:06,305 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 17:22:06,305 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 17:22:06,306 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 17:22:06,306 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 17:22:06,306 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 17:22:06,306 INFO ql.Driver (Driver.java:launchTask(1651)) - Starting task [Stage-0:DDL] in serial mode 2016-12-16 17:22:06,306 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(746)) - 1: get_database: bigsql 2016-12-16 17:22:06,307 INFO HiveMetaStore.audit (HiveMetaStore.java:logAuditEvent(371)) - ugi=admin ip=unknown-ip-addr cmd=get_database: bigsql 2016-12-16 17:22:06,314 INFO exec.DDLTask (DDLTask.java:showTables(2265)) - pattern: * 2016-12-16 17:22:06,314 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(746)) - 1: get_tables: db=bigsql pat=* 2016-12-16 17:22:06,314 INFO HiveMetaStore.audit (HiveMetaStore.java:logAuditEvent(371)) - ugi=admin ip=unknown-ip-addr cmd=get_tables: db=bigsql pat=* 2016-12-16 17:22:06,317 INFO exec.DDLTask (DDLTask.java:showTables(2267)) - results : 7 2016-12-16 17:22:06,319 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 17:22:06,319 INFO hooks.ATSHook (ATSHook.java:(84)) - Created ATS Hook 2016-12-16 17:22:06,320 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 17:22:06,320 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 17:22:06,321 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 17:22:06,321 INFO ql.Driver (SessionState.java:printInfo(954)) - OK 2016-12-16 17:22:06,321 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 17:22:06,321 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 17:22:06,321 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 17:22:06,324 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(249)) - Total input paths to process : 1 2016-12-16 17:22:07,275 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 17:22:07,276 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 17:22:07,276 INFO parse.ParseDriver (ParseDriver.java:parse(185)) - Parsing command: show databases like '*' 2016-12-16 17:22:07,276 INFO parse.ParseDriver (ParseDriver.java:parse(209)) - Parse Completed 2016-12-16 17:22:07,276 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 17:22:07,277 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 17:22:07,278 INFO ql.Driver (Driver.java:compile(436)) - Semantic Analysis Completed 2016-12-16 17:22:07,279 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 17:22:07,280 INFO exec.ListSinkOperator (Operator.java:initialize(332)) - Initializing operator OP[15] 2016-12-16 17:22:07,280 INFO exec.ListSinkOperator (Operator.java:initialize(372)) - Initialization Done 15 OP 2016-12-16 17:22:07,281 INFO exec.ListSinkOperator (Operator.java:initializeChildren(429)) - Operator 15 OP initialized 2016-12-16 17:22:07,281 INFO ql.Driver (Driver.java:getSchema(240)) - Returning Hive schema: Schema(fieldSchemas:[FieldSchema(name:database_name, type:string, comment:from deserializer)], properties:null) 2016-12-16 17:22:07,281 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 17:22:07,282 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 17:22:07,282 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 17:22:07,282 INFO ql.Driver (Driver.java:checkConcurrency(160)) - Concurrency mode is disabled, not creating a lock manager 2016-12-16 17:22:07,282 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 17:22:07,282 INFO ql.Driver (Driver.java:execute(1328)) - Starting command(queryId=hive_20161216172207_2f80827c-db12-4983-9bd3-53c6c220c784): show databases like '*' 2016-12-16 17:22:07,282 INFO hooks.ATSHook (ATSHook.java:(84)) - Created ATS Hook 2016-12-16 17:22:07,283 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 17:22:07,283 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 17:22:07,284 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 17:22:07,284 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 17:22:07,284 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 17:22:07,284 INFO ql.Driver (Driver.java:launchTask(1651)) - Starting task [Stage-0:DDL] in serial mode 2016-12-16 17:22:07,285 INFO exec.DDLTask (DDLTask.java:showDatabases(2220)) - pattern: * 2016-12-16 17:22:07,285 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(746)) - 1: get_databases: * 2016-12-16 17:22:07,285 INFO HiveMetaStore.audit (HiveMetaStore.java:logAuditEvent(371)) - ugi=admin ip=unknown-ip-addr cmd=get_databases: * 2016-12-16 17:22:07,288 INFO exec.DDLTask (DDLTask.java:showDatabases(2225)) - results : 3 2016-12-16 17:22:07,290 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 17:22:07,290 INFO hooks.ATSHook (ATSHook.java:(84)) - Created ATS Hook 2016-12-16 17:22:07,290 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 17:22:07,291 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 17:22:07,291 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 17:22:07,291 INFO ql.Driver (SessionState.java:printInfo(954)) - OK 2016-12-16 17:22:07,291 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 17:22:07,291 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 17:22:07,291 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 17:22:07,294 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(249)) - Total input paths to process : 1 2016-12-16 17:22:07,447 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 17:22:07,448 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 17:22:07,448 INFO parse.ParseDriver (ParseDriver.java:parse(185)) - Parsing command: use bigsql 2016-12-16 17:22:07,448 INFO parse.ParseDriver (ParseDriver.java:parse(209)) - Parse Completed 2016-12-16 17:22:07,448 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 17:22:07,448 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 17:22:07,449 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(746)) - 1: get_database: bigsql 2016-12-16 17:22:07,449 INFO HiveMetaStore.audit (HiveMetaStore.java:logAuditEvent(371)) - ugi=admin ip=unknown-ip-addr cmd=get_database: bigsql 2016-12-16 17:22:07,457 INFO ql.Driver (Driver.java:compile(436)) - Semantic Analysis Completed 2016-12-16 17:22:07,457 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 17:22:07,457 INFO ql.Driver (Driver.java:getSchema(240)) - Returning Hive schema: Schema(fieldSchemas:null, properties:null) 2016-12-16 17:22:07,457 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 17:22:07,457 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 17:22:07,458 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 17:22:07,458 INFO ql.Driver (Driver.java:checkConcurrency(160)) - Concurrency mode is disabled, not creating a lock manager 2016-12-16 17:22:07,458 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 17:22:07,458 INFO ql.Driver (Driver.java:execute(1328)) - Starting command(queryId=hive_20161216172207_52cec780-bd4f-4204-af80-054b67ab092a): use bigsql 2016-12-16 17:22:07,458 INFO hooks.ATSHook (ATSHook.java:(84)) - Created ATS Hook 2016-12-16 17:22:07,458 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 17:22:07,459 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 17:22:07,459 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 17:22:07,459 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 17:22:07,459 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 17:22:07,459 INFO ql.Driver (Driver.java:launchTask(1651)) - Starting task [Stage-0:DDL] in serial mode 2016-12-16 17:22:07,460 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(746)) - 1: get_database: bigsql 2016-12-16 17:22:07,460 INFO HiveMetaStore.audit (HiveMetaStore.java:logAuditEvent(371)) - ugi=admin ip=unknown-ip-addr cmd=get_database: bigsql 2016-12-16 17:22:07,470 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(746)) - 1: get_database: bigsql 2016-12-16 17:22:07,471 INFO HiveMetaStore.audit (HiveMetaStore.java:logAuditEvent(371)) - ugi=admin ip=unknown-ip-addr cmd=get_database: bigsql 2016-12-16 17:22:07,478 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 17:22:07,478 INFO hooks.ATSHook (ATSHook.java:(84)) - Created ATS Hook 2016-12-16 17:22:07,478 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 17:22:07,479 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 17:22:07,479 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 17:22:07,479 INFO ql.Driver (SessionState.java:printInfo(954)) - OK 2016-12-16 17:22:07,480 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 17:22:07,480 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 17:22:07,480 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 17:22:07,481 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 17:22:07,482 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 17:22:07,482 INFO parse.ParseDriver (ParseDriver.java:parse(185)) - Parsing command: show tables like '*' 2016-12-16 17:22:07,482 INFO parse.ParseDriver (ParseDriver.java:parse(209)) - Parse Completed 2016-12-16 17:22:07,482 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 17:22:07,483 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 17:22:07,483 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(746)) - 1: get_database: bigsql 2016-12-16 17:22:07,484 INFO HiveMetaStore.audit (HiveMetaStore.java:logAuditEvent(371)) - ugi=admin ip=unknown-ip-addr cmd=get_database: bigsql 2016-12-16 17:22:07,491 INFO ql.Driver (Driver.java:compile(436)) - Semantic Analysis Completed 2016-12-16 17:22:07,491 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 17:22:07,493 INFO exec.ListSinkOperator (Operator.java:initialize(332)) - Initializing operator OP[16] 2016-12-16 17:22:07,493 INFO exec.ListSinkOperator (Operator.java:initialize(372)) - Initialization Done 16 OP 2016-12-16 17:22:07,493 INFO exec.ListSinkOperator (Operator.java:initializeChildren(429)) - Operator 16 OP initialized 2016-12-16 17:22:07,493 INFO ql.Driver (Driver.java:getSchema(240)) - Returning Hive schema: Schema(fieldSchemas:[FieldSchema(name:tab_name, type:string, comment:from deserializer)], properties:null) 2016-12-16 17:22:07,494 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 17:22:07,494 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 17:22:07,494 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 17:22:07,494 INFO ql.Driver (Driver.java:checkConcurrency(160)) - Concurrency mode is disabled, not creating a lock manager 2016-12-16 17:22:07,494 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 17:22:07,494 INFO ql.Driver (Driver.java:execute(1328)) - Starting command(queryId=hive_20161216172207_5586596a-c29b-44e7-b930-70c03b2e2f01): show tables like '*' 2016-12-16 17:22:07,494 INFO hooks.ATSHook (ATSHook.java:(84)) - Created ATS Hook 2016-12-16 17:22:07,495 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 17:22:07,495 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 17:22:07,495 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 17:22:07,495 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 17:22:07,495 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 17:22:07,496 INFO ql.Driver (Driver.java:launchTask(1651)) - Starting task [Stage-0:DDL] in serial mode 2016-12-16 17:22:07,496 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(746)) - 1: get_database: bigsql 2016-12-16 17:22:07,496 INFO HiveMetaStore.audit (HiveMetaStore.java:logAuditEvent(371)) - ugi=admin ip=unknown-ip-addr cmd=get_database: bigsql 2016-12-16 17:22:07,503 INFO exec.DDLTask (DDLTask.java:showTables(2265)) - pattern: * 2016-12-16 17:22:07,504 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(746)) - 1: get_tables: db=bigsql pat=* 2016-12-16 17:22:07,504 INFO HiveMetaStore.audit (HiveMetaStore.java:logAuditEvent(371)) - ugi=admin ip=unknown-ip-addr cmd=get_tables: db=bigsql pat=* 2016-12-16 17:22:07,508 INFO exec.DDLTask (DDLTask.java:showTables(2267)) - results : 7 2016-12-16 17:22:07,509 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 17:22:07,509 INFO hooks.ATSHook (ATSHook.java:(84)) - Created ATS Hook 2016-12-16 17:22:07,509 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 17:22:07,510 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 17:22:07,510 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 17:22:07,510 INFO ql.Driver (SessionState.java:printInfo(954)) - OK 2016-12-16 17:22:07,510 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 17:22:07,510 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 17:22:07,510 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 17:22:07,513 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(249)) - Total input paths to process : 1 2016-12-16 17:22:36,240 INFO thrift.ThriftCLIService (ThriftCLIService.java:OpenSession(294)) - Client protocol version: HIVE_CLI_SERVICE_PROTOCOL_V8 2016-12-16 17:22:36,252 INFO session.SessionState (SessionState.java:createPath(641)) - Created local directory: /tmp/1168fc26-05c6-49bc-a98f-8e5d512cda4a_resources 2016-12-16 17:22:36,258 INFO session.SessionState (SessionState.java:createPath(641)) - Created HDFS directory: /tmp/hive/anonymous/1168fc26-05c6-49bc-a98f-8e5d512cda4a 2016-12-16 17:22:36,260 INFO session.SessionState (SessionState.java:createPath(641)) - Created local directory: /tmp/hive/1168fc26-05c6-49bc-a98f-8e5d512cda4a 2016-12-16 17:22:36,265 INFO session.SessionState (SessionState.java:createPath(641)) - Created HDFS directory: /tmp/hive/anonymous/1168fc26-05c6-49bc-a98f-8e5d512cda4a/_tmp_space.db 2016-12-16 17:22:36,267 INFO session.HiveSessionImpl (HiveSessionImpl.java:setOperationLogSessionDir(236)) - Operation log session directory is created: /tmp/hive/operation_logs/1168fc26-05c6-49bc-a98f-8e5d512cda4a 2016-12-16 17:23:36,334 INFO thrift.ThriftCLIService (ThriftCLIService.java:OpenSession(294)) - Client protocol version: HIVE_CLI_SERVICE_PROTOCOL_V8 2016-12-16 17:23:36,345 INFO session.SessionState (SessionState.java:createPath(641)) - Created local directory: /tmp/31619564-45fd-45b2-b72a-72312438ee5a_resources 2016-12-16 17:23:36,350 INFO session.SessionState (SessionState.java:createPath(641)) - Created HDFS directory: /tmp/hive/anonymous/31619564-45fd-45b2-b72a-72312438ee5a 2016-12-16 17:23:36,352 INFO session.SessionState (SessionState.java:createPath(641)) - Created local directory: /tmp/hive/31619564-45fd-45b2-b72a-72312438ee5a 2016-12-16 17:23:36,356 INFO session.SessionState (SessionState.java:createPath(641)) - Created HDFS directory: /tmp/hive/anonymous/31619564-45fd-45b2-b72a-72312438ee5a/_tmp_space.db 2016-12-16 17:23:36,358 INFO session.HiveSessionImpl (HiveSessionImpl.java:setOperationLogSessionDir(236)) - Operation log session directory is created: /tmp/hive/operation_logs/31619564-45fd-45b2-b72a-72312438ee5a 2016-12-16 17:24:36,253 INFO thrift.ThriftCLIService (ThriftCLIService.java:OpenSession(294)) - Client protocol version: HIVE_CLI_SERVICE_PROTOCOL_V8 2016-12-16 17:24:36,267 INFO session.SessionState (SessionState.java:createPath(641)) - Created local directory: /tmp/8902fff4-e89e-42d8-9047-cde5cf624251_resources 2016-12-16 17:24:36,272 INFO session.SessionState (SessionState.java:createPath(641)) - Created HDFS directory: /tmp/hive/anonymous/8902fff4-e89e-42d8-9047-cde5cf624251 2016-12-16 17:24:36,274 INFO session.SessionState (SessionState.java:createPath(641)) - Created local directory: /tmp/hive/8902fff4-e89e-42d8-9047-cde5cf624251 2016-12-16 17:24:36,278 INFO session.SessionState (SessionState.java:createPath(641)) - Created HDFS directory: /tmp/hive/anonymous/8902fff4-e89e-42d8-9047-cde5cf624251/_tmp_space.db 2016-12-16 17:24:36,280 INFO session.HiveSessionImpl (HiveSessionImpl.java:setOperationLogSessionDir(236)) - Operation log session directory is created: /tmp/hive/operation_logs/8902fff4-e89e-42d8-9047-cde5cf624251 2016-12-16 17:25:36,211 INFO thrift.ThriftCLIService (ThriftCLIService.java:OpenSession(294)) - Client protocol version: HIVE_CLI_SERVICE_PROTOCOL_V8 2016-12-16 17:25:36,222 INFO session.SessionState (SessionState.java:createPath(641)) - Created local directory: /tmp/b31ba929-5dd4-4c1c-9ad7-ec2428a0fce9_resources 2016-12-16 17:25:36,225 INFO session.SessionState (SessionState.java:createPath(641)) - Created HDFS directory: /tmp/hive/anonymous/b31ba929-5dd4-4c1c-9ad7-ec2428a0fce9 2016-12-16 17:25:36,227 INFO session.SessionState (SessionState.java:createPath(641)) - Created local directory: /tmp/hive/b31ba929-5dd4-4c1c-9ad7-ec2428a0fce9 2016-12-16 17:25:36,230 INFO session.SessionState (SessionState.java:createPath(641)) - Created HDFS directory: /tmp/hive/anonymous/b31ba929-5dd4-4c1c-9ad7-ec2428a0fce9/_tmp_space.db 2016-12-16 17:25:36,232 INFO session.HiveSessionImpl (HiveSessionImpl.java:setOperationLogSessionDir(236)) - Operation log session directory is created: /tmp/hive/operation_logs/b31ba929-5dd4-4c1c-9ad7-ec2428a0fce9 2016-12-16 17:26:36,211 INFO thrift.ThriftCLIService (ThriftCLIService.java:OpenSession(294)) - Client protocol version: HIVE_CLI_SERVICE_PROTOCOL_V8 2016-12-16 17:26:36,221 INFO session.SessionState (SessionState.java:createPath(641)) - Created local directory: /tmp/e5c96125-648b-4ddb-b651-a00666ba7d80_resources 2016-12-16 17:26:36,230 INFO session.SessionState (SessionState.java:createPath(641)) - Created HDFS directory: /tmp/hive/anonymous/e5c96125-648b-4ddb-b651-a00666ba7d80 2016-12-16 17:26:36,232 INFO session.SessionState (SessionState.java:createPath(641)) - Created local directory: /tmp/hive/e5c96125-648b-4ddb-b651-a00666ba7d80 2016-12-16 17:26:36,240 INFO session.SessionState (SessionState.java:createPath(641)) - Created HDFS directory: /tmp/hive/anonymous/e5c96125-648b-4ddb-b651-a00666ba7d80/_tmp_space.db 2016-12-16 17:26:36,241 INFO session.HiveSessionImpl (HiveSessionImpl.java:setOperationLogSessionDir(236)) - Operation log session directory is created: /tmp/hive/operation_logs/e5c96125-648b-4ddb-b651-a00666ba7d80 2016-12-16 17:27:36,257 INFO thrift.ThriftCLIService (ThriftCLIService.java:OpenSession(294)) - Client protocol version: HIVE_CLI_SERVICE_PROTOCOL_V8 2016-12-16 17:27:36,268 INFO session.SessionState (SessionState.java:createPath(641)) - Created local directory: /tmp/95c786be-fbfe-4788-8706-dfc6d2f7d432_resources 2016-12-16 17:27:36,274 INFO session.SessionState (SessionState.java:createPath(641)) - Created HDFS directory: /tmp/hive/anonymous/95c786be-fbfe-4788-8706-dfc6d2f7d432 2016-12-16 17:27:36,276 INFO session.SessionState (SessionState.java:createPath(641)) - Created local directory: /tmp/hive/95c786be-fbfe-4788-8706-dfc6d2f7d432 2016-12-16 17:27:36,280 INFO session.SessionState (SessionState.java:createPath(641)) - Created HDFS directory: /tmp/hive/anonymous/95c786be-fbfe-4788-8706-dfc6d2f7d432/_tmp_space.db 2016-12-16 17:27:36,283 INFO session.HiveSessionImpl (HiveSessionImpl.java:setOperationLogSessionDir(236)) - Operation log session directory is created: /tmp/hive/operation_logs/95c786be-fbfe-4788-8706-dfc6d2f7d432 2016-12-16 17:28:36,199 INFO thrift.ThriftCLIService (ThriftCLIService.java:OpenSession(294)) - Client protocol version: HIVE_CLI_SERVICE_PROTOCOL_V8 2016-12-16 17:28:36,214 INFO session.SessionState (SessionState.java:createPath(641)) - Created local directory: /tmp/3cb0d186-fd97-413f-81c9-12b4df8b4c9c_resources 2016-12-16 17:28:36,218 INFO session.SessionState (SessionState.java:createPath(641)) - Created HDFS directory: /tmp/hive/anonymous/3cb0d186-fd97-413f-81c9-12b4df8b4c9c 2016-12-16 17:28:36,220 INFO session.SessionState (SessionState.java:createPath(641)) - Created local directory: /tmp/hive/3cb0d186-fd97-413f-81c9-12b4df8b4c9c 2016-12-16 17:28:36,223 INFO session.SessionState (SessionState.java:createPath(641)) - Created HDFS directory: /tmp/hive/anonymous/3cb0d186-fd97-413f-81c9-12b4df8b4c9c/_tmp_space.db 2016-12-16 17:28:36,224 INFO session.HiveSessionImpl (HiveSessionImpl.java:setOperationLogSessionDir(236)) - Operation log session directory is created: /tmp/hive/operation_logs/3cb0d186-fd97-413f-81c9-12b4df8b4c9c 2016-12-16 17:29:36,283 INFO thrift.ThriftCLIService (ThriftCLIService.java:OpenSession(294)) - Client protocol version: HIVE_CLI_SERVICE_PROTOCOL_V8 2016-12-16 17:29:36,296 INFO session.SessionState (SessionState.java:createPath(641)) - Created local directory: /tmp/5ca24e4c-437f-4de3-bdf0-6acd304ba9db_resources 2016-12-16 17:29:36,300 INFO session.SessionState (SessionState.java:createPath(641)) - Created HDFS directory: /tmp/hive/anonymous/5ca24e4c-437f-4de3-bdf0-6acd304ba9db 2016-12-16 17:29:36,302 INFO session.SessionState (SessionState.java:createPath(641)) - Created local directory: /tmp/hive/5ca24e4c-437f-4de3-bdf0-6acd304ba9db 2016-12-16 17:29:36,306 INFO session.SessionState (SessionState.java:createPath(641)) - Created HDFS directory: /tmp/hive/anonymous/5ca24e4c-437f-4de3-bdf0-6acd304ba9db/_tmp_space.db 2016-12-16 17:29:36,307 INFO session.HiveSessionImpl (HiveSessionImpl.java:setOperationLogSessionDir(236)) - Operation log session directory is created: /tmp/hive/operation_logs/5ca24e4c-437f-4de3-bdf0-6acd304ba9db 2016-12-16 17:30:36,192 INFO thrift.ThriftCLIService (ThriftCLIService.java:OpenSession(294)) - Client protocol version: HIVE_CLI_SERVICE_PROTOCOL_V8 2016-12-16 17:30:36,208 INFO session.SessionState (SessionState.java:createPath(641)) - Created local directory: /tmp/03a5199a-dba5-4d82-9a50-440286250a5d_resources 2016-12-16 17:30:36,214 INFO session.SessionState (SessionState.java:createPath(641)) - Created HDFS directory: /tmp/hive/anonymous/03a5199a-dba5-4d82-9a50-440286250a5d 2016-12-16 17:30:36,218 INFO session.SessionState (SessionState.java:createPath(641)) - Created local directory: /tmp/hive/03a5199a-dba5-4d82-9a50-440286250a5d 2016-12-16 17:30:36,226 INFO session.SessionState (SessionState.java:createPath(641)) - Created HDFS directory: /tmp/hive/anonymous/03a5199a-dba5-4d82-9a50-440286250a5d/_tmp_space.db 2016-12-16 17:30:36,229 INFO session.HiveSessionImpl (HiveSessionImpl.java:setOperationLogSessionDir(236)) - Operation log session directory is created: /tmp/hive/operation_logs/03a5199a-dba5-4d82-9a50-440286250a5d 2016-12-16 17:31:36,215 INFO thrift.ThriftCLIService (ThriftCLIService.java:OpenSession(294)) - Client protocol version: HIVE_CLI_SERVICE_PROTOCOL_V8 2016-12-16 17:31:36,229 INFO session.SessionState (SessionState.java:createPath(641)) - Created local directory: /tmp/9eb18c36-ea6a-43d5-9e26-4dbf25af4a3d_resources 2016-12-16 17:31:36,232 INFO session.SessionState (SessionState.java:createPath(641)) - Created HDFS directory: /tmp/hive/anonymous/9eb18c36-ea6a-43d5-9e26-4dbf25af4a3d 2016-12-16 17:31:36,234 INFO session.SessionState (SessionState.java:createPath(641)) - Created local directory: /tmp/hive/9eb18c36-ea6a-43d5-9e26-4dbf25af4a3d 2016-12-16 17:31:36,238 INFO session.SessionState (SessionState.java:createPath(641)) - Created HDFS directory: /tmp/hive/anonymous/9eb18c36-ea6a-43d5-9e26-4dbf25af4a3d/_tmp_space.db 2016-12-16 17:31:36,239 INFO session.HiveSessionImpl (HiveSessionImpl.java:setOperationLogSessionDir(236)) - Operation log session directory is created: /tmp/hive/operation_logs/9eb18c36-ea6a-43d5-9e26-4dbf25af4a3d 2016-12-16 17:32:36,233 INFO thrift.ThriftCLIService (ThriftCLIService.java:OpenSession(294)) - Client protocol version: HIVE_CLI_SERVICE_PROTOCOL_V8 2016-12-16 17:32:36,253 INFO session.SessionState (SessionState.java:createPath(641)) - Created local directory: /tmp/05503080-39ca-4e8e-839e-6b93b70af607_resources 2016-12-16 17:32:36,260 INFO session.SessionState (SessionState.java:createPath(641)) - Created HDFS directory: /tmp/hive/anonymous/05503080-39ca-4e8e-839e-6b93b70af607 2016-12-16 17:32:36,263 INFO session.SessionState (SessionState.java:createPath(641)) - Created local directory: /tmp/hive/05503080-39ca-4e8e-839e-6b93b70af607 2016-12-16 17:32:36,267 INFO session.SessionState (SessionState.java:createPath(641)) - Created HDFS directory: /tmp/hive/anonymous/05503080-39ca-4e8e-839e-6b93b70af607/_tmp_space.db 2016-12-16 17:32:36,268 INFO session.HiveSessionImpl (HiveSessionImpl.java:setOperationLogSessionDir(236)) - Operation log session directory is created: /tmp/hive/operation_logs/05503080-39ca-4e8e-839e-6b93b70af607 2016-12-16 17:33:36,254 INFO thrift.ThriftCLIService (ThriftCLIService.java:OpenSession(294)) - Client protocol version: HIVE_CLI_SERVICE_PROTOCOL_V8 2016-12-16 17:33:36,270 INFO session.SessionState (SessionState.java:createPath(641)) - Created local directory: /tmp/6f6bd50e-6f48-4732-83ec-d375f3afabb5_resources 2016-12-16 17:33:36,273 INFO session.SessionState (SessionState.java:createPath(641)) - Created HDFS directory: /tmp/hive/anonymous/6f6bd50e-6f48-4732-83ec-d375f3afabb5 2016-12-16 17:33:36,275 INFO session.SessionState (SessionState.java:createPath(641)) - Created local directory: /tmp/hive/6f6bd50e-6f48-4732-83ec-d375f3afabb5 2016-12-16 17:33:36,280 INFO session.SessionState (SessionState.java:createPath(641)) - Created HDFS directory: /tmp/hive/anonymous/6f6bd50e-6f48-4732-83ec-d375f3afabb5/_tmp_space.db 2016-12-16 17:33:36,282 INFO session.HiveSessionImpl (HiveSessionImpl.java:setOperationLogSessionDir(236)) - Operation log session directory is created: /tmp/hive/operation_logs/6f6bd50e-6f48-4732-83ec-d375f3afabb5 2016-12-16 17:34:36,253 INFO thrift.ThriftCLIService (ThriftCLIService.java:OpenSession(294)) - Client protocol version: HIVE_CLI_SERVICE_PROTOCOL_V8 2016-12-16 17:34:36,265 INFO session.SessionState (SessionState.java:createPath(641)) - Created local directory: /tmp/4c3fc36c-6c0c-4adc-8e4c-138fdc86bae0_resources 2016-12-16 17:34:36,270 INFO session.SessionState (SessionState.java:createPath(641)) - Created HDFS directory: /tmp/hive/anonymous/4c3fc36c-6c0c-4adc-8e4c-138fdc86bae0 2016-12-16 17:34:36,272 INFO session.SessionState (SessionState.java:createPath(641)) - Created local directory: /tmp/hive/4c3fc36c-6c0c-4adc-8e4c-138fdc86bae0 2016-12-16 17:34:36,277 INFO session.SessionState (SessionState.java:createPath(641)) - Created HDFS directory: /tmp/hive/anonymous/4c3fc36c-6c0c-4adc-8e4c-138fdc86bae0/_tmp_space.db 2016-12-16 17:34:36,279 INFO session.HiveSessionImpl (HiveSessionImpl.java:setOperationLogSessionDir(236)) - Operation log session directory is created: /tmp/hive/operation_logs/4c3fc36c-6c0c-4adc-8e4c-138fdc86bae0 2016-12-16 17:35:36,274 INFO thrift.ThriftCLIService (ThriftCLIService.java:OpenSession(294)) - Client protocol version: HIVE_CLI_SERVICE_PROTOCOL_V8 2016-12-16 17:35:36,286 INFO session.SessionState (SessionState.java:createPath(641)) - Created local directory: /tmp/b656393e-5650-4b4f-9456-a139721a164a_resources 2016-12-16 17:35:36,290 INFO session.SessionState (SessionState.java:createPath(641)) - Created HDFS directory: /tmp/hive/anonymous/b656393e-5650-4b4f-9456-a139721a164a 2016-12-16 17:35:36,294 INFO session.SessionState (SessionState.java:createPath(641)) - Created local directory: /tmp/hive/b656393e-5650-4b4f-9456-a139721a164a 2016-12-16 17:35:36,298 INFO session.SessionState (SessionState.java:createPath(641)) - Created HDFS directory: /tmp/hive/anonymous/b656393e-5650-4b4f-9456-a139721a164a/_tmp_space.db 2016-12-16 17:35:36,300 INFO session.HiveSessionImpl (HiveSessionImpl.java:setOperationLogSessionDir(236)) - Operation log session directory is created: /tmp/hive/operation_logs/b656393e-5650-4b4f-9456-a139721a164a 2016-12-16 17:36:36,209 INFO thrift.ThriftCLIService (ThriftCLIService.java:OpenSession(294)) - Client protocol version: HIVE_CLI_SERVICE_PROTOCOL_V8 2016-12-16 17:36:36,224 INFO session.SessionState (SessionState.java:createPath(641)) - Created local directory: /tmp/45b2fa78-d8c9-4a22-a9ef-7878f7f5d36e_resources 2016-12-16 17:36:36,227 INFO session.SessionState (SessionState.java:createPath(641)) - Created HDFS directory: /tmp/hive/anonymous/45b2fa78-d8c9-4a22-a9ef-7878f7f5d36e 2016-12-16 17:36:36,229 INFO session.SessionState (SessionState.java:createPath(641)) - Created local directory: /tmp/hive/45b2fa78-d8c9-4a22-a9ef-7878f7f5d36e 2016-12-16 17:36:36,233 INFO session.SessionState (SessionState.java:createPath(641)) - Created HDFS directory: /tmp/hive/anonymous/45b2fa78-d8c9-4a22-a9ef-7878f7f5d36e/_tmp_space.db 2016-12-16 17:36:36,234 INFO session.HiveSessionImpl (HiveSessionImpl.java:setOperationLogSessionDir(236)) - Operation log session directory is created: /tmp/hive/operation_logs/45b2fa78-d8c9-4a22-a9ef-7878f7f5d36e 2016-12-16 17:37:36,214 INFO thrift.ThriftCLIService (ThriftCLIService.java:OpenSession(294)) - Client protocol version: HIVE_CLI_SERVICE_PROTOCOL_V8 2016-12-16 17:37:36,228 INFO session.SessionState (SessionState.java:createPath(641)) - Created local directory: /tmp/b0eaa1bc-e601-4c4c-b219-a57a806ac350_resources 2016-12-16 17:37:36,234 INFO session.SessionState (SessionState.java:createPath(641)) - Created HDFS directory: /tmp/hive/anonymous/b0eaa1bc-e601-4c4c-b219-a57a806ac350 2016-12-16 17:37:36,235 INFO session.SessionState (SessionState.java:createPath(641)) - Created local directory: /tmp/hive/b0eaa1bc-e601-4c4c-b219-a57a806ac350 2016-12-16 17:37:36,239 INFO session.SessionState (SessionState.java:createPath(641)) - Created HDFS directory: /tmp/hive/anonymous/b0eaa1bc-e601-4c4c-b219-a57a806ac350/_tmp_space.db 2016-12-16 17:37:36,241 INFO session.HiveSessionImpl (HiveSessionImpl.java:setOperationLogSessionDir(236)) - Operation log session directory is created: /tmp/hive/operation_logs/b0eaa1bc-e601-4c4c-b219-a57a806ac350 2016-12-16 17:38:36,244 INFO thrift.ThriftCLIService (ThriftCLIService.java:OpenSession(294)) - Client protocol version: HIVE_CLI_SERVICE_PROTOCOL_V8 2016-12-16 17:38:36,255 INFO session.SessionState (SessionState.java:createPath(641)) - Created local directory: /tmp/8d8fff8c-ecc7-4cd9-9e23-72212ceb6b97_resources 2016-12-16 17:38:36,259 INFO session.SessionState (SessionState.java:createPath(641)) - Created HDFS directory: /tmp/hive/anonymous/8d8fff8c-ecc7-4cd9-9e23-72212ceb6b97 2016-12-16 17:38:36,261 INFO session.SessionState (SessionState.java:createPath(641)) - Created local directory: /tmp/hive/8d8fff8c-ecc7-4cd9-9e23-72212ceb6b97 2016-12-16 17:38:36,265 INFO session.SessionState (SessionState.java:createPath(641)) - Created HDFS directory: /tmp/hive/anonymous/8d8fff8c-ecc7-4cd9-9e23-72212ceb6b97/_tmp_space.db 2016-12-16 17:38:36,267 INFO session.HiveSessionImpl (HiveSessionImpl.java:setOperationLogSessionDir(236)) - Operation log session directory is created: /tmp/hive/operation_logs/8d8fff8c-ecc7-4cd9-9e23-72212ceb6b97 2016-12-16 17:39:36,221 INFO thrift.ThriftCLIService (ThriftCLIService.java:OpenSession(294)) - Client protocol version: HIVE_CLI_SERVICE_PROTOCOL_V8 2016-12-16 17:39:36,235 INFO session.SessionState (SessionState.java:createPath(641)) - Created local directory: /tmp/989c57fd-f26f-44fb-be12-c5bad4c0843b_resources 2016-12-16 17:39:36,253 INFO session.SessionState (SessionState.java:createPath(641)) - Created HDFS directory: /tmp/hive/anonymous/989c57fd-f26f-44fb-be12-c5bad4c0843b 2016-12-16 17:39:36,255 INFO session.SessionState (SessionState.java:createPath(641)) - Created local directory: /tmp/hive/989c57fd-f26f-44fb-be12-c5bad4c0843b 2016-12-16 17:39:36,263 INFO session.SessionState (SessionState.java:createPath(641)) - Created HDFS directory: /tmp/hive/anonymous/989c57fd-f26f-44fb-be12-c5bad4c0843b/_tmp_space.db 2016-12-16 17:39:36,265 INFO session.HiveSessionImpl (HiveSessionImpl.java:setOperationLogSessionDir(236)) - Operation log session directory is created: /tmp/hive/operation_logs/989c57fd-f26f-44fb-be12-c5bad4c0843b 2016-12-16 17:40:36,204 INFO thrift.ThriftCLIService (ThriftCLIService.java:OpenSession(294)) - Client protocol version: HIVE_CLI_SERVICE_PROTOCOL_V8 2016-12-16 17:40:36,219 INFO session.SessionState (SessionState.java:createPath(641)) - Created local directory: /tmp/64d4c063-ce86-4159-bcff-b160d3bd94bd_resources 2016-12-16 17:40:36,223 INFO session.SessionState (SessionState.java:createPath(641)) - Created HDFS directory: /tmp/hive/anonymous/64d4c063-ce86-4159-bcff-b160d3bd94bd 2016-12-16 17:40:36,225 INFO session.SessionState (SessionState.java:createPath(641)) - Created local directory: /tmp/hive/64d4c063-ce86-4159-bcff-b160d3bd94bd 2016-12-16 17:40:36,230 INFO session.SessionState (SessionState.java:createPath(641)) - Created HDFS directory: /tmp/hive/anonymous/64d4c063-ce86-4159-bcff-b160d3bd94bd/_tmp_space.db 2016-12-16 17:40:36,232 INFO session.HiveSessionImpl (HiveSessionImpl.java:setOperationLogSessionDir(236)) - Operation log session directory is created: /tmp/hive/operation_logs/64d4c063-ce86-4159-bcff-b160d3bd94bd 2016-12-16 17:41:36,161 INFO thrift.ThriftCLIService (ThriftCLIService.java:OpenSession(294)) - Client protocol version: HIVE_CLI_SERVICE_PROTOCOL_V8 2016-12-16 17:41:36,173 INFO session.SessionState (SessionState.java:createPath(641)) - Created local directory: /tmp/2d87e2c6-2961-4370-8c96-40c8a6d4006a_resources 2016-12-16 17:41:36,178 INFO session.SessionState (SessionState.java:createPath(641)) - Created HDFS directory: /tmp/hive/anonymous/2d87e2c6-2961-4370-8c96-40c8a6d4006a 2016-12-16 17:41:36,180 INFO session.SessionState (SessionState.java:createPath(641)) - Created local directory: /tmp/hive/2d87e2c6-2961-4370-8c96-40c8a6d4006a 2016-12-16 17:41:36,188 INFO session.SessionState (SessionState.java:createPath(641)) - Created HDFS directory: /tmp/hive/anonymous/2d87e2c6-2961-4370-8c96-40c8a6d4006a/_tmp_space.db 2016-12-16 17:41:36,190 INFO session.HiveSessionImpl (HiveSessionImpl.java:setOperationLogSessionDir(236)) - Operation log session directory is created: /tmp/hive/operation_logs/2d87e2c6-2961-4370-8c96-40c8a6d4006a 2016-12-16 17:42:36,350 INFO thrift.ThriftCLIService (ThriftCLIService.java:OpenSession(294)) - Client protocol version: HIVE_CLI_SERVICE_PROTOCOL_V8 2016-12-16 17:42:36,368 INFO session.SessionState (SessionState.java:createPath(641)) - Created local directory: /tmp/933bef59-dbd8-4887-a493-5286b0ad10de_resources 2016-12-16 17:42:36,374 INFO session.SessionState (SessionState.java:createPath(641)) - Created HDFS directory: /tmp/hive/anonymous/933bef59-dbd8-4887-a493-5286b0ad10de 2016-12-16 17:42:36,376 INFO session.SessionState (SessionState.java:createPath(641)) - Created local directory: /tmp/hive/933bef59-dbd8-4887-a493-5286b0ad10de 2016-12-16 17:42:36,381 INFO session.SessionState (SessionState.java:createPath(641)) - Created HDFS directory: /tmp/hive/anonymous/933bef59-dbd8-4887-a493-5286b0ad10de/_tmp_space.db 2016-12-16 17:42:36,383 INFO session.HiveSessionImpl (HiveSessionImpl.java:setOperationLogSessionDir(236)) - Operation log session directory is created: /tmp/hive/operation_logs/933bef59-dbd8-4887-a493-5286b0ad10de 2016-12-16 17:43:36,333 INFO thrift.ThriftCLIService (ThriftCLIService.java:OpenSession(294)) - Client protocol version: HIVE_CLI_SERVICE_PROTOCOL_V8 2016-12-16 17:43:36,348 INFO session.SessionState (SessionState.java:createPath(641)) - Created local directory: /tmp/91408ee5-bb9a-4e20-8a96-ce380a4642d0_resources 2016-12-16 17:43:36,353 INFO session.SessionState (SessionState.java:createPath(641)) - Created HDFS directory: /tmp/hive/anonymous/91408ee5-bb9a-4e20-8a96-ce380a4642d0 2016-12-16 17:43:36,356 INFO session.SessionState (SessionState.java:createPath(641)) - Created local directory: /tmp/hive/91408ee5-bb9a-4e20-8a96-ce380a4642d0 2016-12-16 17:43:36,365 INFO session.SessionState (SessionState.java:createPath(641)) - Created HDFS directory: /tmp/hive/anonymous/91408ee5-bb9a-4e20-8a96-ce380a4642d0/_tmp_space.db 2016-12-16 17:43:36,367 INFO session.HiveSessionImpl (HiveSessionImpl.java:setOperationLogSessionDir(236)) - Operation log session directory is created: /tmp/hive/operation_logs/91408ee5-bb9a-4e20-8a96-ce380a4642d0 2016-12-16 17:44:36,198 INFO thrift.ThriftCLIService (ThriftCLIService.java:OpenSession(294)) - Client protocol version: HIVE_CLI_SERVICE_PROTOCOL_V8 2016-12-16 17:44:36,213 INFO session.SessionState (SessionState.java:createPath(641)) - Created local directory: /tmp/d15f3ea1-8f63-4e72-b305-803a5efde601_resources 2016-12-16 17:44:36,218 INFO session.SessionState (SessionState.java:createPath(641)) - Created HDFS directory: /tmp/hive/anonymous/d15f3ea1-8f63-4e72-b305-803a5efde601 2016-12-16 17:44:36,220 INFO session.SessionState (SessionState.java:createPath(641)) - Created local directory: /tmp/hive/d15f3ea1-8f63-4e72-b305-803a5efde601 2016-12-16 17:44:36,225 INFO session.SessionState (SessionState.java:createPath(641)) - Created HDFS directory: /tmp/hive/anonymous/d15f3ea1-8f63-4e72-b305-803a5efde601/_tmp_space.db 2016-12-16 17:44:36,227 INFO session.HiveSessionImpl (HiveSessionImpl.java:setOperationLogSessionDir(236)) - Operation log session directory is created: /tmp/hive/operation_logs/d15f3ea1-8f63-4e72-b305-803a5efde601 2016-12-16 17:45:36,254 INFO thrift.ThriftCLIService (ThriftCLIService.java:OpenSession(294)) - Client protocol version: HIVE_CLI_SERVICE_PROTOCOL_V8 2016-12-16 17:45:36,264 INFO session.SessionState (SessionState.java:createPath(641)) - Created local directory: /tmp/61c48dbc-a4d2-444b-b112-793c4231cc1e_resources 2016-12-16 17:45:36,272 INFO session.SessionState (SessionState.java:createPath(641)) - Created HDFS directory: /tmp/hive/anonymous/61c48dbc-a4d2-444b-b112-793c4231cc1e 2016-12-16 17:45:36,274 INFO session.SessionState (SessionState.java:createPath(641)) - Created local directory: /tmp/hive/61c48dbc-a4d2-444b-b112-793c4231cc1e 2016-12-16 17:45:36,280 INFO session.SessionState (SessionState.java:createPath(641)) - Created HDFS directory: /tmp/hive/anonymous/61c48dbc-a4d2-444b-b112-793c4231cc1e/_tmp_space.db 2016-12-16 17:45:36,282 INFO session.HiveSessionImpl (HiveSessionImpl.java:setOperationLogSessionDir(236)) - Operation log session directory is created: /tmp/hive/operation_logs/61c48dbc-a4d2-444b-b112-793c4231cc1e 2016-12-16 17:46:36,327 INFO thrift.ThriftCLIService (ThriftCLIService.java:OpenSession(294)) - Client protocol version: HIVE_CLI_SERVICE_PROTOCOL_V8 2016-12-16 17:46:36,345 INFO session.SessionState (SessionState.java:createPath(641)) - Created local directory: /tmp/f7a5706a-897a-4ec6-83ce-dcb3180ad624_resources 2016-12-16 17:46:36,349 INFO session.SessionState (SessionState.java:createPath(641)) - Created HDFS directory: /tmp/hive/anonymous/f7a5706a-897a-4ec6-83ce-dcb3180ad624 2016-12-16 17:46:36,351 INFO session.SessionState (SessionState.java:createPath(641)) - Created local directory: /tmp/hive/f7a5706a-897a-4ec6-83ce-dcb3180ad624 2016-12-16 17:46:36,355 INFO session.SessionState (SessionState.java:createPath(641)) - Created HDFS directory: /tmp/hive/anonymous/f7a5706a-897a-4ec6-83ce-dcb3180ad624/_tmp_space.db 2016-12-16 17:46:36,357 INFO session.HiveSessionImpl (HiveSessionImpl.java:setOperationLogSessionDir(236)) - Operation log session directory is created: /tmp/hive/operation_logs/f7a5706a-897a-4ec6-83ce-dcb3180ad624 2016-12-16 17:47:36,444 INFO thrift.ThriftCLIService (ThriftCLIService.java:OpenSession(294)) - Client protocol version: HIVE_CLI_SERVICE_PROTOCOL_V8 2016-12-16 17:47:36,456 INFO session.SessionState (SessionState.java:createPath(641)) - Created local directory: /tmp/d0310f3e-e68d-4590-9e9c-29d1e9002ecb_resources 2016-12-16 17:47:36,463 INFO session.SessionState (SessionState.java:createPath(641)) - Created HDFS directory: /tmp/hive/anonymous/d0310f3e-e68d-4590-9e9c-29d1e9002ecb 2016-12-16 17:47:36,467 INFO session.SessionState (SessionState.java:createPath(641)) - Created local directory: /tmp/hive/d0310f3e-e68d-4590-9e9c-29d1e9002ecb 2016-12-16 17:47:36,483 INFO session.SessionState (SessionState.java:createPath(641)) - Created HDFS directory: /tmp/hive/anonymous/d0310f3e-e68d-4590-9e9c-29d1e9002ecb/_tmp_space.db 2016-12-16 17:47:36,486 INFO session.HiveSessionImpl (HiveSessionImpl.java:setOperationLogSessionDir(236)) - Operation log session directory is created: /tmp/hive/operation_logs/d0310f3e-e68d-4590-9e9c-29d1e9002ecb 2016-12-16 17:48:36,446 INFO thrift.ThriftCLIService (ThriftCLIService.java:OpenSession(294)) - Client protocol version: HIVE_CLI_SERVICE_PROTOCOL_V8 2016-12-16 17:48:36,461 INFO session.SessionState (SessionState.java:createPath(641)) - Created local directory: /tmp/8808df5e-26b0-46a6-b405-48109b894ea1_resources 2016-12-16 17:48:36,465 INFO session.SessionState (SessionState.java:createPath(641)) - Created HDFS directory: /tmp/hive/anonymous/8808df5e-26b0-46a6-b405-48109b894ea1 2016-12-16 17:48:36,466 INFO session.SessionState (SessionState.java:createPath(641)) - Created local directory: /tmp/hive/8808df5e-26b0-46a6-b405-48109b894ea1 2016-12-16 17:48:36,470 INFO session.SessionState (SessionState.java:createPath(641)) - Created HDFS directory: /tmp/hive/anonymous/8808df5e-26b0-46a6-b405-48109b894ea1/_tmp_space.db 2016-12-16 17:48:36,471 INFO session.HiveSessionImpl (HiveSessionImpl.java:setOperationLogSessionDir(236)) - Operation log session directory is created: /tmp/hive/operation_logs/8808df5e-26b0-46a6-b405-48109b894ea1 2016-12-16 17:49:36,295 INFO thrift.ThriftCLIService (ThriftCLIService.java:OpenSession(294)) - Client protocol version: HIVE_CLI_SERVICE_PROTOCOL_V8 2016-12-16 17:49:36,306 INFO session.SessionState (SessionState.java:createPath(641)) - Created local directory: /tmp/0fbf6532-e0af-4c8a-86d0-0f4f317b3ae3_resources 2016-12-16 17:49:36,314 INFO session.SessionState (SessionState.java:createPath(641)) - Created HDFS directory: /tmp/hive/anonymous/0fbf6532-e0af-4c8a-86d0-0f4f317b3ae3 2016-12-16 17:49:36,317 INFO session.SessionState (SessionState.java:createPath(641)) - Created local directory: /tmp/hive/0fbf6532-e0af-4c8a-86d0-0f4f317b3ae3 2016-12-16 17:49:36,324 INFO session.SessionState (SessionState.java:createPath(641)) - Created HDFS directory: /tmp/hive/anonymous/0fbf6532-e0af-4c8a-86d0-0f4f317b3ae3/_tmp_space.db 2016-12-16 17:49:36,327 INFO session.HiveSessionImpl (HiveSessionImpl.java:setOperationLogSessionDir(236)) - Operation log session directory is created: /tmp/hive/operation_logs/0fbf6532-e0af-4c8a-86d0-0f4f317b3ae3 2016-12-16 17:50:36,270 INFO thrift.ThriftCLIService (ThriftCLIService.java:OpenSession(294)) - Client protocol version: HIVE_CLI_SERVICE_PROTOCOL_V8 2016-12-16 17:50:36,291 INFO session.SessionState (SessionState.java:createPath(641)) - Created local directory: /tmp/2b5dbbc7-3e93-456f-a24f-a284632f6d3c_resources 2016-12-16 17:50:36,297 INFO session.SessionState (SessionState.java:createPath(641)) - Created HDFS directory: /tmp/hive/anonymous/2b5dbbc7-3e93-456f-a24f-a284632f6d3c 2016-12-16 17:50:36,300 INFO session.SessionState (SessionState.java:createPath(641)) - Created local directory: /tmp/hive/2b5dbbc7-3e93-456f-a24f-a284632f6d3c 2016-12-16 17:50:36,304 INFO session.SessionState (SessionState.java:createPath(641)) - Created HDFS directory: /tmp/hive/anonymous/2b5dbbc7-3e93-456f-a24f-a284632f6d3c/_tmp_space.db 2016-12-16 17:50:36,306 INFO session.HiveSessionImpl (HiveSessionImpl.java:setOperationLogSessionDir(236)) - Operation log session directory is created: /tmp/hive/operation_logs/2b5dbbc7-3e93-456f-a24f-a284632f6d3c 2016-12-16 17:51:36,220 INFO thrift.ThriftCLIService (ThriftCLIService.java:OpenSession(294)) - Client protocol version: HIVE_CLI_SERVICE_PROTOCOL_V8 2016-12-16 17:51:36,230 INFO session.SessionState (SessionState.java:createPath(641)) - Created local directory: /tmp/e7ae2056-3756-4bc0-b61a-877ee5da5a8e_resources 2016-12-16 17:51:36,234 INFO session.SessionState (SessionState.java:createPath(641)) - Created HDFS directory: /tmp/hive/anonymous/e7ae2056-3756-4bc0-b61a-877ee5da5a8e 2016-12-16 17:51:36,236 INFO session.SessionState (SessionState.java:createPath(641)) - Created local directory: /tmp/hive/e7ae2056-3756-4bc0-b61a-877ee5da5a8e 2016-12-16 17:51:36,239 INFO session.SessionState (SessionState.java:createPath(641)) - Created HDFS directory: /tmp/hive/anonymous/e7ae2056-3756-4bc0-b61a-877ee5da5a8e/_tmp_space.db 2016-12-16 17:51:36,241 INFO session.HiveSessionImpl (HiveSessionImpl.java:setOperationLogSessionDir(236)) - Operation log session directory is created: /tmp/hive/operation_logs/e7ae2056-3756-4bc0-b61a-877ee5da5a8e 2016-12-16 17:52:36,243 INFO thrift.ThriftCLIService (ThriftCLIService.java:OpenSession(294)) - Client protocol version: HIVE_CLI_SERVICE_PROTOCOL_V8 2016-12-16 17:52:36,253 INFO session.SessionState (SessionState.java:createPath(641)) - Created local directory: /tmp/8bfc6645-5553-4b74-b1a6-92fa902ced9c_resources 2016-12-16 17:52:36,258 INFO session.SessionState (SessionState.java:createPath(641)) - Created HDFS directory: /tmp/hive/anonymous/8bfc6645-5553-4b74-b1a6-92fa902ced9c 2016-12-16 17:52:36,260 INFO session.SessionState (SessionState.java:createPath(641)) - Created local directory: /tmp/hive/8bfc6645-5553-4b74-b1a6-92fa902ced9c 2016-12-16 17:52:36,265 INFO session.SessionState (SessionState.java:createPath(641)) - Created HDFS directory: /tmp/hive/anonymous/8bfc6645-5553-4b74-b1a6-92fa902ced9c/_tmp_space.db 2016-12-16 17:52:36,267 INFO session.HiveSessionImpl (HiveSessionImpl.java:setOperationLogSessionDir(236)) - Operation log session directory is created: /tmp/hive/operation_logs/8bfc6645-5553-4b74-b1a6-92fa902ced9c 2016-12-16 17:53:36,230 INFO thrift.ThriftCLIService (ThriftCLIService.java:OpenSession(294)) - Client protocol version: HIVE_CLI_SERVICE_PROTOCOL_V8 2016-12-16 17:53:36,242 INFO session.SessionState (SessionState.java:createPath(641)) - Created local directory: /tmp/8ae789fe-1ffa-4e48-812f-26e9927b730b_resources 2016-12-16 17:53:36,247 INFO session.SessionState (SessionState.java:createPath(641)) - Created HDFS directory: /tmp/hive/anonymous/8ae789fe-1ffa-4e48-812f-26e9927b730b 2016-12-16 17:53:36,251 INFO session.SessionState (SessionState.java:createPath(641)) - Created local directory: /tmp/hive/8ae789fe-1ffa-4e48-812f-26e9927b730b 2016-12-16 17:53:36,254 INFO session.SessionState (SessionState.java:createPath(641)) - Created HDFS directory: /tmp/hive/anonymous/8ae789fe-1ffa-4e48-812f-26e9927b730b/_tmp_space.db 2016-12-16 17:53:36,256 INFO session.HiveSessionImpl (HiveSessionImpl.java:setOperationLogSessionDir(236)) - Operation log session directory is created: /tmp/hive/operation_logs/8ae789fe-1ffa-4e48-812f-26e9927b730b 2016-12-16 17:54:36,268 INFO thrift.ThriftCLIService (ThriftCLIService.java:OpenSession(294)) - Client protocol version: HIVE_CLI_SERVICE_PROTOCOL_V8 2016-12-16 17:54:36,283 INFO session.SessionState (SessionState.java:createPath(641)) - Created local directory: /tmp/5d3be1cd-c791-46f2-832e-75de48102707_resources 2016-12-16 17:54:36,292 INFO session.SessionState (SessionState.java:createPath(641)) - Created HDFS directory: /tmp/hive/anonymous/5d3be1cd-c791-46f2-832e-75de48102707 2016-12-16 17:54:36,294 INFO session.SessionState (SessionState.java:createPath(641)) - Created local directory: /tmp/hive/5d3be1cd-c791-46f2-832e-75de48102707 2016-12-16 17:54:36,297 INFO session.SessionState (SessionState.java:createPath(641)) - Created HDFS directory: /tmp/hive/anonymous/5d3be1cd-c791-46f2-832e-75de48102707/_tmp_space.db 2016-12-16 17:54:36,299 INFO session.HiveSessionImpl (HiveSessionImpl.java:setOperationLogSessionDir(236)) - Operation log session directory is created: /tmp/hive/operation_logs/5d3be1cd-c791-46f2-832e-75de48102707 2016-12-16 17:55:36,222 INFO thrift.ThriftCLIService (ThriftCLIService.java:OpenSession(294)) - Client protocol version: HIVE_CLI_SERVICE_PROTOCOL_V8 2016-12-16 17:55:36,232 INFO session.SessionState (SessionState.java:createPath(641)) - Created local directory: /tmp/dd6767c1-de5c-4638-9ded-b22396e0bc48_resources 2016-12-16 17:55:36,238 INFO session.SessionState (SessionState.java:createPath(641)) - Created HDFS directory: /tmp/hive/anonymous/dd6767c1-de5c-4638-9ded-b22396e0bc48 2016-12-16 17:55:36,240 INFO session.SessionState (SessionState.java:createPath(641)) - Created local directory: /tmp/hive/dd6767c1-de5c-4638-9ded-b22396e0bc48 2016-12-16 17:55:36,245 INFO session.SessionState (SessionState.java:createPath(641)) - Created HDFS directory: /tmp/hive/anonymous/dd6767c1-de5c-4638-9ded-b22396e0bc48/_tmp_space.db 2016-12-16 17:55:36,247 INFO session.HiveSessionImpl (HiveSessionImpl.java:setOperationLogSessionDir(236)) - Operation log session directory is created: /tmp/hive/operation_logs/dd6767c1-de5c-4638-9ded-b22396e0bc48 2016-12-16 17:56:36,225 INFO thrift.ThriftCLIService (ThriftCLIService.java:OpenSession(294)) - Client protocol version: HIVE_CLI_SERVICE_PROTOCOL_V8 2016-12-16 17:56:36,236 INFO session.SessionState (SessionState.java:createPath(641)) - Created local directory: /tmp/97574789-f3ad-46e2-84ed-f60eb8447dd0_resources 2016-12-16 17:56:36,240 INFO session.SessionState (SessionState.java:createPath(641)) - Created HDFS directory: /tmp/hive/anonymous/97574789-f3ad-46e2-84ed-f60eb8447dd0 2016-12-16 17:56:36,242 INFO session.SessionState (SessionState.java:createPath(641)) - Created local directory: /tmp/hive/97574789-f3ad-46e2-84ed-f60eb8447dd0 2016-12-16 17:56:36,254 INFO session.SessionState (SessionState.java:createPath(641)) - Created HDFS directory: /tmp/hive/anonymous/97574789-f3ad-46e2-84ed-f60eb8447dd0/_tmp_space.db 2016-12-16 17:56:36,256 INFO session.HiveSessionImpl (HiveSessionImpl.java:setOperationLogSessionDir(236)) - Operation log session directory is created: /tmp/hive/operation_logs/97574789-f3ad-46e2-84ed-f60eb8447dd0 2016-12-16 17:57:36,162 INFO thrift.ThriftCLIService (ThriftCLIService.java:OpenSession(294)) - Client protocol version: HIVE_CLI_SERVICE_PROTOCOL_V8 2016-12-16 17:57:36,174 INFO session.SessionState (SessionState.java:createPath(641)) - Created local directory: /tmp/6a93f737-df0d-4a6f-adf7-db15b5e96645_resources 2016-12-16 17:57:36,182 INFO session.SessionState (SessionState.java:createPath(641)) - Created HDFS directory: /tmp/hive/anonymous/6a93f737-df0d-4a6f-adf7-db15b5e96645 2016-12-16 17:57:36,184 INFO session.SessionState (SessionState.java:createPath(641)) - Created local directory: /tmp/hive/6a93f737-df0d-4a6f-adf7-db15b5e96645 2016-12-16 17:57:36,189 INFO session.SessionState (SessionState.java:createPath(641)) - Created HDFS directory: /tmp/hive/anonymous/6a93f737-df0d-4a6f-adf7-db15b5e96645/_tmp_space.db 2016-12-16 17:57:36,191 INFO session.HiveSessionImpl (HiveSessionImpl.java:setOperationLogSessionDir(236)) - Operation log session directory is created: /tmp/hive/operation_logs/6a93f737-df0d-4a6f-adf7-db15b5e96645 2016-12-16 17:58:36,156 INFO thrift.ThriftCLIService (ThriftCLIService.java:OpenSession(294)) - Client protocol version: HIVE_CLI_SERVICE_PROTOCOL_V8 2016-12-16 17:58:36,168 INFO session.SessionState (SessionState.java:createPath(641)) - Created local directory: /tmp/8d41c160-2854-4871-945c-5847545c16c1_resources 2016-12-16 17:58:36,172 INFO session.SessionState (SessionState.java:createPath(641)) - Created HDFS directory: /tmp/hive/anonymous/8d41c160-2854-4871-945c-5847545c16c1 2016-12-16 17:58:36,174 INFO session.SessionState (SessionState.java:createPath(641)) - Created local directory: /tmp/hive/8d41c160-2854-4871-945c-5847545c16c1 2016-12-16 17:58:36,183 INFO session.SessionState (SessionState.java:createPath(641)) - Created HDFS directory: /tmp/hive/anonymous/8d41c160-2854-4871-945c-5847545c16c1/_tmp_space.db 2016-12-16 17:58:36,185 INFO session.HiveSessionImpl (HiveSessionImpl.java:setOperationLogSessionDir(236)) - Operation log session directory is created: /tmp/hive/operation_logs/8d41c160-2854-4871-945c-5847545c16c1 2016-12-16 17:59:36,252 INFO thrift.ThriftCLIService (ThriftCLIService.java:OpenSession(294)) - Client protocol version: HIVE_CLI_SERVICE_PROTOCOL_V8 2016-12-16 17:59:36,266 INFO session.SessionState (SessionState.java:createPath(641)) - Created local directory: /tmp/5878cad9-4fc1-4ab7-83f6-732cc0e9ffa0_resources 2016-12-16 17:59:36,273 INFO session.SessionState (SessionState.java:createPath(641)) - Created HDFS directory: /tmp/hive/anonymous/5878cad9-4fc1-4ab7-83f6-732cc0e9ffa0 2016-12-16 17:59:36,275 INFO session.SessionState (SessionState.java:createPath(641)) - Created local directory: /tmp/hive/5878cad9-4fc1-4ab7-83f6-732cc0e9ffa0 2016-12-16 17:59:36,279 INFO session.SessionState (SessionState.java:createPath(641)) - Created HDFS directory: /tmp/hive/anonymous/5878cad9-4fc1-4ab7-83f6-732cc0e9ffa0/_tmp_space.db 2016-12-16 17:59:36,281 INFO session.HiveSessionImpl (HiveSessionImpl.java:setOperationLogSessionDir(236)) - Operation log session directory is created: /tmp/hive/operation_logs/5878cad9-4fc1-4ab7-83f6-732cc0e9ffa0 2016-12-16 18:00:36,249 INFO thrift.ThriftCLIService (ThriftCLIService.java:OpenSession(294)) - Client protocol version: HIVE_CLI_SERVICE_PROTOCOL_V8 2016-12-16 18:00:36,265 INFO session.SessionState (SessionState.java:createPath(641)) - Created local directory: /tmp/67a0ed5c-20da-4510-9e6b-d77f59bc27b9_resources 2016-12-16 18:00:36,270 INFO session.SessionState (SessionState.java:createPath(641)) - Created HDFS directory: /tmp/hive/anonymous/67a0ed5c-20da-4510-9e6b-d77f59bc27b9 2016-12-16 18:00:36,272 INFO session.SessionState (SessionState.java:createPath(641)) - Created local directory: /tmp/hive/67a0ed5c-20da-4510-9e6b-d77f59bc27b9 2016-12-16 18:00:36,280 INFO session.SessionState (SessionState.java:createPath(641)) - Created HDFS directory: /tmp/hive/anonymous/67a0ed5c-20da-4510-9e6b-d77f59bc27b9/_tmp_space.db 2016-12-16 18:00:36,283 INFO session.HiveSessionImpl (HiveSessionImpl.java:setOperationLogSessionDir(236)) - Operation log session directory is created: /tmp/hive/operation_logs/67a0ed5c-20da-4510-9e6b-d77f59bc27b9 2016-12-16 18:01:36,265 INFO thrift.ThriftCLIService (ThriftCLIService.java:OpenSession(294)) - Client protocol version: HIVE_CLI_SERVICE_PROTOCOL_V8 2016-12-16 18:01:36,278 INFO session.SessionState (SessionState.java:createPath(641)) - Created local directory: /tmp/89b042b5-1c7e-4a67-b54b-1574d9f278ca_resources 2016-12-16 18:01:36,282 INFO session.SessionState (SessionState.java:createPath(641)) - Created HDFS directory: /tmp/hive/anonymous/89b042b5-1c7e-4a67-b54b-1574d9f278ca 2016-12-16 18:01:36,284 INFO session.SessionState (SessionState.java:createPath(641)) - Created local directory: /tmp/hive/89b042b5-1c7e-4a67-b54b-1574d9f278ca 2016-12-16 18:01:36,290 INFO session.SessionState (SessionState.java:createPath(641)) - Created HDFS directory: /tmp/hive/anonymous/89b042b5-1c7e-4a67-b54b-1574d9f278ca/_tmp_space.db 2016-12-16 18:01:36,292 INFO session.HiveSessionImpl (HiveSessionImpl.java:setOperationLogSessionDir(236)) - Operation log session directory is created: /tmp/hive/operation_logs/89b042b5-1c7e-4a67-b54b-1574d9f278ca 2016-12-16 18:01:46,311 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 18:01:46,312 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 18:01:46,312 INFO parse.ParseDriver (ParseDriver.java:parse(185)) - Parsing command: show databases like '*' 2016-12-16 18:01:46,312 INFO parse.ParseDriver (ParseDriver.java:parse(209)) - Parse Completed 2016-12-16 18:01:46,312 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 18:01:46,312 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 18:01:46,313 INFO ql.Driver (Driver.java:compile(436)) - Semantic Analysis Completed 2016-12-16 18:01:46,313 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 18:01:46,314 INFO exec.ListSinkOperator (Operator.java:initialize(332)) - Initializing operator OP[17] 2016-12-16 18:01:46,315 INFO exec.ListSinkOperator (Operator.java:initialize(372)) - Initialization Done 17 OP 2016-12-16 18:01:46,315 INFO exec.ListSinkOperator (Operator.java:initializeChildren(429)) - Operator 17 OP initialized 2016-12-16 18:01:46,315 INFO ql.Driver (Driver.java:getSchema(240)) - Returning Hive schema: Schema(fieldSchemas:[FieldSchema(name:database_name, type:string, comment:from deserializer)], properties:null) 2016-12-16 18:01:46,315 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 18:01:46,315 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 18:01:46,315 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 18:01:46,316 INFO ql.Driver (Driver.java:checkConcurrency(160)) - Concurrency mode is disabled, not creating a lock manager 2016-12-16 18:01:46,316 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 18:01:46,316 INFO ql.Driver (Driver.java:execute(1328)) - Starting command(queryId=hive_20161216180146_8b4966cb-7ef1-4c9a-8ddb-3d03cbc715c4): show databases like '*' 2016-12-16 18:01:46,316 INFO hooks.ATSHook (ATSHook.java:(84)) - Created ATS Hook 2016-12-16 18:01:46,316 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 18:01:46,317 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 18:01:46,317 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 18:01:46,317 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 18:01:46,317 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 18:01:46,318 INFO ql.Driver (Driver.java:launchTask(1651)) - Starting task [Stage-0:DDL] in serial mode 2016-12-16 18:01:46,318 INFO exec.DDLTask (DDLTask.java:showDatabases(2220)) - pattern: * 2016-12-16 18:01:46,318 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(746)) - 1: get_databases: * 2016-12-16 18:01:46,318 INFO HiveMetaStore.audit (HiveMetaStore.java:logAuditEvent(371)) - ugi=admin ip=unknown-ip-addr cmd=get_databases: * 2016-12-16 18:01:46,321 INFO exec.DDLTask (DDLTask.java:showDatabases(2225)) - results : 3 2016-12-16 18:01:46,323 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 18:01:46,323 INFO hooks.ATSHook (ATSHook.java:(84)) - Created ATS Hook 2016-12-16 18:01:46,323 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 18:01:46,324 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 18:01:46,324 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 18:01:46,325 INFO ql.Driver (SessionState.java:printInfo(954)) - OK 2016-12-16 18:01:46,325 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 18:01:46,325 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 18:01:46,325 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 18:01:46,328 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(249)) - Total input paths to process : 1 2016-12-16 18:01:46,714 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 18:01:46,714 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 18:01:46,715 INFO parse.ParseDriver (ParseDriver.java:parse(185)) - Parsing command: use bigsql 2016-12-16 18:01:46,715 INFO parse.ParseDriver (ParseDriver.java:parse(209)) - Parse Completed 2016-12-16 18:01:46,715 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 18:01:46,715 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 18:01:46,715 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(746)) - 1: get_database: bigsql 2016-12-16 18:01:46,716 INFO HiveMetaStore.audit (HiveMetaStore.java:logAuditEvent(371)) - ugi=admin ip=unknown-ip-addr cmd=get_database: bigsql 2016-12-16 18:01:46,726 INFO ql.Driver (Driver.java:compile(436)) - Semantic Analysis Completed 2016-12-16 18:01:46,726 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 18:01:46,726 INFO ql.Driver (Driver.java:getSchema(240)) - Returning Hive schema: Schema(fieldSchemas:null, properties:null) 2016-12-16 18:01:46,726 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 18:01:46,727 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 18:01:46,727 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 18:01:46,727 INFO ql.Driver (Driver.java:checkConcurrency(160)) - Concurrency mode is disabled, not creating a lock manager 2016-12-16 18:01:46,727 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 18:01:46,728 INFO ql.Driver (Driver.java:execute(1328)) - Starting command(queryId=hive_20161216180146_0723a335-3d24-422b-a5d3-df3df9621cd7): use bigsql 2016-12-16 18:01:46,728 INFO hooks.ATSHook (ATSHook.java:(84)) - Created ATS Hook 2016-12-16 18:01:46,728 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 18:01:46,729 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 18:01:46,729 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 18:01:46,729 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 18:01:46,730 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 18:01:46,730 INFO ql.Driver (Driver.java:launchTask(1651)) - Starting task [Stage-0:DDL] in serial mode 2016-12-16 18:01:46,730 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(746)) - 1: get_database: bigsql 2016-12-16 18:01:46,731 INFO HiveMetaStore.audit (HiveMetaStore.java:logAuditEvent(371)) - ugi=admin ip=unknown-ip-addr cmd=get_database: bigsql 2016-12-16 18:01:46,738 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(746)) - 1: get_database: bigsql 2016-12-16 18:01:46,738 INFO HiveMetaStore.audit (HiveMetaStore.java:logAuditEvent(371)) - ugi=admin ip=unknown-ip-addr cmd=get_database: bigsql 2016-12-16 18:01:46,746 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 18:01:46,746 INFO hooks.ATSHook (ATSHook.java:(84)) - Created ATS Hook 2016-12-16 18:01:46,746 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 18:01:46,746 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 18:01:46,747 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 18:01:46,747 INFO ql.Driver (SessionState.java:printInfo(954)) - OK 2016-12-16 18:01:46,747 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 18:01:46,747 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 18:01:46,747 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 18:01:46,749 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 18:01:46,749 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 18:01:46,750 INFO parse.ParseDriver (ParseDriver.java:parse(185)) - Parsing command: show tables like '*' 2016-12-16 18:01:46,750 INFO parse.ParseDriver (ParseDriver.java:parse(209)) - Parse Completed 2016-12-16 18:01:46,750 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 18:01:46,750 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 18:01:46,751 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(746)) - 1: get_database: bigsql 2016-12-16 18:01:46,751 INFO HiveMetaStore.audit (HiveMetaStore.java:logAuditEvent(371)) - ugi=admin ip=unknown-ip-addr cmd=get_database: bigsql 2016-12-16 18:01:46,759 INFO ql.Driver (Driver.java:compile(436)) - Semantic Analysis Completed 2016-12-16 18:01:46,760 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 18:01:46,761 INFO exec.ListSinkOperator (Operator.java:initialize(332)) - Initializing operator OP[18] 2016-12-16 18:01:46,761 INFO exec.ListSinkOperator (Operator.java:initialize(372)) - Initialization Done 18 OP 2016-12-16 18:01:46,761 INFO exec.ListSinkOperator (Operator.java:initializeChildren(429)) - Operator 18 OP initialized 2016-12-16 18:01:46,761 INFO ql.Driver (Driver.java:getSchema(240)) - Returning Hive schema: Schema(fieldSchemas:[FieldSchema(name:tab_name, type:string, comment:from deserializer)], properties:null) 2016-12-16 18:01:46,762 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 18:01:46,762 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 18:01:46,762 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 18:01:46,762 INFO ql.Driver (Driver.java:checkConcurrency(160)) - Concurrency mode is disabled, not creating a lock manager 2016-12-16 18:01:46,762 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 18:01:46,762 INFO ql.Driver (Driver.java:execute(1328)) - Starting command(queryId=hive_20161216180146_59d8f8e0-6121-4747-812c-e2442a714d6f): show tables like '*' 2016-12-16 18:01:46,763 INFO hooks.ATSHook (ATSHook.java:(84)) - Created ATS Hook 2016-12-16 18:01:46,763 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 18:01:46,763 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 18:01:46,763 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 18:01:46,763 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 18:01:46,763 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 18:01:46,764 INFO ql.Driver (Driver.java:launchTask(1651)) - Starting task [Stage-0:DDL] in serial mode 2016-12-16 18:01:46,764 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(746)) - 1: get_database: bigsql 2016-12-16 18:01:46,764 INFO HiveMetaStore.audit (HiveMetaStore.java:logAuditEvent(371)) - ugi=admin ip=unknown-ip-addr cmd=get_database: bigsql 2016-12-16 18:01:46,771 INFO exec.DDLTask (DDLTask.java:showTables(2265)) - pattern: * 2016-12-16 18:01:46,772 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(746)) - 1: get_tables: db=bigsql pat=* 2016-12-16 18:01:46,772 INFO HiveMetaStore.audit (HiveMetaStore.java:logAuditEvent(371)) - ugi=admin ip=unknown-ip-addr cmd=get_tables: db=bigsql pat=* 2016-12-16 18:01:46,775 INFO exec.DDLTask (DDLTask.java:showTables(2267)) - results : 7 2016-12-16 18:01:46,776 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 18:01:46,776 INFO hooks.ATSHook (ATSHook.java:(84)) - Created ATS Hook 2016-12-16 18:01:46,776 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 18:01:46,776 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 18:01:46,777 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 18:01:46,777 INFO ql.Driver (SessionState.java:printInfo(954)) - OK 2016-12-16 18:01:46,777 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 18:01:46,777 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 18:01:46,777 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 18:01:46,779 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(249)) - Total input paths to process : 1 2016-12-16 18:01:55,246 INFO thrift.ThriftCLIService (ThriftCLIService.java:OpenSession(294)) - Client protocol version: HIVE_CLI_SERVICE_PROTOCOL_V6 2016-12-16 18:01:55,249 INFO metastore.ObjectStore (ObjectStore.java:initialize(289)) - ObjectStore, initialize called 2016-12-16 18:01:55,254 INFO metastore.MetaStoreDirectSql (MetaStoreDirectSql.java:(141)) - Using direct SQL, underlying DB is MYSQL 2016-12-16 18:01:55,254 INFO metastore.ObjectStore (ObjectStore.java:setConf(272)) - Initialized ObjectStore 2016-12-16 18:01:55,262 INFO session.SessionState (SessionState.java:createPath(641)) - Created local directory: /tmp/7038f703-c763-4dd5-a740-66aa82431596_resources 2016-12-16 18:01:55,266 INFO session.SessionState (SessionState.java:createPath(641)) - Created HDFS directory: /tmp/hive/admin/7038f703-c763-4dd5-a740-66aa82431596 2016-12-16 18:01:55,268 INFO session.SessionState (SessionState.java:createPath(641)) - Created local directory: /tmp/hive/7038f703-c763-4dd5-a740-66aa82431596 2016-12-16 18:01:55,271 INFO session.SessionState (SessionState.java:createPath(641)) - Created HDFS directory: /tmp/hive/admin/7038f703-c763-4dd5-a740-66aa82431596/_tmp_space.db 2016-12-16 18:01:55,272 INFO session.HiveSessionImpl (HiveSessionImpl.java:setOperationLogSessionDir(236)) - Operation log session directory is created: /tmp/hive/operation_logs/7038f703-c763-4dd5-a740-66aa82431596 2016-12-16 18:01:55,274 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 18:01:55,275 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 18:01:55,275 INFO parse.ParseDriver (ParseDriver.java:parse(185)) - Parsing command: use bigsql 2016-12-16 18:01:55,275 INFO parse.ParseDriver (ParseDriver.java:parse(209)) - Parse Completed 2016-12-16 18:01:55,275 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 18:01:55,276 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 18:01:55,276 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(746)) - 1: get_database: bigsql 2016-12-16 18:01:55,276 INFO HiveMetaStore.audit (HiveMetaStore.java:logAuditEvent(371)) - ugi=admin ip=unknown-ip-addr cmd=get_database: bigsql 2016-12-16 18:01:55,283 INFO ql.Driver (Driver.java:compile(436)) - Semantic Analysis Completed 2016-12-16 18:01:55,283 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 18:01:55,284 INFO ql.Driver (Driver.java:getSchema(240)) - Returning Hive schema: Schema(fieldSchemas:null, properties:null) 2016-12-16 18:01:55,284 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 18:01:55,284 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 18:01:55,284 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 18:01:55,284 INFO ql.Driver (Driver.java:checkConcurrency(160)) - Concurrency mode is disabled, not creating a lock manager 2016-12-16 18:01:55,284 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 18:01:55,284 INFO ql.Driver (Driver.java:execute(1328)) - Starting command(queryId=hive_20161216180155_e9fdef2f-d108-4b00-a986-5d96f97b9f79): use bigsql 2016-12-16 18:01:55,285 INFO hooks.ATSHook (ATSHook.java:(84)) - Created ATS Hook 2016-12-16 18:01:55,285 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 18:01:55,285 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 18:01:55,285 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 18:01:55,285 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 18:01:55,286 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 18:01:55,286 INFO ql.Driver (Driver.java:launchTask(1651)) - Starting task [Stage-0:DDL] in serial mode 2016-12-16 18:01:55,286 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(746)) - 1: get_database: bigsql 2016-12-16 18:01:55,286 INFO HiveMetaStore.audit (HiveMetaStore.java:logAuditEvent(371)) - ugi=admin ip=unknown-ip-addr cmd=get_database: bigsql 2016-12-16 18:01:55,293 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(746)) - 1: get_database: bigsql 2016-12-16 18:01:55,293 INFO HiveMetaStore.audit (HiveMetaStore.java:logAuditEvent(371)) - ugi=admin ip=unknown-ip-addr cmd=get_database: bigsql 2016-12-16 18:01:55,299 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 18:01:55,299 INFO hooks.ATSHook (ATSHook.java:(84)) - Created ATS Hook 2016-12-16 18:01:55,299 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 18:01:55,300 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 18:01:55,300 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 18:01:55,300 INFO ql.Driver (SessionState.java:printInfo(954)) - OK 2016-12-16 18:01:55,300 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 18:01:55,300 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 18:01:55,300 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 18:01:55,306 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 18:01:55,307 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 18:01:55,307 INFO parse.ParseDriver (ParseDriver.java:parse(185)) - Parsing command: show databases 2016-12-16 18:01:55,307 INFO parse.ParseDriver (ParseDriver.java:parse(209)) - Parse Completed 2016-12-16 18:01:55,307 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 18:01:55,307 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 18:01:55,308 INFO ql.Driver (Driver.java:compile(436)) - Semantic Analysis Completed 2016-12-16 18:01:55,308 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 18:01:55,310 INFO exec.ListSinkOperator (Operator.java:initialize(332)) - Initializing operator OP[19] 2016-12-16 18:01:55,310 INFO exec.ListSinkOperator (Operator.java:initialize(372)) - Initialization Done 19 OP 2016-12-16 18:01:55,310 INFO exec.ListSinkOperator (Operator.java:initializeChildren(429)) - Operator 19 OP initialized 2016-12-16 18:01:55,310 INFO ql.Driver (Driver.java:getSchema(240)) - Returning Hive schema: Schema(fieldSchemas:[FieldSchema(name:database_name, type:string, comment:from deserializer)], properties:null) 2016-12-16 18:01:55,310 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 18:01:55,311 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 18:01:55,312 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 18:01:55,312 INFO ql.Driver (Driver.java:checkConcurrency(160)) - Concurrency mode is disabled, not creating a lock manager 2016-12-16 18:01:55,312 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 18:01:55,312 INFO ql.Driver (Driver.java:execute(1328)) - Starting command(queryId=hive_20161216180155_13ce1654-a1e0-47a9-884d-46d695c8e99b): show databases 2016-12-16 18:01:55,312 INFO hooks.ATSHook (ATSHook.java:(84)) - Created ATS Hook 2016-12-16 18:01:55,312 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 18:01:55,313 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 18:01:55,313 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 18:01:55,313 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 18:01:55,313 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 18:01:55,314 INFO ql.Driver (Driver.java:launchTask(1651)) - Starting task [Stage-0:DDL] in serial mode 2016-12-16 18:01:55,314 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(746)) - 3: get_all_databases 2016-12-16 18:01:55,315 INFO HiveMetaStore.audit (HiveMetaStore.java:logAuditEvent(371)) - ugi=admin ip=unknown-ip-addr cmd=get_all_databases 2016-12-16 18:01:55,315 INFO metastore.HiveMetaStore (HiveMetaStore.java:newRawStore(589)) - 3: Opening raw store with implemenation class:org.apache.hadoop.hive.metastore.ObjectStore 2016-12-16 18:01:55,316 INFO metastore.ObjectStore (ObjectStore.java:initialize(289)) - ObjectStore, initialize called 2016-12-16 18:01:55,321 INFO metastore.MetaStoreDirectSql (MetaStoreDirectSql.java:(141)) - Using direct SQL, underlying DB is MYSQL 2016-12-16 18:01:55,322 INFO metastore.ObjectStore (ObjectStore.java:setConf(272)) - Initialized ObjectStore 2016-12-16 18:01:55,324 INFO exec.DDLTask (DDLTask.java:showDatabases(2225)) - results : 3 2016-12-16 18:01:55,325 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 18:01:55,325 INFO hooks.ATSHook (ATSHook.java:(84)) - Created ATS Hook 2016-12-16 18:01:55,326 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 18:01:55,326 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 18:01:55,326 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 18:01:55,327 INFO ql.Driver (SessionState.java:printInfo(954)) - OK 2016-12-16 18:01:55,327 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 18:01:55,327 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 18:01:55,327 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 18:01:56,084 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(249)) - Total input paths to process : 1 2016-12-16 18:02:27,047 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 18:02:27,048 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 18:02:27,048 INFO parse.ParseDriver (ParseDriver.java:parse(185)) - Parsing command: use bigsql 2016-12-16 18:02:27,049 INFO parse.ParseDriver (ParseDriver.java:parse(209)) - Parse Completed 2016-12-16 18:02:27,049 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 18:02:27,049 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 18:02:27,050 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(746)) - 1: get_database: bigsql 2016-12-16 18:02:27,050 INFO HiveMetaStore.audit (HiveMetaStore.java:logAuditEvent(371)) - ugi=admin ip=unknown-ip-addr cmd=get_database: bigsql 2016-12-16 18:02:27,059 INFO ql.Driver (Driver.java:compile(436)) - Semantic Analysis Completed 2016-12-16 18:02:27,059 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 18:02:27,060 INFO ql.Driver (Driver.java:getSchema(240)) - Returning Hive schema: Schema(fieldSchemas:null, properties:null) 2016-12-16 18:02:27,060 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 18:02:27,060 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 18:02:27,060 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 18:02:27,060 INFO ql.Driver (Driver.java:checkConcurrency(160)) - Concurrency mode is disabled, not creating a lock manager 2016-12-16 18:02:27,060 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 18:02:27,060 INFO ql.Driver (Driver.java:execute(1328)) - Starting command(queryId=hive_20161216180227_eab44b5d-3893-49ca-85b8-0a6c9e5fe9c4): use bigsql 2016-12-16 18:02:27,061 INFO hooks.ATSHook (ATSHook.java:(84)) - Created ATS Hook 2016-12-16 18:02:27,061 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 18:02:27,061 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 18:02:27,061 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 18:02:27,061 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 18:02:27,062 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 18:02:27,062 INFO ql.Driver (Driver.java:launchTask(1651)) - Starting task [Stage-0:DDL] in serial mode 2016-12-16 18:02:27,062 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(746)) - 1: get_database: bigsql 2016-12-16 18:02:27,062 INFO HiveMetaStore.audit (HiveMetaStore.java:logAuditEvent(371)) - ugi=admin ip=unknown-ip-addr cmd=get_database: bigsql 2016-12-16 18:02:27,069 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(746)) - 1: get_database: bigsql 2016-12-16 18:02:27,069 INFO HiveMetaStore.audit (HiveMetaStore.java:logAuditEvent(371)) - ugi=admin ip=unknown-ip-addr cmd=get_database: bigsql 2016-12-16 18:02:27,075 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 18:02:27,076 INFO hooks.ATSHook (ATSHook.java:(84)) - Created ATS Hook 2016-12-16 18:02:27,076 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 18:02:27,076 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 18:02:27,076 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 18:02:27,077 INFO ql.Driver (SessionState.java:printInfo(954)) - OK 2016-12-16 18:02:27,077 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 18:02:27,077 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 18:02:27,077 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 18:02:27,083 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 18:02:27,083 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 18:02:27,083 INFO parse.ParseDriver (ParseDriver.java:parse(185)) - Parsing command: insert into drivers(driverid,name,ssn,location,certified,wageplan) values(1,'test',234555,'test','test','test') 2016-12-16 18:02:27,084 INFO parse.ParseDriver (ParseDriver.java:parse(209)) - Parse Completed 2016-12-16 18:02:27,085 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 18:02:27,085 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 18:02:27,085 INFO parse.CalcitePlanner (SemanticAnalyzer.java:analyzeInternal(10127)) - Starting Semantic Analysis 2016-12-16 18:02:27,085 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(746)) - 1: get_table : db=bigsql tbl=drivers 2016-12-16 18:02:27,086 INFO HiveMetaStore.audit (HiveMetaStore.java:logAuditEvent(371)) - ugi=admin ip=unknown-ip-addr cmd=get_table : db=bigsql tbl=drivers 2016-12-16 18:02:27,111 ERROR hdfs.KeyProviderCache (KeyProviderCache.java:createKeyProviderURI(87)) - Could not find uri with key [dfs.encryption.key.provider.uri] to create a keyProvider !! 2016-12-16 18:02:27,131 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(746)) - 1: get_table : db=bigsql tbl=drivers 2016-12-16 18:02:27,131 INFO HiveMetaStore.audit (HiveMetaStore.java:logAuditEvent(371)) - ugi=admin ip=unknown-ip-addr cmd=get_table : db=bigsql tbl=drivers 2016-12-16 18:02:27,151 INFO parse.CalcitePlanner (SemanticAnalyzer.java:genResolvedParseTree(10074)) - Completed phase 1 of Semantic Analysis 2016-12-16 18:02:27,152 INFO parse.CalcitePlanner (SemanticAnalyzer.java:getMetaData(1552)) - Get metadata for source tables 2016-12-16 18:02:27,152 INFO parse.CalcitePlanner (SemanticAnalyzer.java:getMetaData(1704)) - Get metadata for subqueries 2016-12-16 18:02:27,152 INFO parse.CalcitePlanner (SemanticAnalyzer.java:getMetaData(1728)) - Get metadata for destination tables 2016-12-16 18:02:27,152 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(746)) - 1: get_table : db=bigsql tbl=drivers 2016-12-16 18:02:27,153 INFO HiveMetaStore.audit (HiveMetaStore.java:logAuditEvent(371)) - ugi=admin ip=unknown-ip-addr cmd=get_table : db=bigsql tbl=drivers 2016-12-16 18:02:27,173 INFO parse.CalcitePlanner (SemanticAnalyzer.java:genResolvedParseTree(10078)) - Completed getting MetaData in Semantic Analysis 2016-12-16 18:02:27,174 INFO parse.BaseSemanticAnalyzer (CalcitePlanner.java:canCBOHandleAst(388)) - Not invoking CBO because the statement has too few joins 2016-12-16 18:02:27,175 INFO common.FileUtils (FileUtils.java:mkdir(501)) - Creating directory if it doesn't exist: hdfs://ibm-biginsight.com:8020/apps/hive/warehouse/bigsql.db/drivers/.hive-staging_hive_2016-12-16_18-02-27_083_6843004283042453873-1 2016-12-16 18:02:27,194 INFO parse.CalcitePlanner (SemanticAnalyzer.java:genFileSinkPlan(6653)) - Set stats collection dir : hdfs://ibm-biginsight.com:8020/apps/hive/warehouse/bigsql.db/drivers/.hive-staging_hive_2016-12-16_18-02-27_083_6843004283042453873-1/-ext-10001 2016-12-16 18:02:27,197 INFO ppd.OpProcFactory (OpProcFactory.java:process(655)) - Processing for FS(23) 2016-12-16 18:02:27,198 INFO ppd.OpProcFactory (OpProcFactory.java:process(655)) - Processing for SEL(22) 2016-12-16 18:02:27,198 INFO ppd.OpProcFactory (OpProcFactory.java:process(655)) - Processing for SEL(21) 2016-12-16 18:02:27,198 INFO ppd.OpProcFactory (OpProcFactory.java:process(382)) - Processing for TS(20) 2016-12-16 18:02:27,201 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 18:02:27,201 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 18:02:27,202 INFO optimizer.GenMRFileSink1 (GenMRFileSink1.java:process(103)) - using CombineHiveInputformat for the merge job 2016-12-16 18:02:27,203 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(746)) - 1: get_indexes : db=bigsql tbl=values__tmp__table__1 2016-12-16 18:02:27,203 INFO HiveMetaStore.audit (HiveMetaStore.java:logAuditEvent(371)) - ugi=admin ip=unknown-ip-addr cmd=get_indexes : db=bigsql tbl=values__tmp__table__1 2016-12-16 18:02:27,206 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(746)) - 1: get_indexes : db=bigsql tbl=values__tmp__table__1 2016-12-16 18:02:27,206 INFO HiveMetaStore.audit (HiveMetaStore.java:logAuditEvent(371)) - ugi=admin ip=unknown-ip-addr cmd=get_indexes : db=bigsql tbl=values__tmp__table__1 2016-12-16 18:02:27,209 INFO physical.NullScanTaskDispatcher (NullScanTaskDispatcher.java:dispatch(175)) - Looking for table scans where optimization is applicable 2016-12-16 18:02:27,209 INFO physical.NullScanTaskDispatcher (NullScanTaskDispatcher.java:dispatch(199)) - Found 0 null table scans 2016-12-16 18:02:27,209 INFO physical.NullScanTaskDispatcher (NullScanTaskDispatcher.java:dispatch(175)) - Looking for table scans where optimization is applicable 2016-12-16 18:02:27,209 INFO physical.NullScanTaskDispatcher (NullScanTaskDispatcher.java:dispatch(199)) - Found 0 null table scans 2016-12-16 18:02:27,210 INFO physical.NullScanTaskDispatcher (NullScanTaskDispatcher.java:dispatch(175)) - Looking for table scans where optimization is applicable 2016-12-16 18:02:27,210 INFO physical.NullScanTaskDispatcher (NullScanTaskDispatcher.java:dispatch(199)) - Found 0 null table scans 2016-12-16 18:02:27,210 INFO physical.Vectorizer (Vectorizer.java:validateMapWork(369)) - Validating MapWork... 2016-12-16 18:02:27,211 INFO physical.Vectorizer (Vectorizer.java:validateMapWork(397)) - Input format: org.apache.hadoop.mapred.TextInputFormat, doesn't provide vectorized input 2016-12-16 18:02:27,211 INFO parse.CalcitePlanner (SemanticAnalyzer.java:analyzeInternal(10213)) - Completed plan generation 2016-12-16 18:02:27,211 INFO ql.Driver (Driver.java:compile(436)) - Semantic Analysis Completed 2016-12-16 18:02:27,211 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 18:02:27,211 INFO ql.Driver (Driver.java:getSchema(240)) - Returning Hive schema: Schema(fieldSchemas:[FieldSchema(name:_col0, type:int, comment:null), FieldSchema(name:_col1, type:string, comment:null), FieldSchema(name:_col2, type:bigint, comment:null), FieldSchema(name:_col3, type:string, comment:null), FieldSchema(name:_col4, type:string, comment:null), FieldSchema(name:_col5, type:string, comment:null)], properties:null) 2016-12-16 18:02:27,212 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 18:02:27,213 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 18:02:27,213 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 18:02:27,213 INFO ql.Driver (Driver.java:checkConcurrency(160)) - Concurrency mode is disabled, not creating a lock manager 2016-12-16 18:02:27,213 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 18:02:27,214 INFO ql.Driver (Driver.java:execute(1328)) - Starting command(queryId=hive_20161216180227_4eeef714-2ccf-41ec-8f04-c9ae17ab728e): insert into drivers(driverid,name,ssn,location,certified,wageplan) values(1,'test',234555,'test','test','test') 2016-12-16 18:02:27,214 INFO hooks.ATSHook (ATSHook.java:(84)) - Created ATS Hook 2016-12-16 18:02:27,214 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 18:02:27,214 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 18:02:27,215 INFO ql.Driver (SessionState.java:printInfo(954)) - Query ID = hive_20161216180227_4eeef714-2ccf-41ec-8f04-c9ae17ab728e 2016-12-16 18:02:27,215 INFO ql.Driver (SessionState.java:printInfo(954)) - Total jobs = 3 2016-12-16 18:02:27,215 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 18:02:27,215 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 18:02:27,215 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 18:02:27,215 INFO ql.Driver (SessionState.java:printInfo(954)) - Launching Job 1 out of 3 2016-12-16 18:02:27,217 INFO ql.Driver (Driver.java:launchTask(1651)) - Starting task [Stage-1:MAPRED] in serial mode 2016-12-16 18:02:27,217 INFO exec.Task (SessionState.java:printInfo(954)) - Number of reduce tasks is set to 0 since there's no reduce operator 2016-12-16 18:02:27,222 INFO ql.Context (Context.java:getMRScratchDir(330)) - New scratch dir is hdfs://ibm-biginsight.com:8020/tmp/hive/admin/7038f703-c763-4dd5-a740-66aa82431596/hive_2016-12-16_18-02-27_083_6843004283042453873-3 2016-12-16 18:02:27,228 INFO mr.ExecDriver (ExecDriver.java:execute(288)) - Using org.apache.hadoop.hive.ql.io.CombineHiveInputFormat 2016-12-16 18:02:27,229 INFO mr.ExecDriver (ExecDriver.java:execute(310)) - adding libjars: file:///usr/iop/current/hbase-client/lib/hbase-client.jar,file:///usr/iop/current/hbase-client/lib/hbase-common.jar,file:///usr/iop/current/hbase-client/lib/hbase-hadoop2-compat.jar,file:///usr/iop/current/hbase-client/lib/hbase-prefix-tree.jar,file:///usr/iop/current/hbase-client/lib/hbase-protocol.jar,file:///usr/iop/current/hbase-client/lib/hbase-server.jar,file:///usr/iop/current/hbase-client/lib/htrace-core-3.1.0-incubating.jar,file:///usr/iop/current/hive-webhcat/share/hcatalog 2016-12-16 18:02:27,229 INFO exec.Utilities (Utilities.java:getInputPaths(3398)) - Processing alias values__tmp__table__1 2016-12-16 18:02:27,229 INFO exec.Utilities (Utilities.java:getInputPaths(3415)) - Adding input file hdfs://ibm-biginsight.com:8020/tmp/hive/admin/7038f703-c763-4dd5-a740-66aa82431596/_tmp_space.db/Values__Tmp__Table__1 2016-12-16 18:02:27,229 INFO exec.Utilities (Utilities.java:isEmptyPath(2699)) - Content Summary not cached for hdfs://ibm-biginsight.com:8020/tmp/hive/admin/7038f703-c763-4dd5-a740-66aa82431596/_tmp_space.db/Values__Tmp__Table__1 2016-12-16 18:02:27,231 INFO hooks.ATSHook (ATSHook.java:createPreHookEvent(149)) - Received pre-hook notification for :hive_20161216180227_4eeef714-2ccf-41ec-8f04-c9ae17ab728e 2016-12-16 18:02:27,233 INFO ql.Context (Context.java:getMRScratchDir(330)) - New scratch dir is hdfs://ibm-biginsight.com:8020/tmp/hive/admin/7038f703-c763-4dd5-a740-66aa82431596/hive_2016-12-16_18-02-27_083_6843004283042453873-3 2016-12-16 18:02:27,240 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 18:02:27,240 INFO exec.Utilities (Utilities.java:serializePlan(939)) - Serializing MapWork via kryo 2016-12-16 18:02:27,268 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 18:02:27,271 ERROR mr.ExecDriver (ExecDriver.java:execute(400)) - yarn 2016-12-16 18:02:27,417 INFO impl.TimelineClientImpl (TimelineClientImpl.java:serviceInit(296)) - Timeline service address: http://ibm-biginsight.com:8188/ws/v1/timeline/ 2016-12-16 18:02:27,418 INFO client.RMProxy (RMProxy.java:createRMProxy(98)) - Connecting to ResourceManager at ibm-biginsight.com/10.10.15.15:8050 2016-12-16 18:02:27,428 INFO fs.FSStatsPublisher (FSStatsPublisher.java:init(49)) - created : hdfs://ibm-biginsight.com:8020/apps/hive/warehouse/bigsql.db/drivers/.hive-staging_hive_2016-12-16_18-02-27_083_6843004283042453873-1/-ext-10001 2016-12-16 18:02:27,571 INFO impl.TimelineClientImpl (TimelineClientImpl.java:serviceInit(296)) - Timeline service address: http://ibm-biginsight.com:8188/ws/v1/timeline/ 2016-12-16 18:02:27,572 INFO client.RMProxy (RMProxy.java:createRMProxy(98)) - Connecting to ResourceManager at ibm-biginsight.com/10.10.15.15:8050 2016-12-16 18:02:27,573 INFO exec.Utilities (Utilities.java:getBaseWork(391)) - PLAN PATH = hdfs://ibm-biginsight.com:8020/tmp/hive/admin/7038f703-c763-4dd5-a740-66aa82431596/hive_2016-12-16_18-02-27_083_6843004283042453873-3/-mr-10004/86fcf3c6-5a9f-48cd-bc02-f30e4a7c65a8/map.xml 2016-12-16 18:02:27,574 INFO exec.Utilities (Utilities.java:getBaseWork(391)) - PLAN PATH = hdfs://ibm-biginsight.com:8020/tmp/hive/admin/7038f703-c763-4dd5-a740-66aa82431596/hive_2016-12-16_18-02-27_083_6843004283042453873-3/-mr-10004/86fcf3c6-5a9f-48cd-bc02-f30e4a7c65a8/reduce.xml 2016-12-16 18:02:27,574 INFO exec.Utilities (Utilities.java:getBaseWork(401)) - ***************non-local mode*************** 2016-12-16 18:02:27,574 INFO exec.Utilities (Utilities.java:getBaseWork(405)) - local path = hdfs://ibm-biginsight.com:8020/tmp/hive/admin/7038f703-c763-4dd5-a740-66aa82431596/hive_2016-12-16_18-02-27_083_6843004283042453873-3/-mr-10004/86fcf3c6-5a9f-48cd-bc02-f30e4a7c65a8/reduce.xml 2016-12-16 18:02:27,574 INFO exec.Utilities (Utilities.java:getBaseWork(417)) - Open file to read in plan: hdfs://ibm-biginsight.com:8020/tmp/hive/admin/7038f703-c763-4dd5-a740-66aa82431596/hive_2016-12-16_18-02-27_083_6843004283042453873-3/-mr-10004/86fcf3c6-5a9f-48cd-bc02-f30e4a7c65a8/reduce.xml 2016-12-16 18:02:27,577 INFO exec.Utilities (Utilities.java:getBaseWork(457)) - File not found: File does not exist: /tmp/hive/admin/7038f703-c763-4dd5-a740-66aa82431596/hive_2016-12-16_18-02-27_083_6843004283042453873-3/-mr-10004/86fcf3c6-5a9f-48cd-bc02-f30e4a7c65a8/reduce.xml at org.apache.hadoop.hdfs.server.namenode.INodeFile.valueOf(INodeFile.java:71) at org.apache.hadoop.hdfs.server.namenode.INodeFile.valueOf(INodeFile.java:61) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getBlockLocationsInt(FSNamesystem.java:1815) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getBlockLocations(FSNamesystem.java:1786) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getBlockLocations(FSNamesystem.java:1699) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getBlockLocations(NameNodeRpcServer.java:587) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getBlockLocations(ClientNamenodeProtocolServerSideTranslatorPB.java:365) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:616) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:969) at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2049) at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2045) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:415) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2043) 2016-12-16 18:02:27,577 INFO exec.Utilities (Utilities.java:getBaseWork(458)) - No plan file found: hdfs://ibm-biginsight.com:8020/tmp/hive/admin/7038f703-c763-4dd5-a740-66aa82431596/hive_2016-12-16_18-02-27_083_6843004283042453873-3/-mr-10004/86fcf3c6-5a9f-48cd-bc02-f30e4a7c65a8/reduce.xml 2016-12-16 18:02:27,606 WARN mapreduce.JobResourceUploader (JobResourceUploader.java:uploadFiles(64)) - Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this. 2016-12-16 18:02:27,994 INFO log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-12-16 18:02:27,994 INFO exec.Utilities (Utilities.java:getBaseWork(391)) - PLAN PATH = hdfs://ibm-biginsight.com:8020/tmp/hive/admin/7038f703-c763-4dd5-a740-66aa82431596/hive_2016-12-16_18-02-27_083_6843004283042453873-3/-mr-10004/86fcf3c6-5a9f-48cd-bc02-f30e4a7c65a8/map.xml 2016-12-16 18:02:27,994 INFO io.CombineHiveInputFormat (CombineHiveInputFormat.java:getSplits(517)) - Total number of paths: 1, launching 1 threads to check non-combinable ones. 2016-12-16 18:02:27,998 INFO io.CombineHiveInputFormat (CombineHiveInputFormat.java:getCombineSplits(439)) - CombineHiveInputSplit creating pool for hdfs://ibm-biginsight.com:8020/tmp/hive/admin/7038f703-c763-4dd5-a740-66aa82431596/_tmp_space.db/Values__Tmp__Table__1; using filter path hdfs://ibm-biginsight.com:8020/tmp/hive/admin/7038f703-c763-4dd5-a740-66aa82431596/_tmp_space.db/Values__Tmp__Table__1 2016-12-16 18:02:28,002 INFO input.FileInputFormat (FileInputFormat.java:listStatus(283)) - Total input paths to process : 1 2016-12-16 18:02:28,003 INFO input.CombineFileInputFormat (CombineFileInputFormat.java:createSplits(413)) - DEBUG: Terminated node allocation with : CompletedNodes: 1, size left: 0 2016-12-16 18:02:28,003 INFO io.CombineHiveInputFormat (CombineHiveInputFormat.java:getCombineSplits(494)) - number of splits 1 2016-12-16 18:02:28,004 INFO io.CombineHiveInputFormat (CombineHiveInputFormat.java:getSplits(587)) - Number of all splits 1 2016-12-16 18:02:28,004 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-12-16 18:02:28,034 INFO mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(198)) - number of splits:1 2016-12-16 18:02:28,145 INFO mapreduce.JobSubmitter (JobSubmitter.java:printTokens(287)) - Submitting tokens for job: job_1481879398879_0001 2016-12-16 18:02:28,701 INFO impl.YarnClientImpl (YarnClientImpl.java:submitApplication(273)) - Submitted application application_1481879398879_0001 2016-12-16 18:02:28,746 INFO mapreduce.Job (Job.java:submit(1294)) - The url to track the job: http://ibm-biginsight.com:8088/proxy/application_1481879398879_0001/ 2016-12-16 18:02:28,748 INFO exec.Task (SessionState.java:printInfo(954)) - Starting Job = job_1481879398879_0001, Tracking URL = http://ibm-biginsight.com:8088/proxy/application_1481879398879_0001/ 2016-12-16 18:02:28,748 INFO exec.Task (SessionState.java:printInfo(954)) - Kill Command = /usr/iop/4.1.0.0/hadoop/bin/hadoop job -kill job_1481879398879_0001 2016-12-16 18:02:36,332 INFO thrift.ThriftCLIService (ThriftCLIService.java:OpenSession(294)) - Client protocol version: HIVE_CLI_SERVICE_PROTOCOL_V8 2016-12-16 18:02:36,346 INFO session.SessionState (SessionState.java:createPath(641)) - Created local directory: /tmp/9c958238-1d81-46a6-b732-221319edcb17_resources 2016-12-16 18:02:36,351 INFO session.SessionState (SessionState.java:createPath(641)) - Created HDFS directory: /tmp/hive/anonymous/9c958238-1d81-46a6-b732-221319edcb17 2016-12-16 18:02:36,353 INFO session.SessionState (SessionState.java:createPath(641)) - Created local directory: /tmp/hive/9c958238-1d81-46a6-b732-221319edcb17 2016-12-16 18:02:36,358 INFO session.SessionState (SessionState.java:createPath(641)) - Created HDFS directory: /tmp/hive/anonymous/9c958238-1d81-46a6-b732-221319edcb17/_tmp_space.db 2016-12-16 18:02:36,360 INFO session.HiveSessionImpl (HiveSessionImpl.java:setOperationLogSessionDir(236)) - Operation log session directory is created: /tmp/hive/operation_logs/9c958238-1d81-46a6-b732-221319edcb17 2016-12-16 18:03:36,245 INFO thrift.ThriftCLIService (ThriftCLIService.java:OpenSession(294)) - Client protocol version: HIVE_CLI_SERVICE_PROTOCOL_V8 2016-12-16 18:03:36,255 INFO session.SessionState (SessionState.java:createPath(641)) - Created local directory: /tmp/27779acb-a42f-4710-adb7-e9da8e277720_resources 2016-12-16 18:03:36,258 INFO session.SessionState (SessionState.java:createPath(641)) - Created HDFS directory: /tmp/hive/anonymous/27779acb-a42f-4710-adb7-e9da8e277720 2016-12-16 18:03:36,260 INFO session.SessionState (SessionState.java:createPath(641)) - Created local directory: /tmp/hive/27779acb-a42f-4710-adb7-e9da8e277720 2016-12-16 18:03:36,263 INFO session.SessionState (SessionState.java:createPath(641)) - Created HDFS directory: /tmp/hive/anonymous/27779acb-a42f-4710-adb7-e9da8e277720/_tmp_space.db 2016-12-16 18:03:36,265 INFO session.HiveSessionImpl (HiveSessionImpl.java:setOperationLogSessionDir(236)) - Operation log session directory is created: /tmp/hive/operation_logs/27779acb-a42f-4710-adb7-e9da8e277720 2016-12-16 18:04:36,225 INFO thrift.ThriftCLIService (ThriftCLIService.java:OpenSession(294)) - Client protocol version: HIVE_CLI_SERVICE_PROTOCOL_V8 2016-12-16 18:04:36,237 INFO session.SessionState (SessionState.java:createPath(641)) - Created local directory: /tmp/ab7caba7-e34e-40b5-ab08-e98fe886c629_resources 2016-12-16 18:04:36,249 INFO session.SessionState (SessionState.java:createPath(641)) - Created HDFS directory: /tmp/hive/anonymous/ab7caba7-e34e-40b5-ab08-e98fe886c629 2016-12-16 18:04:36,252 INFO session.SessionState (SessionState.java:createPath(641)) - Created local directory: /tmp/hive/ab7caba7-e34e-40b5-ab08-e98fe886c629 2016-12-16 18:04:36,258 INFO session.SessionState (SessionState.java:createPath(641)) - Created HDFS directory: /tmp/hive/anonymous/ab7caba7-e34e-40b5-ab08-e98fe886c629/_tmp_space.db 2016-12-16 18:04:36,260 INFO session.HiveSessionImpl (HiveSessionImpl.java:setOperationLogSessionDir(236)) - Operation log session directory is created: /tmp/hive/operation_logs/ab7caba7-e34e-40b5-ab08-e98fe886c629