​Hiveserver2 does not start after installing HDP 2.6.4.0-91 using cloudbreak on AWS

[#1]

Hiveserver2 does not start after installing HDP 2.6.4.0-91 using cloudbreak on AWS

Start the hiveserver2 in the Ambari UI and check the contents of /var/log/hive/hiveserver2.log.

Ask for help with the solution.

--------------------------------------------
Contents of hiveserver2.log


2018-03-08 04:41:32,917 INFO [main]: server.HiveServer2 (HiveServer2.java:startHiveServer2(463)) - Starting HiveServer2
2018-03-08 04:41:33,801 INFO [main]: metastore.HiveMetaStore (HiveMetaStore.java:newRawStoreForConf(619)) - 0: Opening raw store with implementation class:org.apache.hadoop.hive.metastore.ObjectStore
2018-03-08 04:41:33,838 INFO [main]: metastore.ObjectStore (ObjectStore.java:initializeHelper(383)) - ObjectStore, initialize called
2018-03-08 04:41:34,866 INFO [main]: metastore.ObjectStore (ObjectStore.java:getPMF(500)) - Setting MetaStore object pin classes with hive.metastore.cache.pinobjtypes="Table,Database,Type,FieldSchema,Order"
2018-03-08 04:41:36,567 INFO [main]: metastore.MetaStoreDirectSql (MetaStoreDirectSql.java:<init>(163)) - Using direct SQL, underlying DB is OTHER
2018-03-08 04:41:36,569 INFO [main]: metastore.ObjectStore (ObjectStore.java:setConf(297)) - Initialized ObjectStore
2018-03-08 04:41:36,649 INFO [main]: metastore.HiveMetaStore (HiveMetaStore.java:createDefaultRoles_core(690)) - Added admin role in metastore
2018-03-08 04:41:36,652 INFO [main]: metastore.HiveMetaStore (HiveMetaStore.java:createDefaultRoles_core(699)) - Added public role in metastore
2018-03-08 04:41:36,665 INFO [main]: metastore.HiveMetaStore (HiveMetaStore.java:addAdminUsers_core(739)) - No user is added in admin role, since config is empty
2018-03-08 04:41:36,726 INFO [main]: impl.MetricsConfig (MetricsConfig.java:loadFirst(112)) - loaded properties from hadoop-metrics2-hiveserver2.properties
2018-03-08 04:41:36,939 INFO [main]: timeline.HadoopTimelineMetricsSink (HadoopTimelineMetricsSink.java:init(82)) - Initializing Timeline metrics sink.
2018-03-08 04:41:36,940 INFO [main]: timeline.HadoopTimelineMetricsSink (HadoopTimelineMetricsSink.java:init(102)) - Identified hostname = ip-10-0-91-7.ap-northeast-2.compute.internal, serviceName = hiveserver2
2018-03-08 04:41:37,001 INFO [main]: availability.MetricSinkWriteShardHostnameHashingStrategy (MetricSinkWriteShardHostnameHashingStrategy.java:findCollectorShard(42)) - Calculated collector shard ip-10-0-91-7.ap-northeast-2.compute.internal based on hostname: ip-10-0-91-7.ap-northeast-2.compute.internal
2018-03-08 04:41:37,001 INFO [main]: timeline.HadoopTimelineMetricsSink (HadoopTimelineMetricsSink.java:init(125)) - Collector Uri: http://ip-10-0-91-7.ap-northeast-2.compute.internal:6188/ws/v1/timeline/metrics
2018-03-08 04:41:37,002 INFO [main]: timeline.HadoopTimelineMetricsSink (HadoopTimelineMetricsSink.java:init(126)) - Container Metrics Uri: http://ip-10-0-91-7.ap-northeast-2.compute.internal:6188/ws/v1/timeline/containermetrics
2018-03-08 04:41:37,014 INFO [main]: impl.MetricsSinkAdapter (MetricsSinkAdapter.java:start(206)) - Sink timeline started
2018-03-08 04:41:37,030 INFO [main]: impl.MetricsSystemImpl (MetricsSystemImpl.java:startTimer(376)) - Scheduled snapshot period at 10 second(s).
2018-03-08 04:41:37,031 INFO [main]: impl.MetricsSystemImpl (MetricsSystemImpl.java:start(192)) - hiveserver2 metrics system started
2018-03-08 04:41:37,036 INFO [main]: metastore.HiveMetaStore (HiveMetaStore.java:init(453)) - Begin calculating metadata count metrics.
2018-03-08 04:41:37,054 INFO [main]: metastore.HiveMetaStore (HiveMetaStore.java:init(455)) - Finished metadata count metrics: 1 databases, 0 tables, 0 partitions.
2018-03-08 04:41:37,167 INFO [main]: metastore.HiveMetaStore (HiveMetaStore.java:logInfo(773)) - 0: get_all_functions
2018-03-08 04:41:37,169 INFO [main]: HiveMetaStore.audit (HiveMetaStore.java:logAuditEvent(317)) - ugi=hive ip=unknown-ip-addr cmd=get_all_functions 
2018-03-08 04:41:38,098 INFO [main]: session.SessionState (SessionState.java:createPath(699)) - Created local directory: /tmp/ce5ae258-8d50-47a4-9f2e-6c88ba231c92_resources
2018-03-08 04:41:38,106 INFO [main]: session.SessionState (SessionState.java:createPath(699)) - Created HDFS directory: /tmp/hive/hive/ce5ae258-8d50-47a4-9f2e-6c88ba231c92
2018-03-08 04:41:38,108 INFO [main]: session.SessionState (SessionState.java:createPath(699)) - Created local directory: /tmp/hive/ce5ae258-8d50-47a4-9f2e-6c88ba231c92
2018-03-08 04:41:38,111 INFO [main]: session.SessionState (SessionState.java:createPath(699)) - Created HDFS directory: /tmp/hive/hive/ce5ae258-8d50-47a4-9f2e-6c88ba231c92/_tmp_space.db
2018-03-08 04:41:38,128 INFO [main]: sqlstd.SQLStdHiveAccessController (SQLStdHiveAccessController.java:<init>(95)) - Created SQLStdHiveAccessController for session context : HiveAuthzSessionContext [sessionString=ce5ae258-8d50-47a4-9f2e-6c88ba231c92, clientType=HIVESERVER2]
2018-03-08 04:41:38,129 INFO [main]: hive.metastore (HiveMetaStoreClient.java:isCompatibleWith(345)) - Mestastore configuration hive.metastore.filter.hook changed from org.apache.hadoop.hive.metastore.DefaultMetaStoreFilterHookImpl to org.apache.hadoop.hive.ql.security.authorization.plugin.AuthorizationMetaStoreFilterHook
2018-03-08 04:41:38,131 INFO [main]: metastore.HiveMetaStore (HiveMetaStore.java:logInfo(773)) - 0: Shutting down the object store...
2018-03-08 04:41:38,131 INFO [main]: HiveMetaStore.audit (HiveMetaStore.java:logAuditEvent(317)) - ugi=hive ip=unknown-ip-addr cmd=Shutting down the object store... 
2018-03-08 04:41:38,132 INFO [main]: metastore.HiveMetaStore (HiveMetaStore.java:logInfo(773)) - 0: Metastore shutdown complete.
2018-03-08 04:41:38,132 INFO [main]: HiveMetaStore.audit (HiveMetaStore.java:logAuditEvent(317)) - ugi=hive ip=unknown-ip-addr cmd=Metastore shutdown complete. 
2018-03-08 04:41:38,133 INFO [main]: metastore.HiveMetaStore (HiveMetaStore.java:init(453)) - Begin calculating metadata count metrics.
2018-03-08 04:41:38,263 INFO [main]: metastore.HiveMetaStore (HiveMetaStore.java:newRawStoreForConf(619)) - 0: Opening raw store with implementation class:org.apache.hadoop.hive.metastore.ObjectStore
2018-03-08 04:41:38,264 INFO [main]: metastore.ObjectStore (ObjectStore.java:initializeHelper(383)) - ObjectStore, initialize called
2018-03-08 04:41:38,386 INFO [main]: metastore.MetaStoreDirectSql (MetaStoreDirectSql.java:<init>(163)) - Using direct SQL, underlying DB is OTHER
2018-03-08 04:41:38,386 INFO [main]: metastore.ObjectStore (ObjectStore.java:setConf(297)) - Initialized ObjectStore
2018-03-08 04:41:38,390 INFO [main]: metastore.HiveMetaStore (HiveMetaStore.java:init(455)) - Finished metadata count metrics: 1 databases, 0 tables, 0 partitions.
2018-03-08 04:41:38,390 WARN [main]: metrics2.CodahaleMetrics (CodahaleMetrics.java:addGauge(299)) - A Gauge with name [init_total_count_dbs] already exists. The old gauge will be overwritten, but this is not recommended
2018-03-08 04:41:38,390 WARN [main]: metrics2.CodahaleMetrics (CodahaleMetrics.java:addGauge(299)) - A Gauge with name [init_total_count_tables] already exists. The old gauge will be overwritten, but this is not recommended
2018-03-08 04:41:38,391 WARN [main]: metrics2.CodahaleMetrics (CodahaleMetrics.java:addGauge(299)) - A Gauge with name [init_total_count_partitions] already exists. The old gauge will be overwritten, but this is not recommended
2018-03-08 04:41:38,602 INFO [main]: service.CompositeService (SessionManager.java:initOperationLogRootDir(158)) - Operation log root directory is created: /tmp/hive/operation_logs
2018-03-08 04:41:38,609 INFO [main]: service.CompositeService (SessionManager.java:createBackgroundOperationPool(96)) - HiveServer2: Background operation thread pool size: 100
2018-03-08 04:41:38,609 INFO [main]: service.CompositeService (SessionManager.java:createBackgroundOperationPool(98)) - HiveServer2: Background operation thread wait queue size: 100
2018-03-08 04:41:38,609 INFO [main]: service.CompositeService (SessionManager.java:createBackgroundOperationPool(101)) - HiveServer2: Background operation thread keepalive time: 10 seconds
2018-03-08 04:41:38,615 INFO [main]: service.AbstractService (AbstractService.java:init(89)) - Service:OperationManager is inited.
2018-03-08 04:41:38,615 INFO [main]: service.AbstractService (AbstractService.java:init(89)) - Service:SessionManager is inited.
2018-03-08 04:41:38,616 INFO [main]: service.AbstractService (AbstractService.java:init(89)) - Service:CLIService is inited.
2018-03-08 04:41:38,616 INFO [main]: service.AbstractService (AbstractService.java:init(89)) - Service:ThriftHttpCLIService is inited.
2018-03-08 04:41:38,616 INFO [main]: service.AbstractService (AbstractService.java:init(89)) - Service:HiveServer2 is inited.
2018-03-08 04:41:38,617 INFO [main]: service.AbstractService (AbstractService.java:start(104)) - Service:OperationManager is started.
2018-03-08 04:41:38,617 INFO [main]: service.AbstractService (AbstractService.java:start(104)) - Service:SessionManager is started.
2018-03-08 04:41:38,618 INFO [main]: service.AbstractService (AbstractService.java:start(104)) - Service:CLIService is started.
2018-03-08 04:41:38,620 INFO [main]: metastore.ObjectStore (ObjectStore.java:initializeHelper(383)) - ObjectStore, initialize called
2018-03-08 04:41:38,739 WARN [main]: conf.HiveConf (HiveConf.java:initialize(3093)) - HiveConf of name hive.internal.ss.authz.settings.applied.marker does not exist
2018-03-08 04:41:38,745 INFO [main]: metastore.MetaStoreDirectSql (MetaStoreDirectSql.java:<init>(163)) - Using direct SQL, underlying DB is OTHER
2018-03-08 04:41:38,745 INFO [main]: metastore.ObjectStore (ObjectStore.java:setConf(297)) - Initialized ObjectStore
2018-03-08 04:41:38,745 INFO [main]: metastore.HiveMetaStore (HiveMetaStore.java:init(453)) - Begin calculating metadata count metrics.
2018-03-08 04:41:38,749 INFO [main]: metastore.HiveMetaStore (HiveMetaStore.java:init(455)) - Finished metadata count metrics: 1 databases, 0 tables, 0 partitions.
2018-03-08 04:41:38,749 WARN [main]: metrics2.CodahaleMetrics (CodahaleMetrics.java:addGauge(299)) - A Gauge with name [init_total_count_dbs] already exists. The old gauge will be overwritten, but this is not recommended
2018-03-08 04:41:38,749 WARN [main]: metrics2.CodahaleMetrics (CodahaleMetrics.java:addGauge(299)) - A Gauge with name [init_total_count_tables] already exists. The old gauge will be overwritten, but this is not recommended
2018-03-08 04:41:38,749 WARN [main]: metrics2.CodahaleMetrics (CodahaleMetrics.java:addGauge(299)) - A Gauge with name [init_total_count_partitions] already exists. The old gauge will be overwritten, but this is not recommended
2018-03-08 04:41:38,750 INFO [main]: metastore.HiveMetaStore (HiveMetaStore.java:logInfo(773)) - 0: get_databases: default
2018-03-08 04:41:38,750 INFO [main]: HiveMetaStore.audit (HiveMetaStore.java:logAuditEvent(317)) - ugi=hive ip=unknown-ip-addr cmd=get_databases: default 
2018-03-08 04:41:38,759 INFO [main]: metastore.HiveMetaStore (HiveMetaStore.java:logInfo(773)) - 0: Shutting down the object store...
2018-03-08 04:41:38,760 INFO [main]: HiveMetaStore.audit (HiveMetaStore.java:logAuditEvent(317)) - ugi=hive ip=unknown-ip-addr cmd=Shutting down the object store... 
2018-03-08 04:41:38,760 INFO [main]: metastore.HiveMetaStore (HiveMetaStore.java:logInfo(773)) - 0: Metastore shutdown complete.
2018-03-08 04:41:38,760 INFO [main]: HiveMetaStore.audit (HiveMetaStore.java:logAuditEvent(317)) - ugi=hive ip=unknown-ip-addr cmd=Metastore shutdown complete. 
2018-03-08 04:41:38,760 INFO [main]: service.AbstractService (AbstractService.java:start(104)) - Service:ThriftHttpCLIService is started.
2018-03-08 04:41:38,761 INFO [main]: service.AbstractService (AbstractService.java:start(104)) - Service:HiveServer2 is started.
2018-03-08 04:41:38,785 INFO [main]: imps.CuratorFrameworkImpl (CuratorFrameworkImpl.java:start(230)) - Starting
2018-03-08 04:41:38,795 INFO [main]: zookeeper.ZooKeeper (Environment.java:logEnv(100)) - Client environment:zookeeper.version=3.4.6-91--1, built on 01/04/2018 09:27 GMT
2018-03-08 04:41:38,795 INFO [main]: zookeeper.ZooKeeper (Environment.java:logEnv(100)) - Client environment:host.name=ip-10-0-91-7.ap-northeast-2.compute.internal
2018-03-08 04:41:38,795 INFO [main]: zookeeper.ZooKeeper (Environment.java:logEnv(100)) - Client environment:java.version=1.8.0_161
2018-03-08 04:41:38,795 INFO [main]: zookeeper.ZooKeeper (Environment.java:logEnv(100)) - Client environment:java.vendor=Oracle Corporation
2018-03-08 04:41:38,795 INFO [main]: zookeeper.ZooKeeper (Environment.java:logEnv(100)) - Client environment:java.home=/usr/lib/jvm/java-1.8.0-openjdk-1.8.0.161-0.b14.36.amzn1.x86_64/jre
2018-03-08 04:41:38,796 INFO [main]: zookeeper.ZooKeeper (Environment.java:logEnv(100)) - Client environment:java.class.path=/usr/hdp/2.6.4.0-91/atlas/hook/hive/hive-bridge-shim-0.8.0.2.6.4.0-91.jar:/usr/hdp/2.6.4.0-91/atlas/hook/hive/atlas-plugin-classloader-0.8.0.2.6.4.0-91.jar:/usr/hdp/2.6.4.0-91/hive-hcatalog/share/hcatalog/hive-hcatalog-core-1.2.1000.2.6.4.0-91.jar:/usr/hdp/2.6.4.0-91/hive-hcatalog/share/hcatalog/hive-hcatalog-server-extensions-1.2.1000.2.6.4.0-91.jar:/usr/hdp/2.6.4.0-91/hive-hcatalog/share/webhcat/java-client/hive-webhcat-java-client-1.2.1000.2.6.4.0-91.jar:/usr/hdp/2.6.4.0-91/atlas/hook/hive/hive-bridge-shim-0.8.0.2.6.4.0-91.jar:/usr/hdp/2.6.4.0-91/atlas/hook/hive/atlas-plugin-classloader-0.8.0.2.6.4.0-91.jar:/usr/hdp/2.6.4.0-91/hive-hcatalog/share/hcatalog/hive-hcatalog-core-1.2.1000.2.6.4.0-91.jar:/usr/hdp/2.6.4.0-91/hive-hcatalog/share/hcatalog/hive-hcatalog-server-extensions-1.2.1000.2.6.4.0-91.jar:/usr/hdp/2.6.4.0-91/hive-hcatalog/share/webhcat/java-client/hive-webhcat-java-client-1.2.1000.2.6.4.0-91.jar:/usr/hdp/current/hive-server2/conf/conf.server:/usr/hdp/2.6.4.0-91/hive/lib/accumulo-core-1.7.0.2.6.4.0-91.jar:/usr/hdp/2.6.4.0-91/hive/lib/accumulo-fate-1.7.0.2.6.4.0-91.jar:/usr/hdp/2.6.4.0-91/hive/lib/accumulo-start-1.7.0.2.6.4.0-91.jar:/usr/hdp/2.6.4.0-91/hive/lib/accumulo-trace-1.7.0.2.6.4.0-91.jar:/usr/hdp/2.6.4.0-91/hive/lib/activation-1.1.jar:/usr/hdp/2.6.4.0-91/hive/lib/ant-1.9.1.jar:/usr/hdp/2.6.4.0-91/hive/lib/ant-launcher-1.9.1.jar:/usr/hdp/2.6.4.0-91/hive/lib/antlr-2.7.7.jar:/usr/hdp/2.6.4.0-91/hive/lib/antlr-runtime-3.4.jar:/usr/hdp/2.6.4.0-91/hive/lib/apache-log4j-extras-1.2.17.jar:/usr/hdp/2.6.4.0-91/hive/lib/asm-commons-3.1.jar:/usr/hdp/2.6.4.0-91/hive/lib/asm-tree-3.1.jar:/usr/hdp/2.6.4.0-91/hive/lib/avatica-1.8.0.2.6.4.0-91.jar:/usr/hdp/2.6.4.0-91/hive/lib/avatica-metrics-1.8.0.2.6.4.0-91.jar:/usr/hdp/2.6.4.0-91/hive/lib/avro-1.7.5.jar:/usr/hdp/2.6.4.0-91/hive/lib/bonecp-0.8.0.RELEASE.jar:/usr/hdp/2.6.4.0-91/hive/lib/calcite-core-1.2.0.2.6.4.0-91.jar:/usr/hdp/2.6.4.0-91/hive/lib/calcite-linq4j-1.2.0.2.6.4.0-91.jar:/usr/hdp/2.6.4.0-91/hive/lib/commons-cli-1.2.jar:/usr/hdp/2.6.4.0-91/hive/lib/commons-codec-1.4.jar:/usr/hdp/2.6.4.0-91/hive/lib/commons-collections-3.2.2.jar:/usr/hdp/2.6.4.0-91/hive/lib/commons-compiler-2.7.6.jar:/usr/hdp/2.6.4.0-91/hive/lib/commons-compress-1.4.1.jar:/usr/hdp/2.6.4.0-91/hive/lib/commons-dbcp-1.4.jar:/usr/hdp/2.6.4.0-91/hive/lib/commons-httpclient-3.0.1.jar:/usr/hdp/2.6.4.0-91/hive/lib/commons-io-2.4.jar:/usr/hdp/2.6.4.0-91/hive/lib/commons-lang-2.6.jar:/usr/hdp/2.6.4.0-91/hive/lib/commons-logging-1.1.3.jar:/usr/hdp/2.6.4.0-91/hive/lib/commons-math-2.1.jar:/usr/hdp/2.6.4.0-91/hive/lib/commons-pool-1.5.4.jar:/usr/hdp/2.6.4.0-91/hive/lib/commons-vfs2-2.0.jar:/usr/hdp/2.6.4.0-91/hive/lib/curator-client-2.6.0.jar:/usr/hdp/2.6.4.0-91/hive/lib/curator-framework-2.6.0.jar:/usr/hdp/2.6.4.0-91/hive/lib/curator-recipes-2.6.0.jar:/usr/hdp/2.6.4.0-91/hive/lib/datanucleus-api-jdo-4.2.1.jar:/usr/hdp/2.6.4.0-91/hive/lib/datanucleus-core-4.1.6.jar:/usr/hdp/2.6.4.0-91/hive/lib/datanucleus-rdbms-4.1.7.jar:/usr/hdp/2.6.4.0-91/hive/lib/derby-10.10.2.0.jar:/usr/hdp/2.6.4.0-91/hive/lib/dropwizard-metrics-hadoop-metrics2-reporter-0.1.2.jar:/usr/hdp/2.6.4.0-91/hive/lib/eigenbase-properties-1.1.5.jar:/usr/hdp/2.6.4.0-91/hive/lib/geronimo-annotation_1.0_spec-1.1.1.jar:/usr/hdp/2.6.4.0-91/hive/lib/geronimo-jaspic_1.0_spec-1.0.jar:/usr/hdp/2.6.4.0-91/hive/lib/geronimo-jta_1.1_spec-1.1.1.jar:/usr/hdp/2.6.4.0-91/hive/lib/groovy-all-2.4.11.jar:/usr/hdp/2.6.4.0-91/hive/lib/guava-14.0.1.jar:/usr/hdp/2.6.4.0-91/hive/lib/HikariCP-2.5.1.jar:/usr/hdp/2.6.4.0-91/hive/lib/hive-accumulo-handler-1.2.1000.2.6.4.0-91.jar:/usr/hdp/2.6.4.0-91/hive/lib/hive-accumulo-handler.jar:/usr/hdp/2.6.4.0-91/hive/lib/hive-ant-1.2.1000.2.6.4.0-91.jar:/usr/hdp/2.6.4.0-91/hive/lib/hive-ant.jar:/usr/hdp/2.6.4.0-91/hive/lib/hive-beeline-1.2.1000.2.6.4.0-91.jar:/usr/hdp/2.6.4.0-91/hive/lib/hive-beeline.jar:/usr/hdp/2.6.4.0-91/hive/lib/hive-cli-1.2.1000.2.6.4.0-91.jar:/usr/hdp/2.6.4.0-91/hive/lib/hive-cli.jar:/usr/hdp/2.6.4.0-91/hive/lib/hive-common-1.2.1000.2.6.4.0-91.jar:/usr/hdp/2.6.4.0-91/hive/lib/hive-common.jar:/usr/hdp/2.6.4.0-91/hive/lib/hive-contrib-1.2.1000.2.6.4.0-91.jar:/usr/hdp/2.6.4.0-91/hive/lib/hive-contrib.jar:/usr/hdp/2.6.4.0-91/hive/lib/hive-exec-1.2.1000.2.6.4.0-91.jar:/usr/hdp/2.6.4.0-91/hive/lib/hive-exec.jar:/usr/hdp/2.6.4.0-91/hive/lib/hive-hbase-handler-1.2.1000.2.6.4.0-91.jar:/usr/hdp/2.6.4.0-91/hive/lib/hive-hbase-handler.jar:/usr/hdp/2.6.4.0-91/hive/lib/hive-hwi-1.2.1000.2.6.4.0-91.jar:/usr/hdp/2.6.4.0-91/hive/lib/hive-hwi.jar:/usr/hdp/2.6.4.0-91/hive/lib/hive-jdbc-1.2.1000.2.6.4.0-91.jar:/usr/hdp/2.6.4.0-91/hive/lib/hive-jdbc.jar:/usr/hdp/2.6.4.0-91/hive/lib/hive-metastore-1.2.1000.2.6.4.0-91.jar:/usr/hdp/2.6.4.0-91/hive/lib/hive-metastore.jar:/usr/hdp/2.6.4.0-91/hive/lib/hive-serde-1.2.1000.2.6.4.0-91.jar:/usr/hdp/2.6.4.0-91/hive/lib/hive-serde.jar:/usr/hdp/2.6.4.0-91/hive/lib/hive-service-1.2.1000.2.6.4.0-91.jar:/usr/hdp/2.6.4.0-91/hive/lib/hive-service.jar:/usr/hdp/2.6.4.0-91/hive/lib/hive-shims-0.20S-1.2.1000.2.6.4.0-91.jar:/usr/hdp/2.6.4.0-91/hive/lib/hive-shims-0.23-1.2.1000.2.6.4.0-91.jar:/usr/hdp/2.6.4.0-91/hive/lib/hive-shims-1.2.1000.2.6.4.0-91.jar:/usr/hdp/2.6.4.0-91/hive/lib/hive-shims-common-1.2.1000.2.6.4.0-91.jar:/usr/hdp/2.6.4.0-91/hive/lib/hive-shims-common.jar:/usr/hdp/2.6.4.0-91/hive/lib/hive-shims.jar:/usr/hdp/2.6.4.0-91/hive/lib/hive-shims-scheduler-1.2.1000.2.6.4.0-91.jar:/usr/hdp/2.6.4.0-91/hive/lib/hive-shims-scheduler.jar:/usr/hdp/2.6.4.0-91/hive/lib/htrace-core-3.1.0-incubating.jar:/usr/hdp/2.6.4.0-91/hive/lib/httpclient-4.4.jar:/usr/hdp/2.6.4.0-91/hive/lib/httpcore-4.4.jar:/usr/hdp/2.6.4.0-91/hive/lib/ivy-2.4.0.jar:/usr/hdp/2.6.4.0-91/hive/lib/jackson-annotations-2.4.0.jar:/usr/hdp/2.6.4.0-91/hive/lib/jackson-core-2.4.2.jar:/usr/hdp/2.6.4.0-91/hive/lib/jackson-databind-2.4.2.jar:/usr/hdp/2.6.4.0-91/hive/lib/janino-2.7.6.jar:/usr/hdp/2.6.4.0-91/hive/lib/javax.jdo-3.2.0-m3.jar:/usr/hdp/2.6.4.0-91/hive/lib/jcommander-1.32.jar:/usr/hdp/2.6.4.0-91/hive/lib/jdo-api-3.0.1.jar:/usr/hdp/2.6.4.0-91/hive/lib/jetty-all-7.6.0.v20120127.jar:/usr/hdp/2.6.4.0-91/hive/lib/jetty-all-server-7.6.0.v20120127.jar:/usr/hdp/2.6.4.0-91/hive/lib/jline-2.12.jar:/usr/hdp/2.6.4.0-91/hive/lib/joda-time-2.8.1.jar:/usr/hdp/2.6.4.0-91/hive/lib/jpam-1.1.jar:/usr/hdp/2.6.4.0-91/hive/lib/json-20090211.jar:/usr/hdp/2.6.4.0-91/hive/lib/jsr305-3.0.0.jar:/usr/hdp/2.6.4.0-91/hive/lib/jta-1.1.jar:/usr/hdp/2.6.4.0-91/hive/lib/libfb303-0.9.3.jar:/usr/hdp/2.6.4.0-91/hive/lib/libthrift-0.9.3.jar:/usr/hdp/2.6.4.0-91/hive/lib/log4j-1.2.16.jar:/usr/hdp/2.6.4.0-91/hive/lib/mail-1.4.1.jar:/usr/hdp/2.6.4.0-91/hive/lib/maven-scm-api-1.4.jar:/usr/hdp/2.6.4.0-91/hive/lib/maven-scm-provider-svn-commons-1.4.jar:/usr/hdp/2.6.4.0-91/hive/lib/maven-scm-provider-svnexe-1.4.jar:/usr/hdp/2.6.4.0-91/hive/lib/metrics-core-3.1.0.jar:/usr/hdp/2.6.4.0-91/hive/lib/metrics-json-3.1.0.jar:/usr/hdp/2.6.4.0-91/hive/lib/metrics-jvm-3.1.0.jar:/usr/hdp/2.6.4.0-91/hive/lib/netty-3.7.0.Final.jar:/usr/hdp/2.6.4.0-91/hive/lib/opencsv-2.3.jar:/usr/hdp/2.6.4.0-91/hive/lib/oro-2.0.8.jar:/usr/hdp/2.6.4.0-91/hive/lib/paranamer-2.3.jar:/usr/hdp/2.6.4.0-91/hive/lib/parquet-hadoop-bundle-1.8.1.jar:/usr/hdp/2.6.4.0-91/hive/lib/pentaho-aggdesigner-algorithm-5.1.5-jhyde.jar:/usr/hdp/2.6.4.0-91/hive/lib/plexus-utils-1.5.6.jar:/usr/hdp/2.6.4.0-91/hive/lib/postgresql-9.4.1208.jre7.jar:/usr/hdp/2.6.4.0-91/hive/lib/protobuf-java-2.5.0.jar:/usr/hdp/2.6.4.0-91/hive/lib/ranger-hive-plugin-shim-0.7.0.2.6.4.0-91.jar:/usr/hdp/2.6.4.0-91/hive/lib/ranger-plugin-classloader-0.7.0.2.6.4.0-91.jar:/usr/hdp/2.6.4.0-91/hive/lib/regexp-1.3.jar:/usr/hdp/2.6.4.0-91/hive/lib/servlet-api-2.5.jar:/usr/hdp/2.6.4.0-91/hive/lib/snappy-java-1.0.5.jar:/usr/hdp/2.6.4.0-91/hive/lib/ST4-4.0.4.jar:/usr/hdp/2.6.4.0-91/hive/lib/stax-api-1.0.1.jar:/usr/hdp/2.6.4.0-91/hive/lib/stringtemplate-3.2.1.jar:/usr/hdp/2.6.4.0-91/hive/lib/super-csv-2.2.0.jar:/usr/hdp/2.6.4.0-91/hive/lib/transaction-api-1.1.jar:/usr/hdp/2.6.4.0-91/hive/lib/velocity-1.5.jar:/usr/hdp/2.6.4.0-91/hive/lib/xz-1.0.jar:/usr/hdp/2.6.4.0-91/hive/lib/zookeeper-3.4.6.2.6.4.0-91.jar::/usr/hdp/current/hive-webhcat/share/hcatalog/hive-hcatalog-core.jar:postgresql-9.4.1208.jre7.jar:postgresql-jdbc2ee.jar:postgresql-jdbc2.jar:postgresql-jdbc3.jar:postgresql-jdbc.jar:/usr/lib/hadoop/lib/*:/usr/hdp/2.6.4.0-91/hadoop/conf:/usr/hdp/2.6.4.0-91/hadoop/lib/aws-java-sdk-kms-1.10.6.jar:/usr/hdp/2.6.4.0-91/hadoop/lib/guava-11.0.2.jar:/usr/hdp/2.6.4.0-91/hadoop/lib/jackson-mapper-asl-1.9.13.jar:/usr/hdp/2.6.4.0-91/hadoop/lib/jsr305-3.0.0.jar:/usr/hdp/2.6.4.0-91/hadoop/lib/commons-logging-1.1.3.jar:/usr/hdp/2.6.4.0-91/hadoop/lib/jets3t-0.9.0.jar:/usr/hdp/2.6.4.0-91/hadoop/lib/ranger-hdfs-plugin-shim-0.7.0.2.6.4.0-91.jar:/usr/hdp/2.6.4.0-91/hadoop/lib/zookeeper-3.4.6.2.6.4.0-91.jar:/usr/hdp/2.6.4.0-91/hadoop/lib/jackson-xc-1.9.13.jar:/usr/hdp/2.6.4.0-91/hadoop/lib/aws-java-sdk-s3-1.10.6.jar:/usr/hdp/2.6.4.0-91/hadoop/lib/curator-client-2.7.1.jar:/usr/hdp/2.6.4.0-91/hadoop/lib/xz-1.0.jar:/usr/hdp/2.6.4.0-91/hadoop/lib/jsp-api-2.1.jar:/usr/hdp/2.6.4.0-91/hadoop/lib/httpcore-4.4.4.jar:/usr/hdp/2.6.4.0-91/hadoop/lib/jackson-jaxrs-1.9.13.jar:/usr/hdp/2.6.4.0-91/hadoop/lib/azure-keyvault-core-0.8.0.jar:/usr/hdp/2.6.4.0-91/hadoop/lib/nimbus-jose-jwt-3.9.jar:/usr/hdp/2.6.4.0-91/hadoop/lib/jackson-core-asl-1.9.13.jar:/usr/hdp/2.6.4.0-91/hadoop/lib/ojdbc6.jar:/usr/hdp/2.6.4.0-91/hadoop/lib/ranger-yarn-plugin-shim-0.7.0.2.6.4.0-91.jar:/usr/hdp/2.6.4.0-91/hadoop/lib/commons-codec-1.4.jar:/usr/hdp/2.6.4.0-91/hadoop/lib/joda-time-2.9.4.jar:/usr/hdp/2.6.4.0-91/hadoop/lib/commons-digester-1.8.jar:/usr/hdp/2.6.4.0-91/hadoop/lib/commons-io-2.4.jar:/usr/hdp/2.6.4.0-91/hadoop/lib/curator-recipes-2.7.1.jar:/usr/hdp/2.6.4.0-91/hadoop/lib/xmlenc-0.52.jar:/usr/hdp/2.6.4.0-91/hadoop/lib/commons-lang3-3.4.jar:/usr/hdp/2.6.4.0-91/hadoop/lib/slf4j-api-1.7.10.jar:/usr/hdp/2.6.4.0-91/hadoop/lib/jetty-util-6.1.26.hwx.jar:/usr/hdp/2.6.4.0-91/hadoop/lib/java-xmlbuilder-0.4.jar:/usr/hdp/2.6.4.0-91/hadoop/lib/asm-3.2.jar:/usr/hdp/2.6.4.0-91/hadoop/lib/snappy-java-1.0.4.1.jar:/usr/hdp/2.6.4.0-91/hadoop/lib/mockito-all-1.8.5.jar:/usr/hdp/2.6.4.0-91/hadoop/lib/api-util-1.0.0-M20.jar:/usr/hdp/2.6.4.0-91/hadoop/lib/jetty-6.1.26.hwx.jar:/usr/hdp/2.6.4.0-91/hadoop/lib/jaxb-impl-2.2.3-1.jar:/usr/hdp/2.6.4.0-91/hadoop/lib/hamcrest-core-1.3.jar:/usr/hdp/2.6.4.0-91/hadoop/lib/jettison-1.1.jar:/usr/hdp/2.6.4.0-91/hadoop/lib/jsch-0.1.54.jar:/usr/hdp/2.6.4.0-91/hadoop/lib/commons-compress-1.4.1.jar:/usr/hdp/2.6.4.0-91/hadoop/lib/slf4j-log4j12-1.7.10.jar:/usr/hdp/2.6.4.0-91/hadoop/lib/azure-storage-5.4.0.jar:/usr/hdp/2.6.4.0-91/hadoop/lib/avro-1.7.4.jar:/usr/hdp/2.6.4.0-91/hadoop/lib/activation-1.1.jar:/usr/hdp/2.6.4.0-91/hadoop/lib/log4j-1.2.17.jar:/usr/hdp/2.6.4.0-91/hadoop/lib/jersey-json-1.9.jar:/usr/hdp/2.6.4.0-91/hadoop/lib/netty-3.6.2.Final.jar:/usr/hdp/2.6.4.0-91/hadoop/lib/commons-net-3.1.jar:/usr/hdp/2.6.4.0-91/hadoop/lib/jackson-databind-2.2.3.jar:/usr/hdp/2.6.4.0-91/hadoop/lib/apacheds-i18n-2.0.0-M15.jar:/usr/hdp/2.6.4.0-91/hadoop/lib/commons-beanutils-core-1.8.0.jar:/usr/hdp/2.6.4.0-91/hadoop/lib/apacheds-kerberos-codec-2.0.0-M15.jar:/usr/hdp/2.6.4.0-91/hadoop/lib/servlet-api-2.5.jar:/usr/hdp/2.6.4.0-91/hadoop/lib/protobuf-java-2.5.0.jar:/usr/hdp/2.6.4.0-91/hadoop/lib/jersey-core-1.9.jar:/usr/hdp/2.6.4.0-91/hadoop/lib/commons-lang-2.6.jar:/usr/hdp/2.6.4.0-91/hadoop/lib/commons-cli-1.2.jar:/usr/hdp/2.6.4.0-91/hadoop/lib/ranger-plugin-classloader-0.7.0.2.6.4.0-91.jar:/usr/hdp/2.6.4.0-91/hadoop/lib/junit-4.11.jar:/usr/hdp/2.6.4.0-91/hadoop/lib/jaxb-api-2.2.2.jar:/usr/hdp/2.6.4.0-91/hadoop/lib/htrace-core-3.1.0-incubating.jar:/usr/hdp/2.6.4.0-91/hadoop/lib/commons-beanutils-1.7.0.jar:/usr/hdp/2.6.4.0-91/hadoop/lib/jackson-annotations-2.2.3.jar:/usr/hdp/2.6.4.0-91/hadoop/lib/commons-collections-3.2.2.jar:/usr/hdp/2.6.4.0-91/hadoop/lib/httpclient-4.5.2.jar:/usr/hdp/2.6.4.0-91/hadoop/lib/jcip-annotations-1.0.jar:/usr/hdp/2.6.4.0-91/hadoop/lib/paranamer-2.3.jar:/usr/hdp/2.6.4.0-91/hadoop/lib/jersey-server-1.9.jar:/usr/hdp/2.6.4.0-91/hadoop/lib/json-smart-1.1.1.jar:/usr/hdp/2.6.4.0-91/hadoop/lib/gson-2.2.4.jar:/usr/hdp/2.6.4.0-91/hadoop/lib/curator-framework-2.7.1.jar:/usr/hdp/2.6.4.0-91/hadoop/lib/jackson-core-2.2.3.jar:/usr/hdp/2.6.4.0-91/hadoop/lib/aws-java-sdk-core-1.10.6.jar:/usr/hdp/2.6.4.0-91/hadoop/lib/commons-math3-3.1.1.jar:/usr/hdp/2.6.4.0-91/hadoop/lib/jetty-sslengine-6.1.26.hwx.jar:/usr/hdp/2.6.4.0-91/hadoop/lib/api-asn1-api-1.0.0-M20.jar:/usr/hdp/2.6.4.0-91/hadoop/lib/stax-api-1.0-2.jar:/usr/hdp/2.6.4.0-91/hadoop/lib/commons-configuration-1.6.jar:/usr/hdp/2.6.4.0-91/hadoop/.//hadoop-common.jar:/usr/hdp/2.6.4.0-91/hadoop/.//hadoop-auth-2.7.3.2.6.4.0-91.jar:/usr/hdp/2.6.4.0-91/hadoop/.//hadoop-annotations-2.7.3.2.6.4.0-91.jar:/usr/hdp/2.6.4.0-91/hadoop/.//hadoop-azure-datalake.jar:/usr/hdp/2.6.4.0-91/hadoop/.//hadoop-azure-2.7.3.2.6.4.0-91.jar:/usr/hdp/2.6.4.0-91/hadoop/.//hadoop-nfs.jar:/usr/hdp/2.6.4.0-91/hadoop/.//hadoop-nfs-2.7.3.2.6.4.0-91.jar:/usr/hdp/2.6.4.0-91/hadoop/.//hadoop-azure-datalake-2.7.3.2.6.4.0-91.jar:/usr/hdp/2.6.4.0-91/hadoop/.//hadoop-common-tests.jar:/usr/hdp/2.6.4.0-91/hadoop/.//hadoop-auth.jar:/usr/hdp/2.6.4.0-91/hadoop/.//hadoop-aws-2.7.3.2.6.4.0-91.jar:/usr/hdp/2.6.4.0-91/hadoop/.//hadoop-annotations.jar:/usr/hdp/2.6.4.0-91/hadoop/.//azure-data-lake-store-sdk-2.1.4.jar:/usr/hdp/2.6.4.0-91/hadoop/.//hadoop-aws.jar:/usr/hdp/2.6.4.0-91/hadoop/.//hadoop-common-2.7.3.2.6.4.0-91-tests.jar:/usr/hdp/2.6.4.0-91/hadoop/.//hadoop-common-2.7.3.2.6.4.0-91.jar:/usr/hdp/2.6.4.0-91/hadoop/.//hadoop-azure.jar:/usr/hdp/2.6.4.0-91/hadoop-hdfs/./:/usr/hdp/2.6.4.0-91/hadoop-hdfs/lib/guava-11.0.2.jar:/usr/hdp/2.6.4.0-91/hadoop-hdfs/lib/xercesImpl-2.9.1.jar:/usr/hdp/2.6.4.0-91/hadoop-hdfs/lib/jackson-mapper-asl-1.9.13.jar:/usr/hdp/2.6.4.0-91/hadoop-hdfs/lib/jsr305-3.0.0.jar:/usr/hdp/2.6.4.0-91/hadoop-hdfs/lib/commons-logging-1.1.3.jar:/usr/hdp/2.6.4.0-91/hadoop-hdfs/lib/okhttp-2.4.0.jar:/usr/hdp/2.6.4.0-91/hadoop-hdfs/lib/jackson-core-asl-1.9.13.jar:/usr/hdp/2.6.4.0-91/hadoop-hdfs/lib/commons-codec-1.4.jar:/usr/hdp/2.6.4.0-91/hadoop-hdfs/lib/commons-io-2.4.jar:/usr/hdp/2.6.4.0-91/hadoop-hdfs/lib/xml-apis-1.3.04.jar:/usr/hdp/2.6.4.0-91/hadoop-hdfs/lib/xmlenc-0.52.jar:/usr/hdp/2.6.4.0-91/hadoop-hdfs/lib/okio-1.4.0.jar:/usr/hdp/2.6.4.0-91/hadoop-hdfs/lib/jetty-util-6.1.26.hwx.jar:/usr/hdp/2.6.4.0-91/hadoop-hdfs/lib/asm-3.2.jar:/usr/hdp/2.6.4.0-91/hadoop-hdfs/lib/jetty-6.1.26.hwx.jar:/usr/hdp/2.6.4.0-91/hadoop-hdfs/lib/netty-all-4.0.52.Final.jar:/usr/hdp/2.6.4.0-91/hadoop-hdfs/lib/commons-daemon-1.0.13.jar:/usr/hdp/2.6.4.0-91/hadoop-hdfs/lib/log4j-1.2.17.jar:/usr/hdp/2.6.4.0-91/hadoop-hdfs/lib/netty-3.6.2.Final.jar:/usr/hdp/2.6.4.0-91/hadoop-hdfs/lib/jackson-databind-2.2.3.jar:/usr/hdp/2.6.4.0-91/hadoop-hdfs/lib/servlet-api-2.5.jar:/usr/hdp/2.6.4.0-91/hadoop-hdfs/lib/protobuf-java-2.5.0.jar:/usr/hdp/2.6.4.0-91/hadoop-hdfs/lib/jersey-core-1.9.jar:/usr/hdp/2.6.4.0-91/hadoop-hdfs/lib/commons-lang-2.6.jar:/usr/hdp/2.6.4.0-91/hadoop-hdfs/lib/commons-cli-1.2.jar:/usr/hdp/2.6.4.0-91/hadoop-hdfs/lib/htrace-core-3.1.0-incubating.jar:/usr/hdp/2.6.4.0-91/hadoop-hdfs/lib/jackson-annotations-2.2.3.jar:/usr/hdp/2.6.4.0-91/hadoop-hdfs/lib/jersey-server-1.9.jar:/usr/hdp/2.6.4.0-91/hadoop-hdfs/lib/jackson-core-2.2.3.jar:/usr/hdp/2.6.4.0-91/hadoop-hdfs/lib/leveldbjni-all-1.8.jar:/usr/hdp/2.6.4.0-91/hadoop-hdfs/.//hadoop-hdfs-2.7.3.2.6.4.0-91-tests.jar:/usr/hdp/2.6.4.0-91/hadoop-hdfs/.//hadoop-hdfs.jar:/usr/hdp/2.6.4.0-91/hadoop-hdfs/.//hadoop-hdfs-tests.jar:/usr/hdp/2.6.4.0-91/hadoop-hdfs/.//hadoop-hdfs-2.7.3.2.6.4.0-91.jar:/usr/hdp/2.6.4.0-91/hadoop-hdfs/.//hadoop-hdfs-nfs-2.7.3.2.6.4.0-91.jar:/usr/hdp/2.6.4.0-91/hadoop-hdfs/.//hadoop-hdfs-nfs.jar:/usr/hdp/2.6.4.0-91/hadoop-yarn/lib/objenesis-2.1.jar:/usr/hdp/2.6.4.0-91/hadoop-yarn/lib/guava-11.0.2.jar:/usr/hdp/2.6.4.0-91/hadoop-yarn/lib/jackson-mapper-asl-1.9.13.jar:/usr/hdp/2.6.4.0-91/hadoop-yarn/lib/jsr305-3.0.0.jar:/usr/hdp/2.6.4.0-91/hadoop-yarn/lib/commons-logging-1.1.3.jar:/usr/hdp/2.6.4.0-91/hadoop-yarn/lib/jets3t-0.9.0.jar:/usr/hdp/2.6.4.0-91/hadoop-yarn/lib/zookeeper-3.4.6.2.6.4.0-91.jar:/usr/hdp/2.6.4.0-91/hadoop-yarn/lib/jackson-xc-1.9.13.jar:/usr/hdp/2.6.4.0-91/hadoop-yarn/lib/aopalliance-1.0.jar:/usr/hdp/2.6.4.0-91/hadoop-yarn/lib/fst-2.24.jar:/usr/hdp/2.6.4.0-91/hadoop-yarn/lib/jersey-client-1.9.jar:/usr/hdp/2.6.4.0-91/hadoop-yarn/lib/javax.inject-1.jar:/usr/hdp/2.6.4.0-91/hadoop-yarn/lib/curator-client-2.7.1.jar:/usr/hdp/2.6.4.0-91/hadoop-yarn/lib/jersey-guice-1.9.jar:/usr/hdp/2.6.4.0-91/hadoop-yarn/lib/xz-1.0.jar:/usr/hdp/2.6.4.0-91/hadoop-yarn/lib/jsp-api-2.1.jar:/usr/hdp/2.6.4.0-91/hadoop-yarn/lib/httpcore-4.4.4.jar:/usr/hdp/2.6.4.0-91/hadoop-yarn/lib/jackson-jaxrs-1.9.13.jar:/usr/hdp/2.6.4.0-91/hadoop-yarn/lib/azure-keyvault-core-0.8.0.jar:/usr/hdp/2.6.4.0-91/hadoop-yarn/lib/nimbus-jose-jwt-3.9.jar:/usr/hdp/2.6.4.0-91/hadoop-yarn/lib/jackson-core-asl-1.9.13.jar:/usr/hdp/2.6.4.0-91/hadoop-yarn/lib/commons-codec-1.debug2: channel 0: window 996686 sent adjust 51890
4.jar:/usr/hdp/2.6.4.0-91/hadoop-yarn/lib/commons-digester-1.8.jar:/usr/hdp/2.6.4.0-91/hadoop-yarn/lib/commons-io-2.4.jar:/usr/hdp/2.6.4.0-91/hadoop-yarn/lib/curator-recipes-2.7.1.jar:/usr/hdp/2.6.4.0-91/hadoop-yarn/lib/xmlenc-0.52.jar:/usr/hdp/2.6.4.0-91/hadoop-yarn/lib/commons-lang3-3.4.jar:/usr/hdp/2.6.4.0-91/hadoop-yarn/lib/javassist-3.18.1-GA.jar:/usr/hdp/2.6.4.0-91/hadoop-yarn/lib/jetty-util-6.1.26.hwx.jar:/usr/hdp/2.6.4.0-91/hadoop-yarn/lib/java-xmlbuilder-0.4.jar:/usr/hdp/2.6.4.0-91/hadoop-yarn/lib/asm-3.2.jar:/usr/hdp/2.6.4.0-91/hadoop-yarn/lib/snappy-java-1.0.4.1.jar:/usr/hdp/2.6.4.0-91/hadoop-yarn/lib/api-util-1.0.0-M20.jar:/usr/hdp/2.6.4.0-91/hadoop-yarn/lib/jetty-6.1.26.hwx.jar:/usr/hdp/2.6.4.0-91/hadoop-yarn/lib/guice-3.0.jar:/usr/hdp/2.6.4.0-91/hadoop-yarn/lib/jaxb-impl-2.2.3-1.jar:/usr/hdp/2.6.4.0-91/hadoop-yarn/lib/guice-servlet-3.0.jar:/usr/hdp/2.6.4.0-91/hadoop-yarn/lib/jettison-1.1.jar:/usr/hdp/2.6.4.0-91/hadoop-yarn/lib/jsch-0.1.54.jar:/usr/hdp/2.6.4.0-91/hadoop-yarn/lib/commons-compress-1.4.1.jar:/usr/hdp/2.6.4.0-91/hadoop-yarn/lib/azure-storage-5.4.0.jar:/usr/hdp/2.6.4.0-91/hadoop-yarn/lib/avro-1.7.4.jar:/usr/hdp/2.6.4.0-91/hadoop-yarn/lib/activation-1.1.jar:/usr/hdp/2.6.4.0-91/hadoop-yarn/lib/log4j-1.2.17.jar:/usr/hdp/2.6.4.0-91/hadoop-yarn/lib/jersey-json-1.9.jar:/usr/hdp/2.6.4.0-91/hadoop-yarn/lib/netty-3.6.2.Final.jar:/usr/hdp/2.6.4.0-91/hadoop-yarn/lib/commons-net-3.1.jar:/usr/hdp/2.6.4.0-91/hadoop-yarn/lib/jackson-databind-2.2.3.jar:/usr/hdp/2.6.4.0-91/hadoop-yarn/lib/apacheds-i18n-2.0.0-M15.jar:/usr/hdp/2.6.4.0-91/hadoop-yarn/lib/commons-beanutils-core-1.8.0.jar:/usr/hdp/2.6.4.0-91/hadoop-yarn/lib/apacheds-kerberos-codec-2.0.0-M15.jar:/usr/hdp/2.6.4.0-91/hadoop-yarn/lib/servlet-api-2.5.jar:/usr/hdp/2.6.4.0-91/hadoop-yarn/lib/protobuf-java-2.5.0.jar:/usr/hdp/2.6.4.0-91/hadoop-yarn/lib/jersey-core-1.9.jar:/usr/hdp/2.6.4.0-91/hadoop-yarn/lib/commons-lang-2.6.jar:/usr/hdp/2.6.4.0-91/hadoop-yarn/lib/commons-cli-1.2.jar:/usr/hdp/2.6.4.0-91/hadoop-yarn/lib/jaxb-api-2.2.2.jar:/usr/hdp/2.6.4.0-91/hadoop-yarn/lib/htrace-core-3.1.0-incubating.jar:/usr/hdp/2.6.4.0-91/hadoop-yarn/lib/commons-beanutils-1.7.0.jar:/usr/hdp/2.6.4.0-91/hadoop-yarn/lib/jackson-annotations-2.2.3.jar:/usr/hdp/2.6.4.0-91/hadoop-yarn/lib/commons-collections-3.2.2.jar:/usr/hdp/2.6.4.0-91/hadoop-yarn/lib/httpclient-4.5.2.jar:/usr/hdp/2.6.4.0-91/hadoop-yarn/lib/jcip-annotations-1.0.jar:/usr/hdp/2.6.4.0-91/hadoop-yarn/lib/paranamer-2.3.jar:/usr/hdp/2.6.4.0-91/hadoop-yarn/lib/jersey-server-1.9.jar:/usr/hdp/2.6.4.0-91/hadoop-yarn/lib/json-smart-1.1.1.jar:/usr/hdp/2.6.4.0-91/hadoop-yarn/lib/gson-2.2.4.jar:/usr/hdp/2.6.4.0-91/hadoop-yarn/lib/curator-framework-2.7.1.jar:/usr/hdp/2.6.4.0-91/hadoop-yarn/lib/zookeeper-3.4.6.2.6.4.0-91-tests.jar:/usr/hdp/2.6.4.0-91/hadoop-yarn/lib/jackson-core-2.2.3.jar:/usr/hdp/2.6.4.0-91/hadoop-yarn/lib/commons-math3-3.1.1.jar:/usr/hdp/2.6.4.0-91/hadoop-yarn/lib/metrics-core-3.0.1.jar:/usr/hdp/2.6.4.0-91/hadoop-yarn/lib/leveldbjni-all-1.8.jar:/usr/hdp/2.6.4.0-91/hadoop-yarn/lib/jetty-sslengine-6.1.26.hwx.jar:/usr/hdp/2.6.4.0-91/hadoop-yarn/lib/api-asn1-api-1.0.0-M20.jar:/usr/hdp/2.6.4.0-91/hadoop-yarn/lib/stax-api-1.0-2.jar:/usr/hdp/2.6.4.0-91/hadoop-yarn/lib/commons-configuration-1.6.jar:/usr/hdp/2.6.4.0-91/hadoop-yarn/.//hadoop-yarn-applications-distributedshell.jar:/usr/hdp/2.6.4.0-91/hadoop-yarn/.//hadoop-yarn-api-2.7.3.2.6.4.0-91.jar:/usr/hdp/2.6.4.0-91/hadoop-yarn/.//hadoop-yarn-client-2.7.3.2.6.4.0-91.jar:/usr/hdp/2.6.4.0-91/hadoop-yarn/.//hadoop-yarn-server-sharedcachemanager-2.7.3.2.6.4.0-91.jar:/usr/hdp/2.6.4.0-91/hadoop-yarn/.//hadoop-yarn-server-web-proxy-2.7.3.2.6.4.0-91.jar:/usr/hdp/2.6.4.0-91/hadoop-yarn/.//hadoop-yarn-applications-unmanaged-am-launcher-2.7.3.2.6.4.0-91.jar:/usr/hdp/2.6.4.0-91/hadoop-yarn/.//hadoop-yarn-server-timeline-pluginstorage.jar:/usr/hdp/2.6.4.0-91/hadoop-yarn/.//hadoop-yarn-server-resourcemanager.jar:/usr/hdp/2.6.4.0-91/hadoop-yarn/.//hadoop-yarn-server-tests-2.7.3.2.6.4.0-91.jar:/usr/hdp/2.6.4.0-91/hadoop-yarn/.//hadoop-yarn-common.jar:/usr/hdp/2.6.4.0-91/hadoop-yarn/.//hadoop-yarn-server-common-2.7.3.2.6.4.0-91.jar:/usr/hdp/2.6.4.0-91/hadoop-yarn/.//hadoop-yarn-server-tests.jar:/usr/hdp/2.6.4.0-91/hadoop-yarn/.//hadoop-yarn-applications-unmanaged-am-launcher.jar:/usr/hdp/2.6.4.0-91/hadoop-yarn/.//hadoop-yarn-server-sharedcachemanager.jar:/usr/hdp/2.6.4.0-91/hadoop-yarn/.//hadoop-yarn-applications-distributedshell-2.7.3.2.6.4.0-91.jar:/usr/hdp/2.6.4.0-91/hadoop-yarn/.//hadoop-yarn-server-common.jar:/usr/hdp/2.6.4.0-91/hadoop-yarn/.//hadoop-yarn-server-applicationhistoryservice.jar:/usr/hdp/2.6.4.0-91/hadoop-yarn/.//hadoop-yarn-registry-2.7.3.2.6.4.0-91.jar:/usr/hdp/2.6.4.0-91/hadoop-yarn/.//hadoop-yarn-api.jar:/usr/hdp/2.6.4.0-91/hadoop-yarn/.//hadoop-yarn-server-web-proxy.jar:/usr/hdp/2.6.4.0-91/hadoop-yarn/.//hadoop-yarn-server-timeline-pluginstorage-2.7.3.2.6.4.0-91.jar:/usr/hdp/2.6.4.0-91/hadoop-yarn/.//hadoop-yarn-client.jar:/usr/hdp/2.6.4.0-91/hadoop-yarn/.//hadoop-yarn-server-applicationhistoryservice-2.7.3.2.6.4.0-91.jar:/usr/hdp/2.6.4.0-91/hadoop-yarn/.//hadoop-yarn-common-2.7.3.2.6.4.0-91.jar:/usr/hdp/2.6.4.0-91/hadoop-yarn/.//hadoop-yarn-server-resourcemanager-2.7.3.2.6.4.0-91.jar:/usr/hdp/2.6.4.0-91/hadoop-yarn/.//hadoop-yarn-registry.jar:/usr/hdp/2.6.4.0-91/hadoop-yarn/.//hadoop-yarn-server-nodemanager-2.7.3.2.6.4.0-91.jar:/usr/hdp/2.6.4.0-91/hadoop-yarn/.//hadoop-yarn-server-nodemanager.jar:/usr/hdp/2.6.4.0-91/hadoop-mapreduce/lib/jackson-mapper-asl-1.9.13.jar:/usr/hdp/2.6.4.0-91/hadoop-mapreduce/lib/aopalliance-1.0.jar:/usr/hdp/2.6.4.0-91/hadoop-mapreduce/lib/javax.inject-1.jar:/usr/hdp/2.6.4.0-91/hadoop-mapreduce/lib/jersey-guice-1.9.jar:/usr/hdp/2.6.4.0-91/hadoop-mapreduce/lib/xz-1.0.jar:/usr/hdp/2.6.4.0-91/hadoop-mapreduce/lib/jackson-core-asl-1.9.13.jar:/usr/hdp/2.6.4.0-91/hadoop-mapreduce/lib/commons-io-2.4.jar:/usr/hdp/2.6.4.0-91/hadoop-mapreduce/lib/asm-3.2.jar:/usr/hdp/2.6.4.0-91/hadoop-mapreduce/lib/snappy-java-1.0.4.1.jar:/usr/hdp/2.6.4.0-91/hadoop-mapreduce/lib/guice-3.0.jar:/usr/hdp/2.6.4.0-91/hadoop-mapreduce/lib/hamcrest-core-1.3.jar:/usr/hdp/2.6.4.0-91/hadoop-mapreduce/lib/guice-servlet-3.0.jar:/usr/hdp/2.6.4.0-91/hadoop-mapreduce/lib/commons-compress-1.4.1.jar:/usr/hdp/2.6.4.0-91/hadoop-mapreduce/lib/avro-1.7.4.jar:/usr/hdp/2.6.4.0-91/hadoop-mapreduce/lib/log4j-1.2.17.jar:/usr/hdp/2.6.4.0-91/hadoop-mapreduce/lib/netty-3.6.2.Final.jar:/usr/hdp/2.6.4.0-91/hadoop-mapreduce/lib/protobuf-java-2.5.0.jar:/usr/hdp/2.6.4.0-91/hadoop-mapreduce/lib/jersey-core-1.9.jar:/usr/hdp/2.6.4.0-91/hadoop-mapreduce/lib/junit-4.11.jar:/usr/hdp/2.6.4.0-91/hadoop-mapreduce/lib/paranamer-2.3.jar:/usr/hdp/2.6.4.0-91/hadoop-mapreduce/lib/jersey-server-1.9.jar:/usr/hdp/2.6.4.0-91/hadoop-mapreduce/lib/leveldbjni-all-1.8.jar:/usr/hdp/2.6.4.0-91/hadoop-mapreduce/.//hadoop-openstack-2.7.3.2.6.4.0-91.jar:/usr/hdp/2.6.4.0-91/hadoop-mapreduce/.//hadoop-sls.jar:/usr/hdp/2.6.4.0-91/hadoop-mapreduce/.//guava-11.0.2.jar:/usr/hdp/2.6.4.0-91/hadoop-mapreduce/.//hadoop-auth-2.7.3.2.6.4.0-91.jar:/usr/hdp/2.6.4.0-91/hadoop-mapreduce/.//hadoop-ant.jar:/usr/hdp/2.6.4.0-91/hadoop-mapreduce/.//jackson-mapper-asl-1.9.13.jar:/usr/hdp/2.6.4.0-91/hadoop-mapreduce/.//jsr305-3.0.0.jar:/usr/hdp/2.6.4.0-91/hadoop-mapreduce/.//hadoop-mapreduce-client-core-2.7.3.2.6.4.0-91.jar:/usr/hdp/2.6.4.0-91/hadoop-mapreduce/.//commons-logging-1.1.3.jar:/usr/hdp/2.6.4.0-91/hadoop-mapreduce/.//hadoop-mapreduce-examples.jar:/usr/hdp/2.6.4.0-91/hadoop-mapreduce/.//jets3t-0.9.0.jar:/usr/hdp/2.6.4.0-91/hadoop-mapreduce/.//hadoop-mapreduce-client-hs-2.7.3.2.6.4.0-91.jar:/usr/hdp/2.6.4.0-91/hadoop-mapreduce/.//hadoop-mapreduce-client-shuffle-2.7.3.2.6.4.0-91.jar:/usr/hdp/2.6.4.0-91/hadoop-mapreduce/.//hadoop-datajoin.jar:/usr/hdp/2.6.4.0-91/hadoop-mapreduce/.//hadoop-rumen.jar:/usr/hdp/2.6.4.0-91/hadoop-mapreduce/.//zookeeper-3.4.6.2.6.4.0-91.jar:/usr/hdp/2.6.4.0-91/hadoop-mapreduce/.//jackson-xc-1.9.13.jar:/usr/hdp/2.6.4.0-91/hadoop-mapreduce/.//hadoop-mapreduce-client-hs.jar:/usr/hdp/2.6.4.0-91/hadoop-mapreduce/.//hadoop-mapreduce-client-jobclient.jar:/usr/hdp/2.6.4.0-91/hadoop-mapreduce/.//hadoop-datajoin-2.7.3.2.6.4.0-91.jar:/usr/hdp/2.6.4.0-91/hadoop-mapreduce/.//okhttp-2.4.0.jar:/usr/hdp/2.6.4.0-91/hadoop-mapreduce/.//hadoop-mapreduce-client-common.jar:/usr/hdp/2.6.4.0-91/hadoop-mapreduce/.//hadoop-rumen-2.7.3.2.6.4.0-91.jar:/usr/hdp/2.6.4.0-91/hadoop-mapreduce/.//curator-client-2.7.1.jar:/usr/hdp/2.6.4.0-91/hadoop-mapreduce/.//hadoop-mapreduce-client-shuffle.jar:/usr/hdp/2.6.4.0-91/hadoop-mapreduce/.//xz-1.0.jar:/usr/hdp/2.6.4.0-91/hadoop-mapreduce/.//hadoop-mapreduce-client-hs-plugins-2.7.3.2.6.4.0-91.jar:/usr/hdp/2.6.4.0-91/hadoop-mapreduce/.//hadoop-mapreduce-client-core.jar:/usr/hdp/2.6.4.0-91/hadoop-mapreduce/.//jsp-api-2.1.jar:/usr/hdp/2.6.4.0-91/hadoop-mapreduce/.//httpcore-4.4.4.jar:/usr/hdp/2.6.4.0-91/hadoop-mapreduce/.//jackson-jaxrs-1.9.13.jar:/usr/hdp/2.6.4.0-91/hadoop-mapreduce/.//azure-keyvault-core-0.8.0.jar:/usr/hdp/2.6.4.0-91/hadoop-mapreduce/.//nimbus-jose-jwt-3.9.jar:/usr/hdp/2.6.4.0-91/hadoop-mapreduce/.//jackson-core-asl-1.9.13.jar:/usr/hdp/2.6.4.0-91/hadoop-mapreduce/.//hadoop-gridmix.jar:/usr/hdp/2.6.4.0-91/hadoop-mapreduce/.//hadoop-extras-2.7.3.2.6.4.0-91.jar:/usr/hdp/2.6.4.0-91/hadoop-mapreduce/.//commons-codec-1.4.jar:/usr/hdp/2.6.4.0-91/hadoop-mapreduce/.//commons-digester-1.8.jar:/usr/hdp/2.6.4.0-91/hadoop-mapreduce/.//commons-io-2.4.jar:/usr/hdp/2.6.4.0-91/hadoop-mapreduce/.//curator-recipes-2.7.1.jar:/usr/hdp/2.6.4.0-91/hadoop-mapreduce/.//xmlenc-0.52.jar:/usr/hdp/2.6.4.0-91/hadoop-mapreduce/.//commons-lang3-3.4.jar:/usr/hdp/2.6.4.0-91/hadoop-mapreduce/.//okio-1.4.0.jar:/usr/hdp/2.6.4.0-91/hadoop-mapreduce/.//hadoop-mapreduce-client-jobclient-2.7.3.2.6.4.0-91-tests.jar:/usr/hdp/2.6.4.0-91/hadoop-mapreduce/.//jetty-util-6.1.26.hwx.jar:/usr/hdp/2.6.4.0-91/hadoop-mapreduce/.//java-xmlbuilder-0.4.jar:/usr/hdp/2.6.4.0-91/hadoop-mapreduce/.//asm-3.2.jar:/usr/hdp/2.6.4.0-91/hadoop-mapreduce/.//hadoop-sls-2.7.3.2.6.4.0-91.jar:/usr/hdp/2.6.4.0-91/hadoop-mapreduce/.//snappy-java-1.0.4.1.jar:/usr/hdp/2.6.4.0-91/hadoop-mapreduce/.//mockito-all-1.8.5.jar:/usr/hdp/2.6.4.0-91/hadoop-mapreduce/.//api-util-1.0.0-M20.jar:/usr/hdp/2.6.4.0-91/hadoop-mapreduce/.//jetty-6.1.26.hwx.jar:/usr/hdp/2.6.4.0-91/hadoop-mapreduce/.//hadoop-mapreduce-client-jobclient-2.7.3.2.6.4.0-91.jar:/usr/hdp/2.6.4.0-91/hadoop-mapreduce/.//hadoop-mapreduce-client-app-2.7.3.2.6.4.0-91.jar:/usr/hdp/2.6.4.0-91/hadoop-mapreduce/.//jaxb-impl-2.2.3-1.jar:/usr/hdp/2.6.4.0-91/hadoop-mapreduce/.//hamcrest-core-1.3.jar:/usr/hdp/2.6.4.0-91/hadoop-mapreduce/.//jettison-1.1.jar:/usr/hdp/2.6.4.0-91/hadoop-mapreduce/.//jsch-0.1.54.jar:/usr/hdp/2.6.4.0-91/hadoop-mapreduce/.//commons-compress-1.4.1.jar:/usr/hdp/2.6.4.0-91/hadoop-mapreduce/.//commons-httpclient-3.1.jar:/usr/hdp/2.6.4.0-91/hadoop-mapreduce/.//avro-1.7.4.jar:/usr/hdp/2.6.4.0-91/hadoop-mapreduce/.//activation-1.1.jar:/usr/hdp/2.6.4.0-91/hadoop-mapreduce/.//log4j-1.2.17.jar:/usr/hdp/2.6.4.0-91/hadoop-mapreduce/.//jersey-json-1.9.jar:/usr/hdp/2.6.4.0-91/hadoop-mapreduce/.//hadoop-auth.jar:/usr/hdp/2.6.4.0-91/hadoop-mapreduce/.//netty-3.6.2.Final.jar:/usr/hdp/2.6.4.0-91/hadoop-mapreduce/.//commons-net-3.1.jar:/usr/hdp/2.6.4.0-91/hadoop-mapreduce/.//hadoop-streaming-2.7.3.2.6.4.0-91.jar:/usr/hdp/2.6.4.0-91/hadoop-mapreduce/.//hadoop-archives.jar:/usr/hdp/2.6.4.0-91/hadoop-mapreduce/.//apacheds-i18n-2.0.0-M15.jar:/usr/hdp/2.6.4.0-91/hadoop-mapreduce/.//hadoop-archives-2.7.3.2.6.4.0-91.jar:/usr/hdp/2.6.4.0-91/hadoop-mapreduce/.//commons-beanutils-core-1.8.0.jar:/usr/hdp/2.6.4.0-91/hadoop-mapreduce/.//hadoop-mapreduce-examples-2.7.3.2.6.4.0-91.jar:/usr/hdp/2.6.4.0-91/hadoop-mapreduce/.//apacheds-kerberos-codec-2.0.0-M15.jar:/usr/hdp/2.6.4.0-91/hadoop-mapreduce/.//hadoop-gridmix-2.7.3.2.6.4.0-91.jar:/usr/hdp/2.6.4.0-91/hadoop-mapreduce/.//hadoop-mapreduce-client-hs-plugins.jar:/usr/hdp/2.6.4.0-91/hadoop-mapreduce/.//servlet-api-2.5.jar:/usr/hdp/2.6.4.0-91/hadoop-mapreduce/.//protobuf-java-2.5.0.jar:/usr/hdp/2.6.4.0-91/hadoop-mapreduce/.//jersey-core-1.9.jar:/usr/hdp/2.6.4.0-91/hadoop-mapreduce/.//hadoop-mapreduce-client-common-2.7.3.2.6.4.0-91.jar:/usr/hdp/2.6.4.0-91/hadoop-mapreduce/.//commons-lang-2.6.jar:/usr/hdp/2.6.4.0-91/hadoop-mapreduce/.//commons-cli-1.2.jar:/usr/hdp/2.6.4.0-91/hadoop-mapreduce/.//junit-4.11.jar:/usr/hdp/2.6.4.0-91/hadoop-mapreduce/.//hadoop-openstack.jar:/usr/hdp/2.6.4.0-91/hadoop-mapreduce/.//jaxb-api-2.2.2.jar:/usr/hdp/2.6.4.0-91/hadoop-mapreduce/.//htrace-core-3.1.0-incubating.jar:/usr/hdp/2.6.4.0-91/hadoop-mapreduce/.//hadoop-extras.jar:/usr/hdp/2.6.4.0-91/hadoop-mapreduce/.//commons-beanutils-1.7.0.jar:/usr/hdp/2.6.4.0-91/hadoop-mapreduce/.//commons-collections-3.2.2.jar:/usr/hdp/2.6.4.0-91/hadoop-mapreduce/.//hadoop-mapreduce-client-app.jar:/usr/hdp/2.6.4.0-91/hadoop-mapreduce/.//httpclient-4.5.2.jar:/usr/hdp/2.6.4.0-91/hadoop-mapreduce/.//jcip-annotations-1.0.jar:/usr/hdp/2.6.4.0-91/hadoop-mapreduce/.//hadoop-distcp-2.7.3.2.6.4.0-91.jar:/usr/hdp/2.6.4.0-91/hadoop-mapreduce/.//paranamer-2.3.jar:/usr/hdp/2.6.4.0-91/hadoop-mapreduce/.//jersey-server-1.9.jar:/usr/hdp/2.6.4.0-91/hadoop-mapreduce/.//hadoop-mapreduce-client-jobclient-tests.jar:/usr/hdp/2.6.4.0-91/hadoop-mapreduce/.//json-smart-1.1.1.jar:/usr/hdp/2.6.4.0-91/hadoop-mapreduce/.//gson-2.2.4.jar:/usr/hdp/2.6.4.0-91/hadoop-mapreduce/.//hadoop-distcp.jar:/usr/hdp/2.6.4.0-91/hadoop-mapreduce/.//curator-framework-2.7.1.jar:/usr/hdp/2.6.4.0-91/hadoop-mapreduce/.//hadoop-ant-2.7.3.2.6.4.0-91.jar:/usr/hdp/2.6.4.0-91/hadoop-mapreduce/.//commons-math3-3.1.1.jar:/usr/hdp/2.6.4.0-91/hadoop-mapreduce/.//hadoop-streaming.jar:/usr/hdp/2.6.4.0-91/hadoop-mapreduce/.//metrics-core-3.0.1.jar:/usr/hdp/2.6.4.0-91/hadoop-mapreduce/.//jetty-sslengine-6.1.26.hwx.jar:/usr/hdp/2.6.4.0-91/hadoop-mapreduce/.//api-asn1-api-1.0.0-M20.jar:/usr/hdp/2.6.4.0-91/hadoop-mapreduce/.//stax-api-1.0-2.jar:/usr/hdp/2.6.4.0-91/hadoop-mapreduce/.//commons-configuration-1.6.jar:/usr/hdp/2.6.4.0-91/tez/tez-examples-0.7.0.2.6.4.0-91.jar:/usr/hdp/2.6.4.0-91/tez/tez-dag-0.7.0.2.6.4.0-91.jar:/usr/hdp/2.6.4.0-91/tez/tez-api-0.7.0.2.6.4.0-91.jar:/usr/hdp/2.6.4.0-91/tez/tez-yarn-timeline-cache-plugin-0.7.0.2.6.4.0-91.jar:/usr/hdp/2.6.4.0-91/tez/tez-runtime-internals-0.7.0.2.6.4.0-91.jar:/usr/hdp/2.6.4.0-91/tez/tez-runtime-library-0.7.0.2.6.4.0-91.jar:/usr/hdp/2.6.4.0-91/tez/tez-tests-0.7.0.2.6.4.0-91.jar:/usr/hdp/2.6.4.0-91/tez/tez-yarn-timeline-history-0.7.0.2.6.4.0-91.jar:/usr/hdp/2.6.4.0-91/tez/tez-yarn-timeline-history-with-acls-0.7.0.2.6.4.0-91.jar:/usr/hdp/2.6.4.0-91/tez/tez-history-parser-0.7.0.2.6.4.0-91.jar:/usr/hdp/2.6.4.0-91/tez/tez-yarn-timeline-history-with-fs-0.7.0.2.6.4.0-91.jar:/usr/hdp/2.6.4.0-91/tez/tez-common-0.7.0.2.6.4.0-91.jar:/usr/hdp/2.6.4.0-91/tez/tez-mapreduce-0.7.0.2.6.4.0-91.jar:/usr/hdp/2.6.4.0-91/tez/tez-job-analyzer-0.7.0.2.6.4.0-91.jar:/usr/hdp/2.6.4.0-91/tez/lib/guava-11.0.2.jar:/usr/hdp/2.6.4.0-91/tez/lib/hadoop-mapreduce-client-core-2.7.3.2.6.4.0-91.jar:/usr/hdp/2.6.4.0-91/tez/lib/hadoop-annotations-2.7.3.2.6.4.0-91.jar:/usr/hdp/2.6.4.0-91/tez/lib/metrics-core-3.1.0.jar:/usr/hdp/2.6.4.0-91/tez/lib/jettison-1.3.4.jar:/usr/hdp/2.6.4.0-91/tez/lib/jsr305-2.0.3.jar:/usr/hdp/2.6.4.0-91/tez/lib/hadoop-azure-2.7.3.2.6.4.0-91.jar:/usr/hdp/2.6.4.0-91/tez/lib/jersey-client-1.9.jar:/usr/hdp/2.6.4.0-91/tez/lib/hadoop-yarn-server-web-proxy-2.7.3.2.6.4.0-91.jar:/usr/hdp/2.6.4.0-91/tez/lib/commons-codec-1.4.jar:/usr/hdp/2.6.4.0-91/tez/lib/commons-io-2.4.jar:/usr/hdp/2.6.4.0-91/tez/lib/hadoop-azure-datalake-2.7.3.2.6.4.0-91.jar:/usr/hdp/2.6.4.0-91/tez/lib/jetty-util-6.1.26.hwx.jar:/usr/hdp/2.6.4.0-91/tez/lib/jetty-6.1.26.hwx.jar:/usr/hdp/2.6.4.0-91/tez/lib/commons-collections4-4.1.jar:/usr/hdp/2.6.4.0-91/tez/lib/jersey-json-1.9.jar:/usr/hdp/2.6.4.0-91/tez/lib/hadoop-aws-2.7.3.2.6.4.0-91.jar:/usr/hdp/2.6.4.0-91/tez/lib/servlet-api-2.5.jar:/usr/hdp/2.6.4.0-91/tez/lib/protobuf-java-2.5.0.jar:/usr/hdp/2.6.4.0-91/tez/lib/hadoop-mapreduce-client-common-2.7.3.2.6.4.0-91.jar:/usr/hdp/2.6.4.0-91/tez/lib/commons-lang-2.6.jar:/usr/hdp/2.6.4.0-91/tez/lib/commons-cli-1.2.jar:/usr/hdp/2.6.4.0-91/tez/lib/hadoop-yarn-server-timeline-pluginstorage-2.7.3.2.6.4.0-91.jar:/usr/hdp/2.6.4.0-91/tez/lib/azure-data-lake-store-sdk-2.1.4.jar:/usr/hdp/2.6.4.0-91/tez/lib/commons-collections-3.2.2.jar:/usr/hdp/2.6.4.0-91/tez/lib/slf4j-api-1.7.5.jar:/usr/hdp/2.6.4.0-91/tez/lib/commons-math3-3.1.1.jar:/usr/hdp/2.6.4.0-91/tez/conf
2018-03-08 04:41:38,796 INFO [main]: zookeeper.ZooKeeper (Environment.java:logEnv(100)) - Client environment:java.library.path=:/usr/hdp/2.6.4.0-91/hadoop/lib/native/Linux-amd64-64:/usr/hdp/2.6.4.0-91/hadoop/lib/native/Linux-amd64-64:/usr/hdp/2.6.4.0-91/hadoop/lib/native
2018-03-08 04:41:38,796 INFO [main]: zookeeper.ZooKeeper (Environment.java:logEnv(100)) - Client environment:java.io.tmpdir=/tmp
2018-03-08 04:41:38,796 INFO [main]: zookeeper.ZooKeeper (Environment.java:logEnv(100)) - Client environment:java.compiler=<NA>
2018-03-08 04:41:38,796 INFO [main]: zookeeper.ZooKeeper (Environment.java:logEnv(100)) - Client environment:os.name=Linux
2018-03-08 04:41:38,796 INFO [main]: zookeeper.ZooKeeper (Environment.java:logEnv(100)) - Client environment:os.arch=amd64
2018-03-08 04:41:38,797 INFO [main]: zookeeper.ZooKeeper (Environment.java:logEnv(100)) - Client environment:os.version=4.9.77-31.58.amzn1.x86_64
2018-03-08 04:41:38,797 INFO [main]: zookeeper.ZooKeeper (Environment.java:logEnv(100)) - Client environment:user.name=hive
2018-03-08 04:41:38,797 INFO [main]: zookeeper.ZooKeeper (Environment.java:logEnv(100)) - Client environment:user.home=/home/hive
2018-03-08 04:41:38,797 INFO [main]: zookeeper.ZooKeeper (Environment.java:logEnv(100)) - Client environment:user.dir=/home/hive
2018-03-08 04:41:38,798 INFO [main]: zookeeper.ZooKeeper (ZooKeeper.java:<init>(438)) - Initiating client connection, connectString=ip-10-0-91-7.ap-northeast-2.compute.internal:2181 sessionTimeout=1200000 watcher=org.apache.curator.ConnectionState@774d8276
2018-03-08 04:41:38,815 INFO [main-SendThread(ip-10-0-91-7.ap-northeast-2.compute.internal:2181)]: zookeeper.ClientCnxn (ClientCnxn.java:logStartConnect(1019)) - Opening socket connection to server ip-10-0-91-7.ap-northeast-2.compute.internal/10.0.91.7:2181. Will not attempt to authenticate using SASL (unknown error)
2018-03-08 04:41:38,817 INFO [main-SendThread(ip-10-0-91-7.ap-northeast-2.compute.internal:2181)]: zookeeper.ClientCnxn (ClientCnxn.java:primeConnection(864)) - Socket connection established, initiating session, client: /10.0.91.7:52236, server: ip-10-0-91-7.ap-northeast-2.compute.internal/10.0.91.7:2181
2018-03-08 04:41:38,824 INFO [main-SendThread(ip-10-0-91-7.ap-northeast-2.compute.internal:2181)]: zookeeper.ClientCnxn (ClientCnxn.java:onConnected(1279)) - Session establishment complete on server ip-10-0-91-7.ap-northeast-2.compute.internal/10.0.91.7:2181, sessionid = 0x16203aad5af0040, negotiated timeout = 60000
2018-03-08 04:41:38,828 INFO [main-EventThread]: state.ConnectionStateManager (ConnectionStateManager.java:postState(228)) - State change: CONNECTED
2018-03-08 04:41:38,935 WARN [Thread-12]: thrift.ThriftCLIService (ThriftHttpCLIService.java:run(138)) - XSRF filter disabled
2018-03-08 04:41:38,944 INFO [Thread-12]: server.Server (Server.java:doStart(252)) - jetty-7.6.0.v20120127
2018-03-08 04:41:38,974 INFO [Thread-12]: handler.ContextHandler (ContextHandler.java:startContext(737)) - started o.e.j.s.ServletContextHandler{/,null}
2018-03-08 04:41:38,982 INFO [Thread-12]: server.AbstractConnector (AbstractConnector.java:doStart(333)) - Started SelectChannelConnector@0.0.0.0:10001
2018-03-08 04:41:38,982 INFO [Thread-12]: thrift.ThriftCLIService (ThriftHttpCLIService.java:run(152)) - Started ThriftHttpCLIService in http mode on port 10001 path=/cliservice/* with 5...500 worker threads
2018-03-08 04:41:39,855 INFO [main]: server.HiveServer2 (HiveServer2.java:addServerInstanceToZooKeeper(256)) - Created a znode on ZooKeeper for HiveServer2 uri: ip-10-0-91-7.ap-northeast-2.compute.internal:10001
2018-03-08 04:41:39,863 INFO [main]: tez.TezSessionPoolManager (TezSessionPoolManager.java:setupPool(107)) - Created new tez session for queue: default with session id: b73e644b-7850-4833-b6da-b308cdf5204b
2018-03-08 04:41:39,864 INFO [main]: tez.TezSessionState (TezSessionState.java:open(129)) - Opening the session with id b73e644b-7850-4833-b6da-b308cdf5204b for thread main log trace id - query id - 
2018-03-08 04:41:39,865 INFO [main]: tez.TezSessionState (TezSessionState.java:open(145)) - User of session id b73e644b-7850-4833-b6da-b308cdf5204b is hive
2018-03-08 04:41:39,874 INFO [main]: tez.DagUtils (DagUtils.java:localizeResource(974)) - Localizing resource because it does not exist: file:/usr/hdp/current/hive-webhcat/share/hcatalog/hive-hcatalog-core.jar to dest: hdfs://ip-10-0-91-7.ap-northeast-2.compute.internal:8020/tmp/hive/hive/_tez_session_dir/b73e644b-7850-4833-b6da-b308cdf5204b/hive-hcatalog-core.jar
2018-03-08 04:41:40,074 INFO [main]: tez.DagUtils (DagUtils.java:createLocalResource(724)) - Resource modification time: 1520484100034
2018-03-08 04:41:40,148 INFO [main]: tez.DagUtils (DagUtils.java:getHiveJarDirectory(898)) - Jar dir is null/directory doesn't exist. Choosing HIVE_INSTALL_DIR - /user/hive/.hiveJars
2018-03-08 04:41:40,386 INFO [main]: tez.DagUtils (DagUtils.java:createLocalResource(724)) - Resource modification time: 1520479600906
2018-03-08 04:41:40,485 INFO [main]: client.TezClient (TezClient.java:<init>(177)) - Tez Client Version: [ component=tez-api, version=0.7.0.2.6.4.0-91, revision=0daef967e122a98f83b824f3b14991e792f5dd4d, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=2018-01-04T10:40:50Z ]
2018-03-08 04:41:40,486 INFO [main]: tez.TezSessionState (TezSessionState.java:open(193)) - Opening new Tez Session (id: b73e644b-7850-4833-b6da-b308cdf5204b, scratch dir: hdfs://ip-10-0-91-7.ap-northeast-2.compute.internal:8020/tmp/hive/hive/_tez_session_dir/b73e644b-7850-4833-b6da-b308cdf5204b)
2018-03-08 04:41:40,539 INFO [main]: client.RMProxy (RMProxy.java:newProxyInstance(125)) - Connecting to ResourceManager at ip-10-0-91-7.ap-northeast-2.compute.internal/10.0.91.7:8050
2018-03-08 04:41:40,657 INFO [main]: client.AHSProxy (AHSProxy.java:createAHSProxy(42)) - Connecting to Application History server at ip-10-0-91-7.ap-northeast-2.compute.internal/10.0.91.7:10200
2018-03-08 04:41:40,661 INFO [main]: client.TezClient (TezClient.java:start(351)) - Session mode. Starting session.
2018-03-08 04:41:40,664 INFO [main]: client.TezClientUtils (TezClientUtils.java:setupTezJarsLocalResources(173)) - Using tez.lib.uris value from configuration: /hdp/apps/2.6.4.0-91/tez/tez.tar.gz
2018-03-08 04:41:40,698 INFO [main]: client.TezClient (TezCommonUtils.java:createTezSystemStagingPath(122)) - Tez system stage directory hdfs://ip-10-0-91-7.ap-northeast-2.compute.internal:8020/tmp/hive/hive/_tez_session_dir/b73e644b-7850-4833-b6da-b308cdf5204b/.tez/application_1520480101488_0046 doesn't exist and is created
2018-03-08 04:41:40,815 INFO [main]: impl.YarnClientImpl (YarnClientImpl.java:submitApplication(274)) - Submitted application application_1520480101488_0046
2018-03-08 04:41:40,817 INFO [main]: client.TezClient (TezClient.java:start(385)) - The url to track the Tez Session: http://ip-10-0-91-7.ap-northeast-2.compute.internal:8088/proxy/application_1520480101488_0046/
2018-03-08 04:41:43,325 INFO [main]: client.TezClient (TezClient.java:getAppMasterStatus(606)) - App did not succeed. Diagnostics: Application application_1520480101488_0046 failed 2 times due to AM Container for appattempt_1520480101488_0046_000002 exited with exitCode: -1000
For more detailed output, check the application tracking page: http://ip-10-0-91-7.ap-northeast-2.compute.internal:8088/cluster/app/application_1520480101488_0046 Then click on links to logs of each attempt.
Diagnostics: ExitCodeException exitCode=2: tar: Removing leading `/' from member names
tar: Skipping to next header
gzip: /hadoopfs/fs1/yarn/nodemanager/filecache/60_tmp/tmp_tez.tar.gz: invalid compressed data--format violated
tar: Exiting with failure status due to previous errors
Failing this attempt. Failing the application.
2018-03-08 04:41:43,325 INFO [main]: server.HiveServer2 (HiveServer2.java:stop(405)) - Shutting down HiveServer2
2018-03-08 04:41:43,336 INFO [main]: handler.ContextHandler (ContextHandler.java:doStop(788)) - stopped o.e.j.s.ServletContextHandler{/,null}
2018-03-08 04:41:43,337 INFO [main]: thrift.ThriftCLIService (ThriftCLIService.java:stop(226)) - Http server has stopped
2018-03-08 04:41:43,337 INFO [main]: service.AbstractService (AbstractService.java:stop(125)) - Service:ThriftHttpCLIService is stopped.
2018-03-08 04:41:43,337 INFO [main]: service.AbstractService (AbstractService.java:stop(125)) - Service:OperationManager is stopped.
2018-03-08 04:41:43,337 INFO [main]: service.AbstractService (AbstractService.java:stop(125)) - Service:SessionManager is stopped.
2018-03-08 04:41:53,338 INFO [main]: service.AbstractService (AbstractService.java:stop(125)) - Service:CLIService is stopped.
2018-03-08 04:41:53,338 INFO [main]: metastore.HiveMetaStore (HiveMetaStore.java:logInfo(773)) - 0: Shutting down the object store...
2018-03-08 04:41:53,338 INFO [main]: HiveMetaStore.audit (HiveMetaStore.java:logAuditEvent(317)) - ugi=hive ip=unknown-ip-addr cmd=Shutting down the object store... 
2018-03-08 04:41:53,338 INFO [main]: metastore.HiveMetaStore (HiveMetaStore.java:logInfo(773)) - 0: Metastore shutdown complete.
2018-03-08 04:41:53,339 INFO [main]: HiveMetaStore.audit (HiveMetaStore.java:logAuditEvent(317)) - ugi=hive ip=unknown-ip-addr cmd=Metastore shutdown complete. 
2018-03-08 04:41:53,339 INFO [main]: service.AbstractService (AbstractService.java:stop(125)) - Service:HiveServer2 is stopped.
2018-03-08 04:41:53,344 WARN [main-EventThread]: server.HiveServer2 (HiveServer2.java:process(335)) - This HiveServer2 instance is now de-registered from ZooKeeper. The server will be shut down after the last client sesssion completes.
2018-03-08 04:41:53,345 WARN [main-EventThread]: server.HiveServer2 (HiveServer2.java:process(343)) - This instance of HiveServer2 has been removed from the list of server instances available for dynamic service discovery. The last client session has ended - will shutdown now.
2018-03-08 04:41:53,347 INFO [main]: zookeeper.ZooKeeper (ZooKeeper.java:close(684)) - Session: 0x16203aad5af0040 closed
2018-03-08 04:41:53,347 INFO [main]: server.HiveServer2 (HiveServer2.java:removeServerInstanceFromZooKeeper(361)) - Server instance removed from ZooKeeper.
2018-03-08 04:41:53,348 INFO [main-EventThread]: server.HiveServer2 (HiveServer2.java:stop(405)) - Shutting down HiveServer2
2018-03-08 04:41:53,348 INFO [main-EventThread]: server.HiveServer2 (HiveServer2.java:removeServerInstanceFromZooKeeper(361)) - Server instance removed from ZooKeeper.
2018-03-08 04:41:53,348 INFO [main-EventThread]: zookeeper.ClientCnxn (ClientCnxn.java:run(524)) - EventThread shut down
2018-03-08 04:41:53,348 WARN [main]: server.HiveServer2 (HiveServer2.java:startHiveServer2(508)) - Error starting HiveServer2 on attempt 1, will retry in 60 seconds
org.apache.tez.dag.api.SessionNotRunning: TezSession has already shutdown. Application application_1520480101488_0046 failed 2 times due to AM Container for appattempt_1520480101488_0046_000002 exited with exitCode: -1000
For more detailed output, check the application tracking page: http://ip-10-0-91-7.ap-northeast-2.compute.internal:8088/cluster/app/application_1520480101488_0046 Then click on links to logs of each attempt.
Diagnostics: ExitCodeException exitCode=2: tar: Removing leading `/' from member names
tar: Skipping to next header
gzip: /hadoopfs/fs1/yarn/nodemanager/filecache/60_tmp/tmp_tez.tar.gz: invalid compressed data--format violated
tar: Exiting with failure status due to previous errors
Failing this attempt. Failing the application.
at org.apache.tez.client.TezClient.waitTillReady(TezClient.java:699)
at org.apache.hadoop.hive.ql.exec.tez.TezSessionState.open(TezSessionState.java:218)
at org.apache.hadoop.hive.ql.exec.tez.TezSessionState.open(TezSessionState.java:116)
at org.apache.hadoop.hive.ql.exec.tez.TezSessionPoolManager.startPool(TezSessionPoolManager.java:76)
at org.apache.hive.service.server.HiveServer2.startHiveServer2(HiveServer2.java:488)
at org.apache.hive.service.server.HiveServer2.access$700(HiveServer2.java:87)
at org.apache.hive.service.server.HiveServer2$StartOptionExecutor.execute(HiveServer2.java:720)
at org.apache.hive.service.server.HiveServer2.main(HiveServer2.java:593)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.apache.hadoop.util.RunJar.run(RunJar.java:233)
at org.apache.hadoop.util.RunJar.main(RunJar.java:148)

[#2 · Accepted solution]

@Soungno Kim

Looks like the cause of failure is the following error.

Diagnostics: ExitCodeException exitCode=2: tar: Removing leading `/' from member names
tar: Skipping to next header
gzip: /hadoopfs/fs1/yarn/nodemanager/filecache/60_tmp/tmp_tez.tar.gz: invalid compressed data--format violated

Can you please check if you are able to untar that file manually? (this is to verify if the tar archive is actually corrupted or not?)

I am suspecting that the archive "/hadoopfs/fs1/yarn/nodemanager/filecache/60_tmp/tmp_tez.tar.gz" is corrupted. So can you please try clearing the filecache dir and then try again.

.