Hello, I am trying to execute phoenix queries from oozie using java action and I am facing kinit issues. Please note if I run this java code standalone ( without using oozie ), it works fine, however, issue is faced while running from oozie java action. Below is my sample java code to use phoenix jdbc. UserGroupInformation.setConfiguration(configuration); UserGroupInformation.loginUserFromKeytab("exm_qa@ABC.VIBGYOR.COM","/etc/security/keytabs/exm_qa.headless.keytab"); Class.forName("org.apache.phoenix.jdbc.PhoenixDriver"); conn = DriverManager.getConnection("jdbc:phoenix:santhosh-blueprint-test-13.XXX:2181:/hbase-secure"); System.out.println("got connection"); Statement statement = conn.createStatement(); Below is how the oozie workflow action XML is defined. <action name="java_query"> <java> <main-class>PhoenixQueryExecutor</main-class> <archive>/user/exm_qa/oozie/apps/shell/lib/original-phoenix-query-executor-1.0-SNAPSHOT.jar</archive> </java> <ok to="end"/> <error to="fail"/> </action> Below is the oozie job properties. I have placed the hbase-site.xml and phoenix-client.jar under oozie.libpath dir. oozie.use.system.libpath = true oozie.libpath=hdfs://chelsea/user/exm_qa/oozie/apps/shell/lib however it does logs below line, which means login was successful. 2016-11-05 18:01:25,380 INFO [main] org.apache.hadoop.security.UserGroupInformation: Login successful for user exm_qa@ABC.VIBGYOR.COM using keytab file /etc/security/keytabs/exm_qa.headless.keytab 2016-11-05 18:01:25,435 INFO [main] org.apache.hadoop.security.UserGroupInformation: Login successful for user exm_qa@ABC.VIBGYOR.COM using keytab file /etc/security/keytabs/exm_qa.headless.keytab Snippet of error . Complete error is here oozie-phoenix-java-action.txt 2016-11-05 18:01:35,848 FATAL [hconnection-0x236134a1-shared--pool1-t1] org.apache.hadoop.hbase.ipc.AbstractRpcClient: SASL authentication failed. The most likely cause is missing or invalid credentials. Consider 'kinit'. javax.security.sasl.SaslException: GSS initiate failed [Caused by GSSException: No valid credentials provided (Mechanism level: Failed to find any Kerberos tgt)] at com.sun.security.sasl.gsskerb.GssKrb5Client.evaluateChallenge(GssKrb5Client.java:211) at org.apache.hadoop.hbase.security.HBaseSaslRpcClient.saslConnect(HBaseSaslRpcClient.java:179) at org.apache.hadoop.hbase.ipc.RpcClientImpl$Connection.setupSaslConnection(RpcClientImpl.java:611) at org.apache.hadoop.hbase.ipc.RpcClientImpl$Connection.access$600(RpcClientImpl.java:156) at org.apache.hadoop.hbase.ipc.RpcClientImpl$Connection$2.run(RpcClientImpl.java:737) at org.apache.hadoop.hbase.ipc.RpcClientImpl$Connection$2.run(RpcClientImpl.java:734) at java.security.AccessController.doPrivileged(Native Method) ... View more

Hello, Below error is being thrown on performing csv bulk upload. any help here will be appreciated. [hbase@santhosh-blueprint-test-13 ~]$ hadoop jar /usr/hdp/current/phoenix-client/phoenix-client.jar org.apache.phoenix.mapreduce.CsvBulkLoadTool --table part --delimiter '|' -z santhosh-blueprint-test-11.XXX:/hbase-secure --input /tmp/santhosh/1/part.tbl 16/11/03 12:51:45 INFO mapreduce.AbstractBulkLoadTool: Configuring HBase connection to santhosh-blueprint-test-11.XXX:/hbase-secure 16/11/03 12:51:46 INFO util.QueryUtil: Creating connection with the jdbc url: jdbc:phoenix:santhosh-blueprint-test-11.XXX:2181:/hbase-secure; 16/11/03 12:51:47 INFO zookeeper.RecoverableZooKeeper: Process identifier=hconnection-0x4dc55105 connecting to ZooKeeper ensemble=santhosh-blueprint-test-11.XXX:2181 16/11/03 12:51:47 INFO zookeeper.ZooKeeper: Client environment:zookeeper.version=3.4.6-1245--1, built on 08/26/2016 00:47 GMT 16/11/03 12:51:47 INFO zookeeper.ZooKeeper: Client environment:host.name=santhosh-blueprint-test-13.XXX 16/11/03 12:51:47 INFO zookeeper.ZooKeeper: Client environment:java.version=1.8.0_77 16/11/03 12:51:47 INFO zookeeper.ZooKeeper: Client environment:java.vendor=Oracle Corporation 16/11/03 12:51:47 INFO zookeeper.ZooKeeper: Client environment:java.home=/usr/jdk64/jdk1.8.0_77/jre 16/11/03 12:51:47 INFO zookeeper.ZooKeeper: Client environment:java.class.path=/usr/hdp/2.5.0.0-1245/hadoop/conf:/usr/hdp/2.5.0.0-1245/hadoop/lib/commons-io-2.4.jar:/usr/hdp/2.5.0.0-1245/hadoop/lib/commons-beanutils-core-1.8.0.jar:/usr/hdp/2.5.0.0-1245/hadoop/lib/commons-digester-1.8.jar:/usr/hdp/2.5.0.0-1245/hadoop/lib/api-asn1-api-1.0.0-M20.jar:/usr/hdp/2.5.0.0-1245/hadoop/lib/jcip-annotations-1.0.jar:/usr/hdp/2.5.0.0-1245/hadoop/lib/jaxb-impl-2.2.3-1.jar:/usr/hdp/2.5.0.0-1245/hadoop/lib/ojdbc6.jar:/usr/hdp/2.5.0.0-1245/hadoop/lib/commons-lang-2.6.jar:/usr/hdp/2.5.0.0-1245/hadoop/lib/curator-client-2.7.1.jar:/usr/hdp/2.5.0.0-1245/hadoop/lib/jersey-json-1.9.jar:/usr/hdp/2.5.0.0-1245/hadoop/lib/jsr305-3.0.0.jar:/usr/hdp/2.5.0.0-1245/hadoop/lib/jersey-core-1.9.jar:/usr/hdp/2.5.0.0-1245/hadoop/lib/jettison-1.1.jar:/usr/hdp/2.5.0.0-1245/hadoop/lib/gson-2.2.4.jar:/usr/hdp/2.5.0.0-1245/hadoop/lib/zookeeper-3.4.6.2.5.0.0-1245.jar:/usr/hdp/2.5.0.0-1245/hadoop/lib/hamcrest-core-1.3.jar:/usr/hdp/2.5.0.0-1245/hadoop/lib/avro-1.7.4.jar:/usr/hdp/2.5.0.0-1245/hadoop/lib/httpclient-4.5.2.jar:/usr/hdp/2.5.0.0-1245/hadoop/lib/curator-framework-2.7.1.jar:/usr/hdp/2.5.0.0-1245/hadoop/lib/json-smart-1.1.1.jar:/usr/hdp/2.5.0.0-1245/hadoop/lib/snappy-java-1.0.4.1.jar:/usr/hdp/2.5.0.0-1245/hadoop/lib/jsp-api-2.1.jar:/usr/hdp/2.5.0.0-1245/hadoop/lib/ranger-yarn-plugin-shim-0.6.0.2.5.0.0-1245.jar:/usr/hdp/2.5.0.0-1245/hadoop/lib/slf4j-api-1.7.10.jar:/usr/hdp/2.5.0.0-1245/hadoop/lib/jackson-mapper-asl-1.9.13.jar:/usr/hdp/2.5.0.0-1245/hadoop/lib/commons-math3-3.1.1.jar:/usr/hdp/2.5.0.0-1245/hadoop/lib/nimbus-jose-jwt-3.9.jar:/usr/hdp/2.5.0.0-1245/hadoop/lib/commons-collections-3.2.2.jar:/usr/hdp/2.5.0.0-1245/hadoop/lib/commons-compress-1.4.1.jar:/usr/hdp/2.5.0.0-1245/hadoop/lib/htrace-core-3.1.0-incubating.jar:/usr/hdp/2.5.0.0-1245/hadoop/lib/aws-java-sdk-kms-1.10.6.jar:/usr/hdp/2.5.0.0-1245/hadoop/lib/commons-net-3.1.jar:/usr/hdp/2.5.0.0-1245/hadoop/lib/jersey-server-1.9.jar:/usr/hdp/2.5.0.0-1245/hadoop/lib/mockito-all-1.8.5.jar:/usr/hdp/2.5.0.0-1245/hadoop/lib/jackson-core-2.2.3.jar:/usr/hdp/2.5.0.0-1245/hadoop/lib/microsoft-windowsazure-storage-sdk-0.6.0.jar:/usr/hdp/2.5.0.0-1245/hadoop/lib/ranger-hdfs-plugin-shim-0.6.0.2.5.0.0-1245.jar:/usr/hdp/2.5.0.0-1245/hadoop/lib/slf4j-log4j12-1.7.10.jar:/usr/hdp/2.5.0.0-1245/hadoop/lib/api-util-1.0.0-M20.jar:/usr/hdp/2.5.0.0-1245/hadoop/lib/curator-recipes-2.7.1.jar:/usr/hdp/2.5.0.0-1245/hadoop/lib/stax-api-1.0-2.jar:/usr/hdp/2.5.0.0-1245/hadoop/lib/commons-codec-1.4.jar:/usr/hdp/2.5.0.0-1245/hadoop/lib/apacheds-kerberos-codec-2.0.0-M15.jar:/usr/hdp/2.5.0.0-1245/hadoop/lib/netty-3.6.2.Final.jar:/usr/hdp/2.5.0.0-1245/hadoop/lib/activation-1.1.jar:/usr/hdp/2.5.0.0-1245/hadoop/lib/asm-3.2.jar:/usr/hdp/2.5.0.0-1245/hadoop/lib/log4j-1.2.17.jar:/usr/hdp/2.5.0.0-1245/hadoop/lib/jackson-xc-1.9.13.jar:/usr/hdp/2.5.0.0-1245/hadoop/lib/jackson-databind-2.2.3.jar:/usr/hdp/2.5.0.0-1245/hadoop/lib/httpcore-4.4.4.jar:/usr/hdp/2.5.0.0-1245/hadoop/lib/jsch-0.1.42.jar:/usr/hdp/2.5.0.0-1245/hadoop/lib/protobuf-java-2.5.0.jar:/usr/hdp/2.5.0.0-1245/hadoop/lib/commons-beanutils-1.7.0.jar:/usr/hdp/2.5.0.0-1245/hadoop/lib/jackson-core-asl-1.9.13.jar:/usr/hdp/2.5.0.0-1245/hadoop/lib/paranamer-2.3.jar:/usr/hdp/2.5.0.0-1245/hadoop/lib/azure-storage-2.2.0.jar:/usr/hdp/2.5.0.0-1245/hadoop/lib/aws-java-sdk-core-1.10.6.jar:/usr/hdp/2.5.0.0-1245/hadoop/lib/xmlenc-0.52.jar:/usr/hdp/2.5.0.0-1245/hadoop/lib/jets3t-0.9.0.jar:/usr/hdp/2.5.0.0-1245/hadoop/lib/aws-java-sdk-s3-1.10.6.jar:/usr/hdp/2.5.0.0-1245/hadoop/lib/java-xmlbuilder-0.4.jar:/usr/hdp/2.5.0.0-1245/hadoop/lib/apacheds-i18n-2.0.0-M15.jar:/usr/hdp/2.5.0.0-1245/hadoop/lib/ranger-plugin-classloader-0.6.0.2.5.0.0-1245.jar:/usr/hdp/2.5.0.0-1245/hadoop/lib/jetty-util-6.1.26.hwx.jar:/usr/hdp/2.5.0.0-1245/hadoop/lib/jackson-annotations-2.2.3.jar:/usr/hdp/2.5.0.0-1245/hadoop/lib/jackson-jaxrs-1.9.13.jar:/usr/hdp/2.5.0.0-1245/hadoop/lib/jetty-6.1.26.hwx.jar:/usr/hdp/2.5.0.0-1245/hadoop/lib/guava-11.0.2.jar:/usr/hdp/2.5.0.0-1245/hadoop/lib/commons-configuration-1.6.jar:/usr/hdp/2.5.0.0-1245/hadoop/lib/jaxb-api-2.2.2.jar:/usr/hdp/2.5.0.0-1245/hadoop/lib/junit-4.11.jar:/usr/hdp/2.5.0.0-1245/hadoop/lib/commons-cli-1.2.jar:/usr/hdp/2.5.0.0-1245/hadoop/lib/servlet-api-2.5.jar:/usr/hdp/2.5.0.0-1245/hadoop/lib/joda-time-2.8.1.jar:/usr/hdp/2.5.0.0-1245/hadoop/lib/commons-logging-1.1.3.jar:/usr/hdp/2.5.0.0-1245/hadoop/lib/xz-1.0.jar:/usr/hdp/2.5.0.0-1245/hadoop/.//hadoop-annotations.jar:/usr/hdp/2.5.0.0-1245/hadoop/.//hadoop-common.jar:/usr/hdp/2.5.0.0-1245/hadoop/.//hadoop-nfs-2.7.3.2.5.0.0-1245.jar:/usr/hdp/2.5.0.0-1245/hadoop/.//hadoop-common-tests.jar:/usr/hdp/2.5.0.0-1245/hadoop/.//hadoop-auth-2.7.3.2.5.0.0-1245.jar:/usr/hdp/2.5.0.0-1245/hadoop/.//hadoop-aws-2.7.3.2.5.0.0-1245.jar:/usr/hdp/2.5.0.0-1245/hadoop/.//hadoop-azure.jar:/usr/hdp/2.5.0.0-1245/hadoop/.//hadoop-aws.jar:/usr/hdp/2.5.0.0-1245/hadoop/.//hadoop-annotations-2.7.3.2.5.0.0-1245.jar:/usr/hdp/2.5.0.0-1245/hadoop/.//hadoop-common-2.7.3.2.5.0.0-1245-tests.jar:/usr/hdp/2.5.0.0-1245/hadoop/.//hadoop-common-2.7.3.2.5.0.0-1245.jar:/usr/hdp/2.5.0.0-1245/hadoop/.//hadoop-azure-2.7.3.2.5.0.0-1245.jar:/usr/hdp/2.5.0.0-1245/hadoop/.//hadoop-auth.jar:/usr/hdp/2.5.0.0-1245/hadoop/.//hadoop-nfs.jar:/usr/hdp/2.5.0.0-1245/hadoop-hdfs/./:/usr/hdp/2.5.0.0-1245/hadoop-hdfs/lib/commons-io-2.4.jar:/usr/hdp/2.5.0.0-1245/hadoop-hdfs/lib/okio-1.4.0.jar:/usr/hdp/2.5.0.0-1245/hadoop-hdfs/lib/commons-lang-2.6.jar:/usr/hdp/2.5.0.0-1245/hadoop-hdfs/lib/okhttp-2.4.0.jar:/usr/hdp/2.5.0.0-1245/hadoop-hdfs/lib/jsr305-3.0.0.jar:/usr/hdp/2.5.0.0-1245/hadoop-hdfs/lib/jersey-core-1.9.jar:/usr/hdp/2.5.0.0-1245/hadoop-hdfs/lib/xml-apis-1.3.04.jar:/usr/hdp/2.5.0.0-1245/hadoop-hdfs/lib/xercesImpl-2.9.1.jar:/usr/hdp/2.5.0.0-1245/hadoop-hdfs/lib/jackson-mapper-asl-1.9.13.jar:/usr/hdp/2.5.0.0-1245/hadoop-hdfs/lib/htrace-core-3.1.0-incubating.jar:/usr/hdp/2.5.0.0-1245/hadoop-hdfs/lib/jersey-server-1.9.jar:/usr/hdp/2.5.0.0-1245/hadoop-hdfs/lib/commons-codec-1.4.jar:/usr/hdp/2.5.0.0-1245/hadoop-hdfs/lib/netty-3.6.2.Final.jar:/usr/hdp/2.5.0.0-1245/hadoop-hdfs/lib/asm-3.2.jar:/usr/hdp/2.5.0.0-1245/hadoop-hdfs/lib/log4j-1.2.17.jar:/usr/hdp/2.5.0.0-1245/hadoop-hdfs/lib/leveldbjni-all-1.8.jar:/usr/hdp/2.5.0.0-1245/hadoop-hdfs/lib/netty-all-4.0.23.Final.jar:/usr/hdp/2.5.0.0-1245/hadoop-hdfs/lib/protobuf-java-2.5.0.jar:/usr/hdp/2.5.0.0-1245/hadoop-hdfs/lib/jackson-core-asl-1.9.13.jar:/usr/hdp/2.5.0.0-1245/hadoop-hdfs/lib/xmlenc-0.52.jar:/usr/hdp/2.5.0.0-1245/hadoop-hdfs/lib/jetty-util-6.1.26.hwx.jar:/usr/hdp/2.5.0.0-1245/hadoop-hdfs/lib/jetty-6.1.26.hwx.jar:/usr/hdp/2.5.0.0-1245/hadoop-hdfs/lib/guava-11.0.2.jar:/usr/hdp/2.5.0.0-1245/hadoop-hdfs/lib/commons-daemon-1.0.13.jar:/usr/hdp/2.5.0.0-1245/hadoop-hdfs/lib/commons-cli-1.2.jar:/usr/hdp/2.5.0.0-1245/hadoop-hdfs/lib/servlet-api-2.5.jar:/usr/hdp/2.5.0.0-1245/hadoop-hdfs/lib/commons-logging-1.1.3.jar:/usr/hdp/2.5.0.0-1245/hadoop-hdfs/.//hadoop-hdfs-2.7.3.2.5.0.0-1245-tests.jar:/usr/hdp/2.5.0.0-1245/hadoop-hdfs/.//hadoop-hdfs-nfs-2.7.3.2.5.0.0-1245.jar:/usr/hdp/2.5.0.0-1245/hadoop-hdfs/.//hadoop-hdfs-nfs.jar:/usr/hdp/2.5.0.0-1245/hadoop-hdfs/.//hadoop-hdfs.jar:/usr/hdp/2.5.0.0-1245/hadoop-hdfs/.//hadoop-hdfs-2.7.3.2.5.0.0-1245.jar:/usr/hdp/2.5.0.0-1245/hadoop-hdfs/.//hadoop-hdfs-tests.jar:/usr/hdp/2.5.0.0-1245/hadoop-yarn/lib/commons-io-2.4.jar:/usr/hdp/2.5.0.0-1245/hadoop-yarn/lib/commons-beanutils-core-1.8.0.jar:/usr/hdp/2.5.0.0-1245/hadoop-yarn/lib/commons-digester-1.8.jar:/usr/hdp/2.5.0.0-1245/hadoop-yarn/lib/api-asn1-api-1.0.0-M20.jar:/usr/hdp/2.5.0.0-1245/hadoop-yarn/lib/jcip-annotations-1.0.jar:/usr/hdp/2.5.0.0-1245/hadoop-yarn/lib/javax.inject-1.jar:/usr/hdp/2.5.0.0-1245/hadoop-yarn/lib/jaxb-impl-2.2.3-1.jar:/usr/hdp/2.5.0.0-1245/hadoop-yarn/lib/commons-lang-2.6.jar:/usr/hdp/2.5.0.0-1245/hadoop-yarn/lib/curator-client-2.7.1.jar:/usr/hdp/2.5.0.0-1245/hadoop-yarn/lib/jersey-json-1.9.jar:/usr/hdp/2.5.0.0-1245/hadoop-yarn/lib/jsr305-3.0.0.jar:/usr/hdp/2.5.0.0-1245/hadoop-yarn/lib/jersey-core-1.9.jar:/usr/hdp/2.5.0.0-1245/hadoop-yarn/lib/jettison-1.1.jar:/usr/hdp/2.5.0.0-1245/hadoop-yarn/lib/gson-2.2.4.jar:/usr/hdp/2.5.0.0-1245/hadoop-yarn/lib/zookeeper-3.4.6.2.5.0.0-1245.jar:/usr/hdp/2.5.0.0-1245/hadoop-yarn/lib/jersey-client-1.9.jar:/usr/hdp/2.5.0.0-1245/hadoop-yarn/lib/avro-1.7.4.jar:/usr/hdp/2.5.0.0-1245/hadoop-yarn/lib/guice-servlet-3.0.jar:/usr/hdp/2.5.0.0-1245/hadoop-yarn/lib/httpclient-4.5.2.jar:/usr/hdp/2.5.0.0-1245/hadoop-yarn/lib/curator-framework-2.7.1.jar:/usr/hdp/2.5.0.0-1245/hadoop-yarn/lib/json-smart-1.1.1.jar:/usr/hdp/2.5.0.0-1245/hadoop-yarn/lib/snappy-java-1.0.4.1.jar:/usr/hdp/2.5.0.0-1245/hadoop-yarn/lib/zookeeper-3.4.6.2.5.0.0-1245-tests.jar:/usr/hdp/2.5.0.0-1245/hadoop-yarn/lib/jsp-api-2.1.jar:/usr/hdp/2.5.0.0-1245/hadoop-yarn/lib/jackson-mapper-asl-1.9.13.jar:/usr/hdp/2.5.0.0-1245/hadoop-yarn/lib/commons-math3-3.1.1.jar:/usr/hdp/2.5.0.0-1245/hadoop-yarn/lib/nimbus-jose-jwt-3.9.jar:/usr/hdp/2.5.0.0-1245/hadoop-yarn/lib/commons-collections-3.2.2.jar:/usr/hdp/2.5.0.0-1245/hadoop-yarn/lib/commons-compress-1.4.1.jar:/usr/hdp/2.5.0.0-1245/hadoop-yarn/lib/htrace-core-3.1.0-incubating.jar:/usr/hdp/2.5.0.0-1245/hadoop-yarn/lib/commons-net-3.1.jar:/usr/hdp/2.5.0.0-1245/hadoop-yarn/lib/jersey-server-1.9.jar:/usr/hdp/2.5.0.0-1245/hadoop-yarn/lib/jackson-core-2.2.3.jar:/usr/hdp/2.5.0.0-1245/hadoop-yarn/lib/microsoft-windowsazure-storage-sdk-0.6.0.jar:/usr/hdp/2.5.0.0-1245/hadoop-yarn/lib/api-util-1.0.0-M20.jar:/usr/hdp/2.5.0.0-1245/hadoop-yarn/lib/curator-recipes-2.7.1.jar:/usr/hdp/2.5.0.0-1245/hadoop-yarn/lib/aopalliance-1.0.jar:/usr/hdp/2.5.0.0-1245/hadoop-yarn/lib/stax-api-1.0-2.jar:/usr/hdp/2.5.0.0-1245/hadoop-yarn/lib/guice-3.0.jar:/usr/hdp/2.5.0.0-1245/hadoop-yarn/lib/commons-codec-1.4.jar:/usr/hdp/2.5.0.0-1245/hadoop-yarn/lib/apacheds-kerberos-codec-2.0.0-M15.jar:/usr/hdp/2.5.0.0-1245/hadoop-yarn/lib/netty-3.6.2.Final.jar:/usr/hdp/2.5.0.0-1245/hadoop-yarn/lib/activation-1.1.jar:/usr/hdp/2.5.0.0-1245/hadoop-yarn/lib/asm-3.2.jar:/usr/hdp/2.5.0.0-1245/hadoop-yarn/lib/log4j-1.2.17.jar:/usr/hdp/2.5.0.0-1245/hadoop-yarn/lib/leveldbjni-all-1.8.jar:/usr/hdp/2.5.0.0-1245/hadoop-yarn/lib/jackson-xc-1.9.13.jar:/usr/hdp/2.5.0.0-1245/hadoop-yarn/lib/jackson-databind-2.2.3.jar:/usr/hdp/2.5.0.0-1245/hadoop-yarn/lib/httpcore-4.4.4.jar:/usr/hdp/2.5.0.0-1245/hadoop-yarn/lib/jsch-0.1.42.jar:/usr/hdp/2.5.0.0-1245/hadoop-yarn/lib/javassist-3.18.1-GA.jar:/usr/hdp/2.5.0.0-1245/hadoop-yarn/lib/protobuf-java-2.5.0.jar:/usr/hdp/2.5.0.0-1245/hadoop-yarn/lib/commons-beanutils-1.7.0.jar:/usr/hdp/2.5.0.0-1245/hadoop-yarn/lib/jackson-core-asl-1.9.13.jar:/usr/hdp/2.5.0.0-1245/hadoop-yarn/lib/paranamer-2.3.jar:/usr/hdp/2.5.0.0-1245/hadoop-yarn/lib/jersey-guice-1.9.jar:/usr/hdp/2.5.0.0-1245/hadoop-yarn/lib/xmlenc-0.52.jar:/usr/hdp/2.5.0.0-1245/hadoop-yarn/lib/objenesis-2.1.jar:/usr/hdp/2.5.0.0-1245/hadoop-yarn/lib/jets3t-0.9.0.jar:/usr/hdp/2.5.0.0-1245/hadoop-yarn/lib/java-xmlbuilder-0.4.jar:/usr/hdp/2.5.0.0-1245/hadoop-yarn/lib/apacheds-i18n-2.0.0-M15.jar:/usr/hdp/2.5.0.0-1245/hadoop-yarn/lib/fst-2.24.jar:/usr/hdp/2.5.0.0-1245/hadoop-yarn/lib/jetty-util-6.1.26.hwx.jar:/usr/hdp/2.5.0.0-1245/hadoop-yarn/lib/jackson-annotations-2.2.3.jar:/usr/hdp/2.5.0.0-1245/hadoop-yarn/lib/jackson-jaxrs-1.9.13.jar:/usr/hdp/2.5.0.0-1245/hadoop-yarn/lib/jetty-6.1.26.hwx.jar:/usr/hdp/2.5.0.0-1245/hadoop-yarn/lib/guava-11.0.2.jar:/usr/hdp/2.5.0.0-1245/hadoop-yarn/lib/commons-configuration-1.6.jar:/usr/hdp/2.5.0.0-1245/hadoop-yarn/lib/jaxb-api-2.2.2.jar:/usr/hdp/2.5.0.0-1245/hadoop-yarn/lib/metrics-core-3.0.1.jar:/usr/hdp/2.5.0.0-1245/hadoop-yarn/lib/commons-cli-1.2.jar:/usr/hdp/2.5.0.0-1245/hadoop-yarn/lib/servlet-api-2.5.jar:/usr/hdp/2.5.0.0-1245/hadoop-yarn/lib/commons-logging-1.1.3.jar:/usr/hdp/2.5.0.0-1245/hadoop-yarn/lib/xz-1.0.jar:/usr/hdp/2.5.0.0-1245/hadoop-yarn/.//hadoop-yarn-server-tests.jar:/usr/hdp/2.5.0.0-1245/hadoop-yarn/.//hadoop-yarn-server-sharedcachemanager-2.7.3.2.5.0.0-1245.jar:/usr/hdp/2.5.0.0-1245/hadoop-yarn/.//hadoop-yarn-api.jar:/usr/hdp/2.5.0.0-1245/hadoop-yarn/.//hadoop-yarn-server-sharedcachemanager.jar:/usr/hdp/2.5.0.0-1245/hadoop-yarn/.//hadoop-yarn-registry.jar:/usr/hdp/2.5.0.0-1245/hadoop-yarn/.//hadoop-yarn-server-resourcemanager-2.7.3.2.5.0.0-1245.jar:/usr/hdp/2.5.0.0-1245/hadoop-yarn/.//hadoop-yarn-server-timeline-pluginstorage.jar:/usr/hdp/2.5.0.0-1245/hadoop-yarn/.//hadoop-yarn-server-tests-2.7.3.2.5.0.0-1245.jar:/usr/hdp/2.5.0.0-1245/hadoop-yarn/.//hadoop-yarn-server-nodemanager.jar:/usr/hdp/2.5.0.0-1245/hadoop-yarn/.//hadoop-yarn-server-applicationhistoryservice.jar:/usr/hdp/2.5.0.0-1245/hadoop-yarn/.//hadoop-yarn-server-common-2.7.3.2.5.0.0-1245.jar:/usr/hdp/2.5.0.0-1245/hadoop-yarn/.//hadoop-yarn-server-web-proxy.jar:/usr/hdp/2.5.0.0-1245/hadoop-yarn/.//hadoop-yarn-registry-2.7.3.2.5.0.0-1245.jar:/usr/hdp/2.5.0.0-1245/hadoop-yarn/.//hadoop-yarn-applications-unmanaged-am-launcher-2.7.3.2.5.0.0-1245.jar:/usr/hdp/2.5.0.0-1245/hadoop-yarn/.//hadoop-yarn-server-resourcemanager.jar:/usr/hdp/2.5.0.0-1245/hadoop-yarn/.//hadoop-yarn-server-applicationhistoryservice-2.7.3.2.5.0.0-1245.jar:/usr/hdp/2.5.0.0-1245/hadoop-yarn/.//hadoop-yarn-server-nodemanager-2.7.3.2.5.0.0-1245.jar:/usr/hdp/2.5.0.0-1245/hadoop-yarn/.//hadoop-yarn-client.jar:/usr/hdp/2.5.0.0-1245/hadoop-yarn/.//hadoop-yarn-applications-distributedshell.jar:/usr/hdp/2.5.0.0-1245/hadoop-yarn/.//hadoop-yarn-server-common.jar:/usr/hdp/2.5.0.0-1245/hadoop-yarn/.//hadoop-yarn-server-timeline-pluginstorage-2.7.3.2.5.0.0-1245.jar:/usr/hdp/2.5.0.0-1245/hadoop-yarn/.//hadoop-yarn-server-web-proxy-2.7.3.2.5.0.0-1245.jar:/usr/hdp/2.5.0.0-1245/hadoop-yarn/.//hadoop-yarn-common.jar:/usr/hdp/2.5.0.0-1245/hadoop-yarn/.//hadoop-yarn-api-2.7.3.2.5.0.0-1245.jar:/usr/hdp/2.5.0.0-1245/hadoop-yarn/.//hadoop-yarn-applications-unmanaged-am-launcher.jar:/usr/hdp/2.5.0.0-1245/hadoop-yarn/.//hadoop-yarn-client-2.7.3.2.5.0.0-1245.jar:/usr/hdp/2.5.0.0-1245/hadoop-yarn/.//hadoop-yarn-applications-distributedshell-2.7.3.2.5.0.0-1245.jar:/usr/hdp/2.5.0.0-1245/hadoop-yarn/.//hadoop-yarn-common-2.7.3.2.5.0.0-1245.jar:/usr/hdp/2.5.0.0-1245/hadoop-mapreduce/lib/commons-io-2.4.jar:/usr/hdp/2.5.0.0-1245/hadoop-mapreduce/lib/javax.inject-1.jar:/usr/hdp/2.5.0.0-1245/hadoop-mapreduce/lib/jersey-core-1.9.jar:/usr/hdp/2.5.0.0-1245/hadoop-mapreduce/lib/hamcrest-core-1.3.jar:/usr/hdp/2.5.0.0-1245/hadoop-mapreduce/lib/avro-1.7.4.jar:/usr/hdp/2.5.0.0-1245/hadoop-mapreduce/lib/guice-servlet-3.0.jar:/usr/hdp/2.5.0.0-1245/hadoop-mapreduce/lib/snappy-java-1.0.4.1.jar:/usr/hdp/2.5.0.0-1245/hadoop-mapreduce/lib/jackson-mapper-asl-1.9.13.jar:/usr/hdp/2.5.0.0-1245/hadoop-mapreduce/lib/commons-compress-1.4.1.jar:/usr/hdp/2.5.0.0-1245/hadoop-mapreduce/lib/jersey-server-1.9.jar:/usr/hdp/2.5.0.0-1245/hadoop-mapreduce/lib/aopalliance-1.0.jar:/usr/hdp/2.5.0.0-1245/hadoop-mapreduce/lib/guice-3.0.jar:/usr/hdp/2.5.0.0-1245/hadoop-mapreduce/lib/netty-3.6.2.Final.jar:/usr/hdp/2.5.0.0-1245/hadoop-mapreduce/lib/asm-3.2.jar:/usr/hdp/2.5.0.0-1245/hadoop-mapreduce/lib/log4j-1.2.17.jar:/usr/hdp/2.5.0.0-1245/hadoop-mapreduce/lib/leveldbjni-all-1.8.jar:/usr/hdp/2.5.0.0-1245/hadoop-mapreduce/lib/protobuf-java-2.5.0.jar:/usr/hdp/2.5.0.0-1245/hadoop-mapreduce/lib/jackson-core-asl-1.9.13.jar:/usr/hdp/2.5.0.0-1245/hadoop-mapreduce/lib/paranamer-2.3.jar:/usr/hdp/2.5.0.0-1245/hadoop-mapreduce/lib/jersey-guice-1.9.jar:/usr/hdp/2.5.0.0-1245/hadoop-mapreduce/lib/junit-4.11.jar:/usr/hdp/2.5.0.0-1245/hadoop-mapreduce/lib/xz-1.0.jar:/usr/hdp/2.5.0.0-1245/hadoop-mapreduce/.//commons-io-2.4.jar:/usr/hdp/2.5.0.0-1245/hadoop-mapreduce/.//hadoop-ant-2.7.3.2.5.0.0-1245.jar:/usr/hdp/2.5.0.0-1245/hadoop-mapreduce/.//commons-beanutils-core-1.8.0.jar:/usr/hdp/2.5.0.0-1245/hadoop-mapreduce/.//commons-digester-1.8.jar:/usr/hdp/2.5.0.0-1245/hadoop-mapreduce/.//commons-lang3-3.3.2.jar:/usr/hdp/2.5.0.0-1245/hadoop-mapreduce/.//api-asn1-api-1.0.0-M20.jar:/usr/hdp/2.5.0.0-1245/hadoop-mapreduce/.//jcip-annotations-1.0.jar:/usr/hdp/2.5.0.0-1245/hadoop-mapreduce/.//hadoop-distcp.jar:/usr/hdp/2.5.0.0-1245/hadoop-mapreduce/.//hadoop-mapreduce-client-hs-plugins.jar:/usr/hdp/2.5.0.0-1245/hadoop-mapreduce/.//jaxb-impl-2.2.3-1.jar:/usr/hdp/2.5.0.0-1245/hadoop-mapreduce/.//hadoop-mapreduce-client-common-2.7.3.2.5.0.0-1245.jar:/usr/hdp/2.5.0.0-1245/hadoop-mapreduce/.//commons-lang-2.6.jar:/usr/hdp/2.5.0.0-1245/hadoop-mapreduce/.//curator-client-2.7.1.jar:/usr/hdp/2.5.0.0-1245/hadoop-mapreduce/.//jersey-json-1.9.jar:/usr/hdp/2.5.0.0-1245/hadoop-mapreduce/.//hadoop-mapreduce-client-app-2.7.3.2.5.0.0-1245.jar:/usr/hdp/2.5.0.0-1245/hadoop-mapreduce/.//jsr305-3.0.0.jar:/usr/hdp/2.5.0.0-1245/hadoop-mapreduce/.//jersey-core-1.9.jar:/usr/hdp/2.5.0.0-1245/hadoop-mapreduce/.//commons-httpclient-3.1.jar:/usr/hdp/2.5.0.0-1245/hadoop-mapreduce/.//jettison-1.1.jar:/usr/hdp/2.5.0.0-1245/hadoop-mapreduce/.//hadoop-auth-2.7.3.2.5.0.0-1245.jar:/usr/hdp/2.5.0.0-1245/hadoop-mapreduce/.//gson-2.2.4.jar:/usr/hdp/2.5.0.0-1245/hadoop-mapreduce/.//hadoop-mapreduce-client-jobclient.jar:/usr/hdp/2.5.0.0-1245/hadoop-mapreduce/.//hadoop-mapreduce-client-hs-2.7.3.2.5.0.0-1245.jar:/usr/hdp/2.5.0.0-1245/hadoop-mapreduce/.//zookeeper-3.4.6.2.5.0.0-1245.jar:/usr/hdp/2.5.0.0-1245/hadoop-mapreduce/.//hamcrest-core-1.3.jar:/usr/hdp/2.5.0.0-1245/hadoop-mapreduce/.//avro-1.7.4.jar:/usr/hdp/2.5.0.0-1245/hadoop-mapreduce/.//httpclient-4.5.2.jar:/usr/hdp/2.5.0.0-1245/hadoop-mapreduce/.//curator-framework-2.7.1.jar:/usr/hdp/2.5.0.0-1245/hadoop-mapreduce/.//hadoop-openstack.jar:/usr/hdp/2.5.0.0-1245/hadoop-mapreduce/.//json-smart-1.1.1.jar:/usr/hdp/2.5.0.0-1245/hadoop-mapreduce/.//snappy-java-1.0.4.1.jar:/usr/hdp/2.5.0.0-1245/hadoop-mapreduce/.//hadoop-mapreduce-client-core.jar:/usr/hdp/2.5.0.0-1245/hadoop-mapreduce/.//jsp-api-2.1.jar:/usr/hdp/2.5.0.0-1245/hadoop-mapreduce/.//hadoop-rumen.jar:/usr/hdp/2.5.0.0-1245/hadoop-mapreduce/.//hadoop-archives.jar:/usr/hdp/2.5.0.0-1245/hadoop-mapreduce/.//jackson-mapper-asl-1.9.13.jar:/usr/hdp/2.5.0.0-1245/hadoop-mapreduce/.//commons-math3-3.1.1.jar:/usr/hdp/2.5.0.0-1245/hadoop-mapreduce/.//nimbus-jose-jwt-3.9.jar:/usr/hdp/2.5.0.0-1245/hadoop-mapreduce/.//hadoop-mapreduce-client-shuffle.jar:/usr/hdp/2.5.0.0-1245/hadoop-mapreduce/.//hadoop-datajoin-2.7.3.2.5.0.0-1245.jar:/usr/hdp/2.5.0.0-1245/hadoop-mapreduce/.//hadoop-rumen-2.7.3.2.5.0.0-1245.jar:/usr/hdp/2.5.0.0-1245/hadoop-mapreduce/.//commons-collections-3.2.2.jar:/usr/hdp/2.5.0.0-1245/hadoop-mapreduce/.//commons-compress-1.4.1.jar:/usr/hdp/2.5.0.0-1245/hadoop-mapreduce/.//htrace-core-3.1.0-incubating.jar:/usr/hdp/2.5.0.0-1245/hadoop-mapreduce/.//commons-net-3.1.jar:/usr/hdp/2.5.0.0-1245/hadoop-mapreduce/.//hadoop-gridmix-2.7.3.2.5.0.0-1245.jar:/usr/hdp/2.5.0.0-1245/hadoop-mapreduce/.//jersey-server-1.9.jar:/usr/hdp/2.5.0.0-1245/hadoop-mapreduce/.//mockito-all-1.8.5.jar:/usr/hdp/2.5.0.0-1245/hadoop-mapreduce/.//hadoop-mapreduce-client-common.jar:/usr/hdp/2.5.0.0-1245/hadoop-mapreduce/.//microsoft-windowsazure-storage-sdk-0.6.0.jar:/usr/hdp/2.5.0.0-1245/hadoop-mapreduce/.//api-util-1.0.0-M20.jar:/usr/hdp/2.5.0.0-1245/hadoop-mapreduce/.//curator-recipes-2.7.1.jar:/usr/hdp/2.5.0.0-1245/hadoop-mapreduce/.//hadoop-mapreduce-client-shuffle-2.7.3.2.5.0.0-1245.jar:/usr/hdp/2.5.0.0-1245/hadoop-mapreduce/.//stax-api-1.0-2.jar:/usr/hdp/2.5.0.0-1245/hadoop-mapreduce/.//hadoop-sls-2.7.3.2.5.0.0-1245.jar:/usr/hdp/2.5.0.0-1245/hadoop-mapreduce/.//hadoop-streaming.jar:/usr/hdp/2.5.0.0-1245/hadoop-mapreduce/.//commons-codec-1.4.jar:/usr/hdp/2.5.0.0-1245/hadoop-mapreduce/.//apacheds-kerberos-codec-2.0.0-M15.jar:/usr/hdp/2.5.0.0-1245/hadoop-mapreduce/.//netty-3.6.2.Final.jar:/usr/hdp/2.5.0.0-1245/hadoop-mapreduce/.//hadoop-mapreduce-client-jobclient-2.7.3.2.5.0.0-1245.jar:/usr/hdp/2.5.0.0-1245/hadoop-mapreduce/.//activation-1.1.jar:/usr/hdp/2.5.0.0-1245/hadoop-mapreduce/.//asm-3.2.jar:/usr/hdp/2.5.0.0-1245/hadoop-mapreduce/.//log4j-1.2.17.jar:/usr/hdp/2.5.0.0-1245/hadoop-mapreduce/.//hadoop-mapreduce-client-app.jar:/usr/hdp/2.5.0.0-1245/hadoop-mapreduce/.//hadoop-mapreduce-examples.jar:/usr/hdp/2.5.0.0-1245/hadoop-mapreduce/.//hadoop-mapreduce-client-hs.jar:/usr/hdp/2.5.0.0-1245/hadoop-mapreduce/.//hadoop-ant.jar:/usr/hdp/2.5.0.0-1245/hadoop-mapreduce/.//jackson-xc-1.9.13.jar:/usr/hdp/2.5.0.0-1245/hadoop-mapreduce/.//httpcore-4.4.4.jar:/usr/hdp/2.5.0.0-1245/hadoop-mapreduce/.//jsch-0.1.42.jar:/usr/hdp/2.5.0.0-1245/hadoop-mapreduce/.//hadoop-extras-2.7.3.2.5.0.0-1245.jar:/usr/hdp/2.5.0.0-1245/hadoop-mapreduce/.//protobuf-java-2.5.0.jar:/usr/hdp/2.5.0.0-1245/hadoop-mapreduce/.//hadoop-sls.jar:/usr/hdp/2.5.0.0-1245/hadoop-mapreduce/.//commons-beanutils-1.7.0.jar:/usr/hdp/2.5.0.0-1245/hadoop-mapreduce/.//jackson-core-asl-1.9.13.jar:/usr/hdp/2.5.0.0-1245/hadoop-mapreduce/.//paranamer-2.3.jar:/usr/hdp/2.5.0.0-1245/hadoop-mapreduce/.//hadoop-mapreduce-client-jobclient-tests.jar:/usr/hdp/2.5.0.0-1245/hadoop-mapreduce/.//xmlenc-0.52.jar:/usr/hdp/2.5.0.0-1245/hadoop-mapreduce/.//hadoop-openstack-2.7.3.2.5.0.0-1245.jar:/usr/hdp/2.5.0.0-1245/hadoop-mapreduce/.//hadoop-auth.jar:/usr/hdp/2.5.0.0-1245/hadoop-mapreduce/.//hadoop-mapreduce-examples-2.7.3.2.5.0.0-1245.jar:/usr/hdp/2.5.0.0-1245/hadoop-mapreduce/.//jets3t-0.9.0.jar:/usr/hdp/2.5.0.0-1245/hadoop-mapreduce/.//hadoop-streaming-2.7.3.2.5.0.0-1245.jar:/usr/hdp/2.5.0.0-1245/hadoop-mapreduce/.//hadoop-distcp-2.7.3.2.5.0.0-1245.jar:/usr/hdp/2.5.0.0-1245/hadoop-mapreduce/.//java-xmlbuilder-0.4.jar:/usr/hdp/2.5.0.0-1245/hadoop-mapreduce/.//apacheds-i18n-2.0.0-M15.jar:/usr/hdp/2.5.0.0-1245/hadoop-mapreduce/.//jetty-util-6.1.26.hwx.jar:/usr/hdp/2.5.0.0-1245/hadoop-mapreduce/.//hadoop-gridmix.jar:/usr/hdp/2.5.0.0-1245/hadoop-mapreduce/.//jackson-jaxrs-1.9.13.jar:/usr/hdp/2.5.0.0-1245/hadoop-mapreduce/.//hadoop-mapreduce-client-core-2.7.3.2.5.0.0-1245.jar:/usr/hdp/2.5.0.0-1245/hadoop-mapreduce/.//hadoop-mapreduce-client-hs-plugins-2.7.3.2.5.0.0-1245.jar:/usr/hdp/2.5.0.0-1245/hadoop-mapreduce/.//hadoop-archives-2.7.3.2.5.0.0-1245.jar:/usr/hdp/2.5.0.0-1245/hadoop-mapreduce/.//jetty-6.1.26.hwx.jar:/usr/hdp/2.5.0.0-1245/hadoop-mapreduce/.//guava-11.0.2.jar:/usr/hdp/2.5.0.0-1245/hadoop-mapreduce/.//commons-configuration-1.6.jar:/usr/hdp/2.5.0.0-1245/hadoop-mapreduce/.//jaxb-api-2.2.2.jar:/usr/hdp/2.5.0.0-1245/hadoop-mapreduce/.//junit-4.11.jar:/usr/hdp/2.5.0.0-1245/hadoop-mapreduce/.//hadoop-mapreduce-client-jobclient-2.7.3.2.5.0.0-1245-tests.jar:/usr/hdp/2.5.0.0-1245/hadoop-mapreduce/.//metrics-core-3.0.1.jar:/usr/hdp/2.5.0.0-1245/hadoop-mapreduce/.//hadoop-extras.jar:/usr/hdp/2.5.0.0-1245/hadoop-mapreduce/.//hadoop-datajoin.jar:/usr/hdp/2.5.0.0-1245/hadoop-mapreduce/.//commons-cli-1.2.jar:/usr/hdp/2.5.0.0-1245/hadoop-mapreduce/.//servlet-api-2.5.jar:/usr/hdp/2.5.0.0-1245/hadoop-mapreduce/.//commons-logging-1.1.3.jar:/usr/hdp/2.5.0.0-1245/hadoop-mapreduce/.//xz-1.0.jar::mysql-connector-java-5.1.17.jar:mysql-connector-java.jar:/usr/hdp/2.5.0.0-1245/tez/tez-yarn-timeline-history-0.7.0.2.5.0.0-1245.jar:/usr/hdp/2.5.0.0-1245/tez/tez-mapreduce-0.7.0.2.5.0.0-1245.jar:/usr/hdp/2.5.0.0-1245/tez/tez-runtime-internals-0.7.0.2.5.0.0-1245.jar:/usr/hdp/2.5.0.0-1245/tez/tez-examples-0.7.0.2.5.0.0-1245.jar:/usr/hdp/2.5.0.0-1245/tez/tez-yarn-timeline-history-with-fs-0.7.0.2.5.0.0-1245.jar:/usr/hdp/2.5.0.0-1245/tez/tez-job-analyzer-0.7.0.2.5.0.0-1245.jar:/usr/hdp/2.5.0.0-1245/tez/tez-common-0.7.0.2.5.0.0-1245.jar:/usr/hdp/2.5.0.0-1245/tez/tez-tests-0.7.0.2.5.0.0-1245.jar:/usr/hdp/2.5.0.0-1245/tez/tez-dag-0.7.0.2.5.0.0-1245.jar:/usr/hdp/2.5.0.0-1245/tez/tez-yarn-timeline-cache-plugin-0.7.0.2.5.0.0-1245.jar:/usr/hdp/2.5.0.0-1245/tez/tez-runtime-library-0.7.0.2.5.0.0-1245.jar:/usr/hdp/2.5.0.0-1245/tez/tez-api-0.7.0.2.5.0.0-1245.jar:/usr/hdp/2.5.0.0-1245/tez/tez-history-parser-0.7.0.2.5.0.0-1245.jar:/usr/hdp/2.5.0.0-1245/tez/tez-yarn-timeline-history-with-acls-0.7.0.2.5.0.0-1245.jar:/usr/hdp/2.5.0.0-1245/tez/lib/commons-io-2.4.jar:/usr/hdp/2.5.0.0-1245/tez/lib/hadoop-mapreduce-client-common-2.7.3.2.5.0.0-1245.jar:/usr/hdp/2.5.0.0-1245/tez/lib/commons-lang-2.6.jar:/usr/hdp/2.5.0.0-1245/tez/lib/jersey-json-1.9.jar:/usr/hdp/2.5.0.0-1245/tez/lib/jersey-client-1.9.jar:/usr/hdp/2.5.0.0-1245/tez/lib/hadoop-aws-2.7.3.2.5.0.0-1245.jar:/usr/hdp/2.5.0.0-1245/tez/lib/commons-math3-3.1.1.jar:/usr/hdp/2.5.0.0-1245/tez/lib/metrics-core-3.1.0.jar:/usr/hdp/2.5.0.0-1245/tez/lib/commons-collections-3.2.2.jar:/usr/hdp/2.5.0.0-1245/tez/lib/hadoop-annotations-2.7.3.2.5.0.0-1245.jar:/usr/hdp/2.5.0.0-1245/tez/lib/commons-codec-1.4.jar:/usr/hdp/2.5.0.0-1245/tez/lib/commons-collections4-4.1.jar:/usr/hdp/2.5.0.0-1245/tez/lib/jsr305-2.0.3.jar:/usr/hdp/2.5.0.0-1245/tez/lib/protobuf-java-2.5.0.jar:/usr/hdp/2.5.0.0-1245/tez/lib/hadoop-yarn-server-timeline-pluginstorage-2.7.3.2.5.0.0-1245.jar:/usr/hdp/2.5.0.0-1245/tez/lib/hadoop-yarn-server-web-proxy-2.7.3.2.5.0.0-1245.jar:/usr/hdp/2.5.0.0-1245/tez/lib/hadoop-azure-2.7.3.2.5.0.0-1245.jar:/usr/hdp/2.5.0.0-1245/tez/lib/jetty-util-6.1.26.hwx.jar:/usr/hdp/2.5.0.0-1245/tez/lib/hadoop-mapreduce-client-core-2.7.3.2.5.0.0-1245.jar:/usr/hdp/2.5.0.0-1245/tez/lib/jetty-6.1.26.hwx.jar:/usr/hdp/2.5.0.0-1245/tez/lib/jettison-1.3.4.jar:/usr/hdp/2.5.0.0-1245/tez/lib/slf4j-api-1.7.5.jar:/usr/hdp/2.5.0.0-1245/tez/lib/guava-11.0.2.jar:/usr/hdp/2.5.0.0-1245/tez/lib/commons-cli-1.2.jar:/usr/hdp/2.5.0.0-1245/tez/lib/servlet-api-2.5.jar:/usr/hdp/2.5.0.0-1245/tez/conf 16/11/03 12:51:47 INFO zookeeper.ZooKeeper: Client environment:java.library.path=:/usr/hdp/2.5.0.0-1245/hadoop/lib/native/Linux-amd64-64:/grid/0/hdp/2.5.0.0-1245/hadoop/lib/native 16/11/03 12:51:47 INFO zookeeper.ZooKeeper: Client environment:java.io.tmpdir=/tmp 16/11/03 12:51:47 INFO zookeeper.ZooKeeper: Client environment:java.compiler=<NA> 16/11/03 12:51:47 INFO zookeeper.ZooKeeper: Client environment:os.name=Linux 16/11/03 12:51:47 INFO zookeeper.ZooKeeper: Client environment:os.arch=amd64 16/11/03 12:51:47 INFO zookeeper.ZooKeeper: Client environment:os.version=2.6.32-504.1.3.el6.x86_64 16/11/03 12:51:47 INFO zookeeper.ZooKeeper: Client environment:user.name=hbase 16/11/03 12:51:47 INFO zookeeper.ZooKeeper: Client environment:user.home=/home/hbase 16/11/03 12:51:47 INFO zookeeper.ZooKeeper: Client environment:user.dir=/home/hbase 16/11/03 12:51:47 INFO zookeeper.ZooKeeper: Initiating client connection, connectString=santhosh-blueprint-test-11.XXX:2181 sessionTimeout=90000 watcher=org.apache.hadoop.hbase.zookeeper.PendingWatcher@274e2312 16/11/03 12:51:47 INFO zookeeper.ClientCnxn: Opening socket connection to server santhosh-blueprint-test-11.XXX/AAA22.78.36:2181. Will not attempt to authenticate using SASL (unknown error) 16/11/03 12:51:47 INFO zookeeper.ClientCnxn: Socket connection established to santhosh-blueprint-test-11.XXX/AAA22.78.36:2181, initiating session 16/11/03 12:51:47 INFO zookeeper.ClientCnxn: Session establishment complete on server santhosh-blueprint-test-11.XXX/AAA22.78.36:2181, sessionid = 0x1582a2f53b3002c, negotiated timeout = 40000 16/11/03 12:51:48 INFO metrics.Metrics: Initializing metrics system: phoenix 16/11/03 12:51:49 INFO impl.MetricsConfig: loaded properties from hadoop-metrics2.properties 16/11/03 12:51:49 INFO impl.MetricsSystemImpl: Scheduled snapshot period at 10 second(s). 16/11/03 12:51:49 INFO impl.MetricsSystemImpl: phoenix metrics system started Exception in thread "main" java.sql.SQLException: org.apache.hadoop.hbase.client.RetriesExhaustedException: Failed after attempts=36, exceptions: Thu Nov 03 12:52:38 UTC 2016, null, java.net.SocketTimeoutException: callTimeout=60000, callDuration=68656: row 'SYSTEM:CATALOG,,' on table 'hbase:meta' at region=hbase:meta,,1.1588230740, hostname=santhosh-blueprint-test-3.XXX,16020,1478177456047, seqNum=0 at org.apache.phoenix.query.ConnectionQueryServicesImpl$13.call(ConnectionQueryServicesImpl.java:2590) at org.apache.phoenix.query.ConnectionQueryServicesImpl$13.call(ConnectionQueryServicesImpl.java:2327) at org.apache.phoenix.util.PhoenixContextExecutor.call(PhoenixContextExecutor.java:78) at org.apache.phoenix.query.ConnectionQueryServicesImpl.init(ConnectionQueryServicesImpl.java:2327) at org.apache.phoenix.jdbc.PhoenixDriver.getConnectionQueryServices(PhoenixDriver.java:233) at org.apache.phoenix.jdbc.PhoenixEmbeddedDriver.createConnection(PhoenixEmbeddedDriver.java:142) at org.apache.phoenix.jdbc.PhoenixDriver.connect(PhoenixDriver.java:202) at java.sql.DriverManager.getConnection(DriverManager.java:664) at java.sql.DriverManager.getConnection(DriverManager.java:208) at org.apache.phoenix.util.QueryUtil.getConnection(QueryUtil.java:305) at org.apache.phoenix.util.QueryUtil.getConnection(QueryUtil.java:296) at org.apache.phoenix.mapreduce.AbstractBulkLoadTool.loadData(AbstractBulkLoadTool.java:209) at org.apache.phoenix.mapreduce.AbstractBulkLoadTool.run(AbstractBulkLoadTool.java:183) at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:76) at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:90) at org.apache.phoenix.mapreduce.CsvBulkLoadTool.main(CsvBulkLoadTool.java:101) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.util.RunJar.run(RunJar.java:233) at org.apache.hadoop.util.RunJar.main(RunJar.java:148) Caused by: org.apache.hadoop.hbase.client.RetriesExhaustedException: Failed after attempts=36, exceptions: Thu Nov 03 12:52:38 UTC 2016, null, java.net.SocketTimeoutException: callTimeout=60000, callDuration=68656: row 'SYSTEM:CATALOG,,' on table 'hbase:meta' at region=hbase:meta,,1.1588230740, hostname=santhosh-blueprint-test-3.XXX,16020,1478177456047, seqNum=0 at org.apache.hadoop.hbase.client.RpcRetryingCallerWithReadReplicas.throwEnrichedException(RpcRetryingCallerWithReadReplicas.java:271) at org.apache.hadoop.hbase.client.ScannerCallableWithReplicas.call(ScannerCallableWithReplicas.java:210) at org.apache.hadoop.hbase.client.ScannerCallableWithReplicas.call(ScannerCallableWithReplicas.java:60) at org.apache.hadoop.hbase.client.RpcRetryingCaller.callWithoutRetries(RpcRetryingCaller.java:200) at org.apache.hadoop.hbase.client.ClientScanner.call(ClientScanner.java:326) at org.apache.hadoop.hbase.client.ClientScanner.nextScanner(ClientScanner.java:301) at org.apache.hadoop.hbase.client.ClientScanner.initializeScannerInConstruction(ClientScanner.java:166) at org.apache.hadoop.hbase.client.ClientScanner.<init>(ClientScanner.java:161) at org.apache.hadoop.hbase.client.HTable.getScanner(HTable.java:794) at org.apache.hadoop.hbase.MetaTableAccessor.fullScan(MetaTableAccessor.java:602) at org.apache.hadoop.hbase.MetaTableAccessor.tableExists(MetaTableAccessor.java:366) at org.apache.hadoop.hbase.client.HBaseAdmin.tableExists(HBaseAdmin.java:405) at org.apache.phoenix.query.ConnectionQueryServicesImpl$13.call(ConnectionQueryServicesImpl.java:2358) ... 21 more Caused by: java.net.SocketTimeoutException: callTimeout=60000, callDuration=68656: row 'SYSTEM:CATALOG,,' on table 'hbase:meta' at region=hbase:meta,,1.1588230740, hostname=santhosh-blueprint-test-3.XXX,16020,1478177456047, seqNum=0 at org.apache.hadoop.hbase.client.RpcRetryingCaller.callWithRetries(RpcRetryingCaller.java:159) at org.apache.hadoop.hbase.client.ResultBoundedCompletionService$QueueingFuture.run(ResultBoundedCompletionService.java:65) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) Caused by: org.apache.hadoop.hbase.exceptions.ConnectionClosingException: Call to santhosh-blueprint-test-3.XXX/AAA22.78.6:16020 failed on local exception: org.apache.hadoop.hbase.exceptions.ConnectionClosingException: Connection to santhosh-blueprint-test-3.XXX/AAA22.78.6:16020 is closing. Call id=9, waitTime=3 at org.apache.hadoop.hbase.ipc.RpcClientImpl.wrapException(RpcClientImpl.java:1258) at org.apache.hadoop.hbase.ipc.RpcClientImpl.call(RpcClientImpl.java:1229) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.callBlockingMethod(AbstractRpcClient.java:213) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$BlockingRpcChannelImplementation.callBlockingMethod(AbstractRpcClient.java:287) at org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$BlockingStub.scan(ClientProtos.java:32741) at org.apache.hadoop.hbase.client.ScannerCallable.openScanner(ScannerCallable.java:373) at org.apache.hadoop.hbase.client.ScannerCallable.call(ScannerCallable.java:200) at org.apache.hadoop.hbase.client.ScannerCallable.call(ScannerCallable.java:62) at org.apache.hadoop.hbase.client.RpcRetryingCaller.callWithoutRetries(RpcRetryingCaller.java:200) at org.apache.hadoop.hbase.client.ScannerCallableWithReplicas$RetryingRPC.call(ScannerCallableWithReplicas.java:364) at org.apache.hadoop.hbase.client.ScannerCallableWithReplicas$RetryingRPC.call(ScannerCallableWithReplicas.java:338) at org.apache.hadoop.hbase.client.RpcRetryingCaller.callWithRetries(RpcRetryingCaller.java:126) ... 4 more Caused by: org.apache.hadoop.hbase.exceptions.ConnectionClosingException: Connection to santhosh-blueprint-test-3.XXX/AAA22.78.6:16020 is closing. Call id=9, waitTime=3 at org.apache.hadoop.hbase.ipc.RpcClientImpl$Connection.cleanupCalls(RpcClientImpl.java:1047) at org.apache.hadoop.hbase.ipc.RpcClientImpl$Connection.close(RpcClientImpl.java:846) at org.apache.hadoop.hbase.ipc.RpcClientImpl$Connection.run(RpcClientImpl.java:574) ... View more

journal node is logging below WARN in the logs and ambari is alerting about journal web ui is not accessible. any idea how to recover from this ? 2016-10-19 12:36:20,353 WARN namenode.FSImage (EditLogFileInputStream.java:scanEditLog(359)) - Caught exception after scanning through 0 ops from /hadoop/hdfs/journal/stanleyhotel/current/edits_inprogress_0000000000064985103 while determining its valid length. Position was 888832 java.io.IOException: Can't scan a pre-transactional edit log. at org.apache.hadoop.hdfs.server.namenode.FSEditLogOp$LegacyReader.scanOp(FSEditLogOp.java:4959) at org.apache.hadoop.hdfs.server.namenode.EditLogFileInputStream.scanNextOp(EditLogFileInputStream.java:245) at org.apache.hadoop.hdfs.server.namenode.EditLogFileInputStream.scanEditLog(EditLogFileInputStream.java:355) at org.apache.hadoop.hdfs.server.namenode.FileJournalManager$EditLogFile.scanLog(FileJournalManager.java:551) at org.apache.hadoop.hdfs.qjournal.server.Journal.scanStorageForLatestEdits(Journal.java:192) at org.apache.hadoop.hdfs.qjournal.server.Journal.<init>(Journal.java:152) at org.apache.hadoop.hdfs.qjournal.server.JournalNode.getOrCreateJournal(JournalNode.java:90) at org.apache.hadoop.hdfs.qjournal.server.JournalNode.getOrCreateJournal(JournalNode.java:99)^C at org.apache.hadoop.hdfs.qjournal.server.JournalNodeRpcServer.heartbeat(JournalNodeRpcServer.java:158) at org.apache.hadoop.hdfs.qjournal.protocolPB.QJournalProtocolServerSideTranslatorPB.heartbeat(QJournalProtocolServerSideTranslatorPB.java:172) at org.apache.hadoop.hdfs.qjournal.protocol.QJournalProtocolProtos$QJournalProtocolService$2.callBlockingMethod(QJournalProtocolProtos.java:25423) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:640) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:982) at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2313) at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2309) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1724) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2307) 2016-10-19 12:36:20,353 WARN namenode.FSImage (EditLogFileInputStream.java:scanEditLog(364)) - After resync, position is 888832 ... View more