2017-09-27 08:25:06,598 INFO namenode.NameNode (LogAdapter.java:info(47)) - STARTUP_MSG: /************************************************************ STARTUP_MSG: Starting NameNode STARTUP_MSG: user = hdfs STARTUP_MSG: host = standbynamenode-t5liwl46t1.hdp.local/10.0.0.163 STARTUP_MSG: args = [] STARTUP_MSG: version = 2.7.1.2.4.3.0-227 STARTUP_MSG: classpath = /usr/hdp/current/hadoop-client/conf:/usr/hdp/2.4.3.0-227/hadoop/lib/jersey-json-1.9.jar:/usr/hdp/2.4.3.0-227/hadoop/lib/spark-yarn-shuffle.jar:/usr/hdp/2.4.3.0-227/hadoop/lib/ojdbc6.jar:/usr/hdp/2.4.3.0-227/hadoop/lib/jackson-databind-2.2.3.jar:/usr/hdp/2.4.3.0-227/hadoop/lib/ranger-hdfs-plugin-shim-0.5.0.2.4.3.0-227.jar:/usr/hdp/2.4.3.0-227/hadoop/lib/jackson-jaxrs-1.9.13.jar:/usr/hdp/2.4.3.0-227/hadoop/lib/ranger-plugin-classloader-0.5.0.2.4.3.0-227.jar:/usr/hdp/2.4.3.0-227/hadoop/lib/jackson-mapper-asl-1.9.13.jar:/usr/hdp/2.4.3.0-227/hadoop/lib/ranger-yarn-plugin-shim-0.5.0.2.4.3.0-227.jar:/usr/hdp/2.4.3.0-227/hadoop/lib/activation-1.1.jar:/usr/hdp/2.4.3.0-227/hadoop/lib/jersey-server-1.9.jar:/usr/hdp/2.4.3.0-227/hadoop/lib/apacheds-i18n-2.0.0-M15.jar:/usr/hdp/2.4.3.0-227/hadoop/lib/jackson-xc-1.9.13.jar:/usr/hdp/2.4.3.0-227/hadoop/lib/apacheds-kerberos-codec-2.0.0-M15.jar:/usr/hdp/2.4.3.0-227/hadoop/lib/jets3t-0.9.0.jar:/usr/hdp/2.4.3.0-227/hadoop/lib/api-asn1-api-1.0.0-M20.jar:/usr/hdp/2.4.3.0-227/hadoop/lib/jettison-1.1.jar:/usr/hdp/2.4.3.0-227/hadoop/lib/api-util-1.0.0-M20.jar:/usr/hdp/2.4.3.0-227/hadoop/lib/asm-3.2.jar:/usr/hdp/2.4.3.0-227/hadoop/lib/avro-1.7.4.jar:/usr/hdp/2.4.3.0-227/hadoop/lib/jetty-6.1.26.hwx.jar:/usr/hdp/2.4.3.0-227/hadoop/lib/aws-java-sdk-1.7.4.jar:/usr/hdp/2.4.3.0-227/hadoop/lib/jetty-util-6.1.26.hwx.jar:/usr/hdp/2.4.3.0-227/hadoop/lib/azure-storage-2.2.0.jar:/usr/hdp/2.4.3.0-227/hadoop/lib/paranamer-2.3.jar:/usr/hdp/2.4.3.0-227/hadoop/lib/commons-beanutils-1.7.0.jar:/usr/hdp/2.4.3.0-227/hadoop/lib/java-xmlbuilder-0.4.jar:/usr/hdp/2.4.3.0-227/hadoop/lib/commons-beanutils-core-1.8.0.jar:/usr/hdp/2.4.3.0-227/hadoop/lib/commons-cli-1.2.jar:/usr/hdp/2.4.3.0-227/hadoop/lib/netty-3.6.2.Final.jar:/usr/hdp/2.4.3.0-227/hadoop/lib/commons-codec-1.4.jar:/usr/hdp/2.4.3.0-227/hadoop/lib/jaxb-api-2.2.2.jar:/usr/hdp/2.4.3.0-227/hadoop/lib/commons-collections-3.2.2.jar:/usr/hdp/2.4.3.0-227/hadoop/lib/protobuf-java-2.5.0.jar:/usr/hdp/2.4.3.0-227/hadoop/lib/commons-compress-1.4.1.jar:/usr/hdp/2.4.3.0-227/hadoop/lib/jaxb-impl-2.2.3-1.jar:/usr/hdp/2.4.3.0-227/hadoop/lib/commons-configuration-1.6.jar:/usr/hdp/2.4.3.0-227/hadoop/lib/servlet-api-2.5.jar:/usr/hdp/2.4.3.0-227/hadoop/lib/commons-digester-1.8.jar:/usr/hdp/2.4.3.0-227/hadoop/lib/slf4j-api-1.7.10.jar:/usr/hdp/2.4.3.0-227/hadoop/lib/commons-httpclient-3.1.jar:/usr/hdp/2.4.3.0-227/hadoop/lib/commons-io-2.4.jar:/usr/hdp/2.4.3.0-227/hadoop/lib/commons-lang-2.6.jar:/usr/hdp/2.4.3.0-227/hadoop/lib/slf4j-log4j12-1.7.10.jar:/usr/hdp/2.4.3.0-227/hadoop/lib/commons-logging-1.1.3.jar:/usr/hdp/2.4.3.0-227/hadoop/lib/snappy-java-1.0.4.1.jar:/usr/hdp/2.4.3.0-227/hadoop/lib/commons-math3-3.1.1.jar:/usr/hdp/2.4.3.0-227/hadoop/lib/commons-net-3.1.jar:/usr/hdp/2.4.3.0-227/hadoop/lib/stax-api-1.0-2.jar:/usr/hdp/2.4.3.0-227/hadoop/lib/curator-client-2.7.1.jar:/usr/hdp/2.4.3.0-227/hadoop/lib/xmlenc-0.52.jar:/usr/hdp/2.4.3.0-227/hadoop/lib/curator-framework-2.7.1.jar:/usr/hdp/2.4.3.0-227/hadoop/lib/xz-1.0.jar:/usr/hdp/2.4.3.0-227/hadoop/lib/curator-recipes-2.7.1.jar:/usr/hdp/2.4.3.0-227/hadoop/lib/gson-2.2.4.jar:/usr/hdp/2.4.3.0-227/hadoop/lib/guava-11.0.2.jar:/usr/hdp/2.4.3.0-227/hadoop/lib/zookeeper-3.4.6.2.4.3.0-227.jar:/usr/hdp/2.4.3.0-227/hadoop/lib/hamcrest-core-1.3.jar:/usr/hdp/2.4.3.0-227/hadoop/lib/mockito-all-1.8.5.jar:/usr/hdp/2.4.3.0-227/hadoop/lib/htrace-core-3.1.0-incubating.jar:/usr/hdp/2.4.3.0-227/hadoop/lib/httpclient-4.2.5.jar:/usr/hdp/2.4.3.0-227/hadoop/lib/httpcore-4.2.5.jar:/usr/hdp/2.4.3.0-227/hadoop/lib/jersey-core-1.9.jar:/usr/hdp/2.4.3.0-227/hadoop/lib/jackson-annotations-2.2.3.jar:/usr/hdp/2.4.3.0-227/hadoop/lib/jackson-core-2.2.3.jar:/usr/hdp/2.4.3.0-227/hadoop/lib/jackson-core-asl-1.9.13.jar:/usr/hdp/2.4.3.0-227/hadoop/lib/jsch-0.1.42.jar:/usr/hdp/2.4.3.0-227/hadoop/lib/jsp-api-2.1.jar:/usr/hdp/2.4.3.0-227/hadoop/lib/jsr305-3.0.0.jar:/usr/hdp/2.4.3.0-227/hadoop/lib/junit-4.11.jar:/usr/hdp/2.4.3.0-227/hadoop/lib/log4j-1.2.17.jar:/usr/hdp/2.4.3.0-227/hadoop/lib/microsoft-windowsazure-storage-sdk-0.6.0.jar:/usr/hdp/2.4.3.0-227/hadoop/.//hadoop-annotations-2.7.1.2.4.3.0-227.jar:/usr/hdp/2.4.3.0-227/hadoop/.//hadoop-annotations.jar:/usr/hdp/2.4.3.0-227/hadoop/.//hadoop-auth-2.7.1.2.4.3.0-227.jar:/usr/hdp/2.4.3.0-227/hadoop/.//hadoop-auth.jar:/usr/hdp/2.4.3.0-227/hadoop/.//hadoop-aws-2.7.1.2.4.3.0-227.jar:/usr/hdp/2.4.3.0-227/hadoop/.//hadoop-aws.jar:/usr/hdp/2.4.3.0-227/hadoop/.//hadoop-azure-2.7.1.2.4.3.0-227.jar:/usr/hdp/2.4.3.0-227/hadoop/.//hadoop-azure.jar:/usr/hdp/2.4.3.0-227/hadoop/.//hadoop-common-2.7.1.2.4.3.0-227-tests.jar:/usr/hdp/2.4.3.0-227/hadoop/.//hadoop-common-2.7.1.2.4.3.0-227.jar:/usr/hdp/2.4.3.0-227/hadoop/.//hadoop-common-tests.jar:/usr/hdp/2.4.3.0-227/hadoop/.//hadoop-common.jar:/usr/hdp/2.4.3.0-227/hadoop/.//hadoop-nfs-2.7.1.2.4.3.0-227.jar:/usr/hdp/2.4.3.0-227/hadoop/.//hadoop-nfs.jar:/usr/hdp/2.4.3.0-227/hadoop-hdfs/./:/usr/hdp/2.4.3.0-227/hadoop-hdfs/lib/asm-3.2.jar:/usr/hdp/2.4.3.0-227/hadoop-hdfs/lib/commons-cli-1.2.jar:/usr/hdp/2.4.3.0-227/hadoop-hdfs/lib/commons-codec-1.4.jar:/usr/hdp/2.4.3.0-227/hadoop-hdfs/lib/commons-daemon-1.0.13.jar:/usr/hdp/2.4.3.0-227/hadoop-hdfs/lib/commons-io-2.4.jar:/usr/hdp/2.4.3.0-227/hadoop-hdfs/lib/commons-lang-2.6.jar:/usr/hdp/2.4.3.0-227/hadoop-hdfs/lib/commons-logging-1.1.3.jar:/usr/hdp/2.4.3.0-227/hadoop-hdfs/lib/guava-11.0.2.jar:/usr/hdp/2.4.3.0-227/hadoop-hdfs/lib/htrace-core-3.1.0-incubating.jar:/usr/hdp/2.4.3.0-227/hadoop-hdfs/lib/jackson-core-asl-1.9.13.jar:/usr/hdp/2.4.3.0-227/hadoop-hdfs/lib/jackson-mapper-asl-1.9.13.jar:/usr/hdp/2.4.3.0-227/hadoop-hdfs/lib/jersey-core-1.9.jar:/usr/hdp/2.4.3.0-227/hadoop-hdfs/lib/jersey-server-1.9.jar:/usr/hdp/2.4.3.0-227/hadoop-hdfs/lib/jetty-6.1.26.hwx.jar:/usr/hdp/2.4.3.0-227/hadoop-hdfs/lib/jetty-util-6.1.26.hwx.jar:/usr/hdp/2.4.3.0-227/hadoop-hdfs/lib/jsr305-3.0.0.jar:/usr/hdp/2.4.3.0-227/hadoop-hdfs/lib/leveldbjni-all-1.8.jar:/usr/hdp/2.4.3.0-227/hadoop-hdfs/lib/log4j-1.2.17.jar:/usr/hdp/2.4.3.0-227/hadoop-hdfs/lib/netty-3.6.2.Final.jar:/usr/hdp/2.4.3.0-227/hadoop-hdfs/lib/netty-all-4.0.23.Final.jar:/usr/hdp/2.4.3.0-227/hadoop-hdfs/lib/okhttp-2.4.0.jar:/usr/hdp/2.4.3.0-227/hadoop-hdfs/lib/okio-1.4.0.jar:/usr/hdp/2.4.3.0-227/hadoop-hdfs/lib/protobuf-java-2.5.0.jar:/usr/hdp/2.4.3.0-227/hadoop-hdfs/lib/servlet-api-2.5.jar:/usr/hdp/2.4.3.0-227/hadoop-hdfs/lib/xercesImpl-2.9.1.jar:/usr/hdp/2.4.3.0-227/hadoop-hdfs/lib/xml-apis-1.3.04.jar:/usr/hdp/2.4.3.0-227/hadoop-hdfs/lib/xmlenc-0.52.jar:/usr/hdp/2.4.3.0-227/hadoop-hdfs/.//hadoop-hdfs-2.7.1.2.4.3.0-227-tests.jar:/usr/hdp/2.4.3.0-227/hadoop-hdfs/.//hadoop-hdfs-2.7.1.2.4.3.0-227.jar:/usr/hdp/2.4.3.0-227/hadoop-hdfs/.//hadoop-hdfs-nfs-2.7.1.2.4.3.0-227.jar:/usr/hdp/2.4.3.0-227/hadoop-hdfs/.//hadoop-hdfs-nfs.jar:/usr/hdp/2.4.3.0-227/hadoop-hdfs/.//hadoop-hdfs-tests.jar:/usr/hdp/2.4.3.0-227/hadoop-hdfs/.//hadoop-hdfs.jar:/usr/hdp/2.4.3.0-227/hadoop-yarn/lib/activation-1.1.jar:/usr/hdp/2.4.3.0-227/hadoop-yarn/lib/aopalliance-1.0.jar:/usr/hdp/2.4.3.0-227/hadoop-yarn/lib/jets3t-0.9.0.jar:/usr/hdp/2.4.3.0-227/hadoop-yarn/lib/apacheds-i18n-2.0.0-M15.jar:/usr/hdp/2.4.3.0-227/hadoop-yarn/lib/jaxb-api-2.2.2.jar:/usr/hdp/2.4.3.0-227/hadoop-yarn/lib/apacheds-kerberos-codec-2.0.0-M15.jar:/usr/hdp/2.4.3.0-227/hadoop-yarn/lib/jettison-1.1.jar:/usr/hdp/2.4.3.0-227/hadoop-yarn/lib/api-asn1-api-1.0.0-M20.jar:/usr/hdp/2.4.3.0-227/hadoop-yarn/lib/log4j-1.2.17.jar:/usr/hdp/2.4.3.0-227/hadoop-yarn/lib/api-util-1.0.0-M20.jar:/usr/hdp/2.4.3.0-227/hadoop-yarn/lib/asm-3.2.jar:/usr/hdp/2.4.3.0-227/hadoop-yarn/lib/avro-1.7.4.jar:/usr/hdp/2.4.3.0-227/hadoop-yarn/lib/objenesis-2.1.jar:/usr/hdp/2.4.3.0-227/hadoop-yarn/lib/commons-beanutils-1.7.0.jar:/usr/hdp/2.4.3.0-227/hadoop-yarn/lib/jaxb-impl-2.2.3-1.jar:/usr/hdp/2.4.3.0-227/hadoop-yarn/lib/commons-beanutils-core-1.8.0.jar:/usr/hdp/2.4.3.0-227/hadoop-yarn/lib/commons-cli-1.2.jar:/usr/hdp/2.4.3.0-227/hadoop-yarn/lib/netty-3.6.2.Final.jar:/usr/hdp/2.4.3.0-227/hadoop-yarn/lib/commons-codec-1.4.jar:/usr/hdp/2.4.3.0-227/hadoop-yarn/lib/jersey-client-1.9.jar:/usr/hdp/2.4.3.0-227/hadoop-yarn/lib/commons-collections-3.2.2.jar:/usr/hdp/2.4.3.0-227/hadoop-yarn/lib/paranamer-2.3.jar:/usr/hdp/2.4.3.0-227/hadoop-yarn/lib/commons-compress-1.4.1.jar:/usr/hdp/2.4.3.0-227/hadoop-yarn/lib/jersey-core-1.9.jar:/usr/hdp/2.4.3.0-227/hadoop-yarn/lib/commons-configuration-1.6.jar:/usr/hdp/2.4.3.0-227/hadoop-yarn/lib/protobuf-java-2.5.0.jar:/usr/hdp/2.4.3.0-227/hadoop-yarn/lib/commons-digester-1.8.jar:/usr/hdp/2.4.3.0-227/hadoop-yarn/lib/servlet-api-2.5.jar:/usr/hdp/2.4.3.0-227/hadoop-yarn/lib/commons-httpclient-3.1.jar:/usr/hdp/2.4.3.0-227/hadoop-yarn/lib/commons-io-2.4.jar:/usr/hdp/2.4.3.0-227/hadoop-yarn/lib/commons-lang-2.6.jar:/usr/hdp/2.4.3.0-227/hadoop-yarn/lib/snappy-java-1.0.4.1.jar:/usr/hdp/2.4.3.0-227/hadoop-yarn/lib/commons-logging-1.1.3.jar:/usr/hdp/2.4.3.0-227/hadoop-yarn/lib/stax-api-1.0-2.jar:/usr/hdp/2.4.3.0-227/hadoop-yarn/lib/commons-math3-3.1.1.jar:/usr/hdp/2.4.3.0-227/hadoop-yarn/lib/commons-net-3.1.jar:/usr/hdp/2.4.3.0-227/hadoop-yarn/lib/xmlenc-0.52.jar:/usr/hdp/2.4.3.0-227/hadoop-yarn/lib/curator-client-2.7.1.jar:/usr/hdp/2.4.3.0-227/hadoop-yarn/lib/xz-1.0.jar:/usr/hdp/2.4.3.0-227/hadoop-yarn/lib/curator-framework-2.7.1.jar:/usr/hdp/2.4.3.0-227/hadoop-yarn/lib/zookeeper-3.4.6.2.4.3.0-227.jar:/usr/hdp/2.4.3.0-227/hadoop-yarn/lib/curator-recipes-2.7.1.jar:/usr/hdp/2.4.3.0-227/hadoop-yarn/lib/fst-2.24.jar:/usr/hdp/2.4.3.0-227/hadoop-yarn/lib/gson-2.2.4.jar:/usr/hdp/2.4.3.0-227/hadoop-yarn/lib/guava-11.0.2.jar:/usr/hdp/2.4.3.0-227/hadoop-yarn/lib/guice-3.0.jar:/usr/hdp/2.4.3.0-227/hadoop-yarn/lib/zookeeper-3.4.6.2.4.3.0-227-tests.jar:/usr/hdp/2.4.3.0-227/hadoop-yarn/lib/guice-servlet-3.0.jar:/usr/hdp/2.4.3.0-227/hadoop-yarn/lib/jersey-guice-1.9.jar:/usr/hdp/2.4.3.0-227/hadoop-yarn/lib/htrace-core-3.1.0-incubating.jar:/usr/hdp/2.4.3.0-227/hadoop-yarn/lib/httpclient-4.2.5.jar:/usr/hdp/2.4.3.0-227/hadoop-yarn/lib/httpcore-4.2.5.jar:/usr/hdp/2.4.3.0-227/hadoop-yarn/lib/jersey-json-1.9.jar:/usr/hdp/2.4.3.0-227/hadoop-yarn/lib/jackson-annotations-2.2.3.jar:/usr/hdp/2.4.3.0-227/hadoop-yarn/lib/jackson-core-2.2.3.jar:/usr/hdp/2.4.3.0-227/hadoop-yarn/lib/jackson-core-asl-1.9.13.jar:/usr/hdp/2.4.3.0-227/hadoop-yarn/lib/jackson-databind-2.2.3.jar:/usr/hdp/2.4.3.0-227/hadoop-yarn/lib/jackson-jaxrs-1.9.13.jar:/usr/hdp/2.4.3.0-227/hadoop-yarn/lib/microsoft-windowsazure-storage-sdk-0.6.0.jar:/usr/hdp/2.4.3.0-227/hadoop-yarn/lib/jackson-mapper-asl-1.9.13.jar:/usr/hdp/2.4.3.0-227/hadoop-yarn/lib/jackson-xc-1.9.13.jar:/usr/hdp/2.4.3.0-227/hadoop-yarn/lib/java-xmlbuilder-0.4.jar:/usr/hdp/2.4.3.0-227/hadoop-yarn/lib/javassist-3.18.1-GA.jar:/usr/hdp/2.4.3.0-227/hadoop-yarn/lib/javax.inject-1.jar:/usr/hdp/2.4.3.0-227/hadoop-yarn/lib/jersey-server-1.9.jar:/usr/hdp/2.4.3.0-227/hadoop-yarn/lib/jetty-6.1.26.hwx.jar:/usr/hdp/2.4.3.0-227/hadoop-yarn/lib/jetty-util-6.1.26.hwx.jar:/usr/hdp/2.4.3.0-227/hadoop-yarn/lib/jsch-0.1.42.jar:/usr/hdp/2.4.3.0-227/hadoop-yarn/lib/jsp-api-2.1.jar:/usr/hdp/2.4.3.0-227/hadoop-yarn/lib/jsr305-3.0.0.jar:/usr/hdp/2.4.3.0-227/hadoop-yarn/lib/leveldbjni-all-1.8.jar:/usr/hdp/2.4.3.0-227/hadoop-yarn/.//hadoop-yarn-api-2.7.1.2.4.3.0-227.jar:/usr/hdp/2.4.3.0-227/hadoop-yarn/.//hadoop-yarn-api.jar:/usr/hdp/2.4.3.0-227/hadoop-yarn/.//hadoop-yarn-applications-distributedshell-2.7.1.2.4.3.0-227.jar:/usr/hdp/2.4.3.0-227/hadoop-yarn/.//hadoop-yarn-applications-distributedshell.jar:/usr/hdp/2.4.3.0-227/hadoop-yarn/.//hadoop-yarn-applications-unmanaged-am-launcher-2.7.1.2.4.3.0-227.jar:/usr/hdp/2.4.3.0-227/hadoop-yarn/.//hadoop-yarn-applications-unmanaged-am-launcher.jar:/usr/hdp/2.4.3.0-227/hadoop-yarn/.//hadoop-yarn-client-2.7.1.2.4.3.0-227.jar:/usr/hdp/2.4.3.0-227/hadoop-yarn/.//hadoop-yarn-client.jar:/usr/hdp/2.4.3.0-227/hadoop-yarn/.//hadoop-yarn-common-2.7.1.2.4.3.0-227.jar:/usr/hdp/2.4.3.0-227/hadoop-yarn/.//hadoop-yarn-common.jar:/usr/hdp/2.4.3.0-227/hadoop-yarn/.//hadoop-yarn-registry-2.7.1.2.4.3.0-227.jar:/usr/hdp/2.4.3.0-227/hadoop-yarn/.//hadoop-yarn-registry.jar:/usr/hdp/2.4.3.0-227/hadoop-yarn/.//hadoop-yarn-server-applicationhistoryservice-2.7.1.2.4.3.0-227.jar:/usr/hdp/2.4.3.0-227/hadoop-yarn/.//hadoop-yarn-server-applicationhistoryservice.jar:/usr/hdp/2.4.3.0-227/hadoop-yarn/.//hadoop-yarn-server-common-2.7.1.2.4.3.0-227.jar:/usr/hdp/2.4.3.0-227/hadoop-yarn/.//hadoop-yarn-server-common.jar:/usr/hdp/2.4.3.0-227/hadoop-yarn/.//hadoop-yarn-server-nodemanager-2.7.1.2.4.3.0-227.jar:/usr/hdp/2.4.3.0-227/hadoop-yarn/.//hadoop-yarn-server-nodemanager.jar:/usr/hdp/2.4.3.0-227/hadoop-yarn/.//hadoop-yarn-server-resourcemanager-2.7.1.2.4.3.0-227.jar:/usr/hdp/2.4.3.0-227/hadoop-yarn/.//hadoop-yarn-server-resourcemanager.jar:/usr/hdp/2.4.3.0-227/hadoop-yarn/.//hadoop-yarn-server-sharedcachemanager-2.7.1.2.4.3.0-227.jar:/usr/hdp/2.4.3.0-227/hadoop-yarn/.//hadoop-yarn-server-sharedcachemanager.jar:/usr/hdp/2.4.3.0-227/hadoop-yarn/.//hadoop-yarn-server-tests-2.7.1.2.4.3.0-227.jar:/usr/hdp/2.4.3.0-227/hadoop-yarn/.//hadoop-yarn-server-tests.jar:/usr/hdp/2.4.3.0-227/hadoop-yarn/.//hadoop-yarn-server-timeline-plugins-2.7.1.2.4.3.0-227.jar:/usr/hdp/2.4.3.0-227/hadoop-yarn/.//hadoop-yarn-server-timeline-plugins.jar:/usr/hdp/2.4.3.0-227/hadoop-yarn/.//hadoop-yarn-server-web-proxy-2.7.1.2.4.3.0-227.jar:/usr/hdp/2.4.3.0-227/hadoop-yarn/.//hadoop-yarn-server-web-proxy.jar:/usr/hdp/2.4.3.0-227/hadoop-mapreduce/lib/aopalliance-1.0.jar:/usr/hdp/2.4.3.0-227/hadoop-mapreduce/lib/asm-3.2.jar:/usr/hdp/2.4.3.0-227/hadoop-mapreduce/lib/avro-1.7.4.jar:/usr/hdp/2.4.3.0-227/hadoop-mapreduce/lib/commons-compress-1.4.1.jar:/usr/hdp/2.4.3.0-227/hadoop-mapreduce/lib/commons-io-2.4.jar:/usr/hdp/2.4.3.0-227/hadoop-mapreduce/lib/guice-3.0.jar:/usr/hdp/2.4.3.0-227/hadoop-mapreduce/lib/guice-servlet-3.0.jar:/usr/hdp/2.4.3.0-227/hadoop-mapreduce/lib/hamcrest-core-1.3.jar:/usr/hdp/2.4.3.0-227/hadoop-mapreduce/lib/jackson-core-asl-1.9.13.jar:/usr/hdp/2.4.3.0-227/hadoop-mapreduce/lib/jackson-mapper-asl-1.9.13.jar:/usr/hdp/2.4.3.0-227/hadoop-mapreduce/lib/javax.inject-1.jar:/usr/hdp/2.4.3.0-227/hadoop-mapreduce/lib/jersey-core-1.9.jar:/usr/hdp/2.4.3.0-227/hadoop-mapreduce/lib/jersey-guice-1.9.jar:/usr/hdp/2.4.3.0-227/hadoop-mapreduce/lib/jersey-server-1.9.jar:/usr/hdp/2.4.3.0-227/hadoop-mapreduce/lib/junit-4.11.jar:/usr/hdp/2.4.3.0-227/hadoop-mapreduce/lib/leveldbjni-all-1.8.jar:/usr/hdp/2.4.3.0-227/hadoop-mapreduce/lib/log4j-1.2.17.jar:/usr/hdp/2.4.3.0-227/hadoop-mapreduce/lib/netty-3.6.2.Final.jar:/usr/hdp/2.4.3.0-227/hadoop-mapreduce/lib/paranamer-2.3.jar:/usr/hdp/2.4.3.0-227/hadoop-mapreduce/lib/protobuf-java-2.5.0.jar:/usr/hdp/2.4.3.0-227/hadoop-mapreduce/lib/snappy-java-1.0.4.1.jar:/usr/hdp/2.4.3.0-227/hadoop-mapreduce/lib/xz-1.0.jar:/usr/hdp/2.4.3.0-227/hadoop-mapreduce/.//jaxb-api-2.2.2.jar:/usr/hdp/2.4.3.0-227/hadoop-mapreduce/.//activation-1.1.jar:/usr/hdp/2.4.3.0-227/hadoop-mapreduce/.//hadoop-sls-2.7.1.2.4.3.0-227.jar:/usr/hdp/2.4.3.0-227/hadoop-mapreduce/.//apacheds-i18n-2.0.0-M15.jar:/usr/hdp/2.4.3.0-227/hadoop-mapreduce/.//hadoop-mapreduce-client-app-2.7.1.2.4.3.0-227.jar:/usr/hdp/2.4.3.0-227/hadoop-mapreduce/.//apacheds-kerberos-codec-2.0.0-M15.jar:/usr/hdp/2.4.3.0-227/hadoop-mapreduce/.//hadoop-sls.jar:/usr/hdp/2.4.3.0-227/hadoop-mapreduce/.//api-asn1-api-1.0.0-M20.jar:/usr/hdp/2.4.3.0-227/hadoop-mapreduce/.//hamcrest-core-1.3.jar:/usr/hdp/2.4.3.0-227/hadoop-mapreduce/.//api-util-1.0.0-M20.jar:/usr/hdp/2.4.3.0-227/hadoop-mapreduce/.//log4j-1.2.17.jar:/usr/hdp/2.4.3.0-227/hadoop-mapreduce/.//asm-3.2.jar:/usr/hdp/2.4.3.0-227/hadoop-mapreduce/.//jaxb-impl-2.2.3-1.jar:/usr/hdp/2.4.3.0-227/hadoop-mapreduce/.//avro-1.7.4.jar:/usr/hdp/2.4.3.0-227/hadoop-mapreduce/.//hadoop-streaming.jar:/usr/hdp/2.4.3.0-227/hadoop-mapreduce/.//commons-beanutils-1.7.0.jar:/usr/hdp/2.4.3.0-227/hadoop-mapreduce/.//hadoop-mapreduce-client-common.jar:/usr/hdp/2.4.3.0-227/hadoop-mapreduce/.//commons-beanutils-core-1.8.0.jar:/usr/hdp/2.4.3.0-227/hadoop-mapreduce/.//jersey-core-1.9.jar:/usr/hdp/2.4.3.0-227/hadoop-mapreduce/.//commons-cli-1.2.jar:/usr/hdp/2.4.3.0-227/hadoop-mapreduce/.//httpcore-4.2.5.jar:/usr/hdp/2.4.3.0-227/hadoop-mapreduce/.//commons-codec-1.4.jar:/usr/hdp/2.4.3.0-227/hadoop-mapreduce/.//hadoop-mapreduce-client-jobclient-tests.jar:/usr/hdp/2.4.3.0-227/hadoop-mapreduce/.//commons-collections-3.2.2.jar:/usr/hdp/2.4.3.0-227/hadoop-mapreduce/.//htrace-core-3.1.0-incubating.jar:/usr/hdp/2.4.3.0-227/hadoop-mapreduce/.//commons-compress-1.4.1.jar:/usr/hdp/2.4.3.0-227/hadoop-mapreduce/.//hadoop-mapreduce-client-jobclient.jar:/usr/hdp/2.4.3.0-227/hadoop-mapreduce/.//commons-configuration-1.6.jar:/usr/hdp/2.4.3.0-227/hadoop-mapreduce/.//httpclient-4.2.5.jar:/usr/hdp/2.4.3.0-227/hadoop-mapreduce/.//commons-digester-1.8.jar:/usr/hdp/2.4.3.0-227/hadoop-mapreduce/.//jackson-core-2.2.3.jar:/usr/hdp/2.4.3.0-227/hadoop-mapreduce/.//commons-httpclient-3.1.jar:/usr/hdp/2.4.3.0-227/hadoop-mapreduce/.//jersey-json-1.9.jar:/usr/hdp/2.4.3.0-227/hadoop-mapreduce/.//commons-io-2.4.jar:/usr/hdp/2.4.3.0-227/hadoop-mapreduce/.//jersey-server-1.9.jar:/usr/hdp/2.4.3.0-227/hadoop-mapreduce/.//commons-lang-2.6.jar:/usr/hdp/2.4.3.0-227/hadoop-mapreduce/.//jackson-core-asl-1.9.13.jar:/usr/hdp/2.4.3.0-227/hadoop-mapreduce/.//commons-lang3-3.3.2.jar:/usr/hdp/2.4.3.0-227/hadoop-mapreduce/.//jackson-jaxrs-1.9.13.jar:/usr/hdp/2.4.3.0-227/hadoop-mapreduce/.//commons-logging-1.1.3.jar:/usr/hdp/2.4.3.0-227/hadoop-mapreduce/.//java-xmlbuilder-0.4.jar:/usr/hdp/2.4.3.0-227/hadoop-mapreduce/.//commons-math3-3.1.1.jar:/usr/hdp/2.4.3.0-227/hadoop-mapreduce/.//jets3t-0.9.0.jar:/usr/hdp/2.4.3.0-227/hadoop-mapreduce/.//commons-net-3.1.jar:/usr/hdp/2.4.3.0-227/hadoop-mapreduce/.//jackson-mapper-asl-1.9.13.jar:/usr/hdp/2.4.3.0-227/hadoop-mapreduce/.//curator-client-2.7.1.jar:/usr/hdp/2.4.3.0-227/hadoop-mapreduce/.//jackson-xc-1.9.13.jar:/usr/hdp/2.4.3.0-227/hadoop-mapreduce/.//curator-framework-2.7.1.jar:/usr/hdp/2.4.3.0-227/hadoop-mapreduce/.//mockito-all-1.8.5.jar:/usr/hdp/2.4.3.0-227/hadoop-mapreduce/.//curator-recipes-2.7.1.jar:/usr/hdp/2.4.3.0-227/hadoop-mapreduce/.//jettison-1.1.jar:/usr/hdp/2.4.3.0-227/hadoop-mapreduce/.//gson-2.2.4.jar:/usr/hdp/2.4.3.0-227/hadoop-mapreduce/.//jetty-6.1.26.hwx.jar:/usr/hdp/2.4.3.0-227/hadoop-mapreduce/.//guava-11.0.2.jar:/usr/hdp/2.4.3.0-227/hadoop-mapreduce/.//hadoop-mapreduce-examples.jar:/usr/hdp/2.4.3.0-227/hadoop-mapreduce/.//hadoop-ant-2.7.1.2.4.3.0-227.jar:/usr/hdp/2.4.3.0-227/hadoop-mapreduce/.//jetty-util-6.1.26.hwx.jar:/usr/hdp/2.4.3.0-227/hadoop-mapreduce/.//hadoop-ant.jar:/usr/hdp/2.4.3.0-227/hadoop-mapreduce/.//hadoop-mapreduce-client-app.jar:/usr/hdp/2.4.3.0-227/hadoop-mapreduce/.//hadoop-archives-2.7.1.2.4.3.0-227.jar:/usr/hdp/2.4.3.0-227/hadoop-mapreduce/.//joda-time-2.9.4.jar:/usr/hdp/2.4.3.0-227/hadoop-mapreduce/.//hadoop-archives.jar:/usr/hdp/2.4.3.0-227/hadoop-mapreduce/.//hadoop-mapreduce-client-shuffle.jar:/usr/hdp/2.4.3.0-227/hadoop-mapreduce/.//hadoop-auth-2.7.1.2.4.3.0-227.jar:/usr/hdp/2.4.3.0-227/hadoop-mapreduce/.//jsch-0.1.42.jar:/usr/hdp/2.4.3.0-227/hadoop-mapreduce/.//hadoop-auth.jar:/usr/hdp/2.4.3.0-227/hadoop-mapreduce/.//hadoop-mapreduce-client-common-2.7.1.2.4.3.0-227.jar:/usr/hdp/2.4.3.0-227/hadoop-mapreduce/.//hadoop-datajoin-2.7.1.2.4.3.0-227.jar:/usr/hdp/2.4.3.0-227/hadoop-mapreduce/.//jsp-api-2.1.jar:/usr/hdp/2.4.3.0-227/hadoop-mapreduce/.//hadoop-datajoin.jar:/usr/hdp/2.4.3.0-227/hadoop-mapreduce/.//hadoop-rumen.jar:/usr/hdp/2.4.3.0-227/hadoop-mapreduce/.//hadoop-distcp-2.7.1.2.4.3.0-227.jar:/usr/hdp/2.4.3.0-227/hadoop-mapreduce/.//jsr305-3.0.0.jar:/usr/hdp/2.4.3.0-227/hadoop-mapreduce/.//hadoop-distcp.jar:/usr/hdp/2.4.3.0-227/hadoop-mapreduce/.//hadoop-openstack-2.7.1.2.4.3.0-227.jar:/usr/hdp/2.4.3.0-227/hadoop-mapreduce/.//hadoop-extras-2.7.1.2.4.3.0-227.jar:/usr/hdp/2.4.3.0-227/hadoop-mapreduce/.//junit-4.11.jar:/usr/hdp/2.4.3.0-227/hadoop-mapreduce/.//hadoop-extras.jar:/usr/hdp/2.4.3.0-227/hadoop-mapreduce/.//hadoop-openstack.jar:/usr/hdp/2.4.3.0-227/hadoop-mapreduce/.//xz-1.0.jar:/usr/hdp/2.4.3.0-227/hadoop-mapreduce/.//hadoop-gridmix-2.7.1.2.4.3.0-227.jar:/usr/hdp/2.4.3.0-227/hadoop-mapreduce/.//metrics-core-3.0.1.jar:/usr/hdp/2.4.3.0-227/hadoop-mapreduce/.//hadoop-gridmix.jar:/usr/hdp/2.4.3.0-227/hadoop-mapreduce/.//hadoop-mapreduce-client-hs-plugins-2.7.1.2.4.3.0-227.jar:/usr/hdp/2.4.3.0-227/hadoop-mapreduce/.//hadoop-mapreduce-client-core-2.7.1.2.4.3.0-227.jar:/usr/hdp/2.4.3.0-227/hadoop-mapreduce/.//hadoop-rumen-2.7.1.2.4.3.0-227.jar:/usr/hdp/2.4.3.0-227/hadoop-mapreduce/.//hadoop-mapreduce-client-core.jar:/usr/hdp/2.4.3.0-227/hadoop-mapreduce/.//hadoop-mapreduce-client-hs-plugins.jar:/usr/hdp/2.4.3.0-227/hadoop-mapreduce/.//hadoop-mapreduce-client-hs-2.7.1.2.4.3.0-227.jar:/usr/hdp/2.4.3.0-227/hadoop-mapreduce/.//hadoop-streaming-2.7.1.2.4.3.0-227.jar:/usr/hdp/2.4.3.0-227/hadoop-mapreduce/.//hadoop-mapreduce-client-hs.jar:/usr/hdp/2.4.3.0-227/hadoop-mapreduce/.//hadoop-mapreduce-client-jobclient-2.7.1.2.4.3.0-227-tests.jar:/usr/hdp/2.4.3.0-227/hadoop-mapreduce/.//hadoop-mapreduce-client-jobclient-2.7.1.2.4.3.0-227.jar:/usr/hdp/2.4.3.0-227/hadoop-mapreduce/.//hadoop-mapreduce-client-shuffle-2.7.1.2.4.3.0-227.jar:/usr/hdp/2.4.3.0-227/hadoop-mapreduce/.//hadoop-mapreduce-examples-2.7.1.2.4.3.0-227.jar:/usr/hdp/2.4.3.0-227/hadoop-mapreduce/.//microsoft-windowsazure-storage-sdk-0.6.0.jar:/usr/hdp/2.4.3.0-227/hadoop-mapreduce/.//netty-3.6.2.Final.jar:/usr/hdp/2.4.3.0-227/hadoop-mapreduce/.//paranamer-2.3.jar:/usr/hdp/2.4.3.0-227/hadoop-mapreduce/.//protobuf-java-2.5.0.jar:/usr/hdp/2.4.3.0-227/hadoop-mapreduce/.//servlet-api-2.5.jar:/usr/hdp/2.4.3.0-227/hadoop-mapreduce/.//snappy-java-1.0.4.1.jar:/usr/hdp/2.4.3.0-227/hadoop-mapreduce/.//stax-api-1.0-2.jar:/usr/hdp/2.4.3.0-227/hadoop-mapreduce/.//xmlenc-0.52.jar:/usr/hdp/2.4.3.0-227/hadoop-mapreduce/.//zookeeper-3.4.6.2.4.3.0-227.jar::postgresql-jdbc2ee.jar:postgresql-jdbc2.jar:postgresql-jdbc3.jar:postgresql-jdbc.jar:/usr/hdp/2.4.3.0-227/tez/tez-api-0.7.0.2.4.3.0-227.jar:/usr/hdp/2.4.3.0-227/tez/tez-common-0.7.0.2.4.3.0-227.jar:/usr/hdp/2.4.3.0-227/tez/tez-dag-0.7.0.2.4.3.0-227.jar:/usr/hdp/2.4.3.0-227/tez/tez-examples-0.7.0.2.4.3.0-227.jar:/usr/hdp/2.4.3.0-227/tez/tez-history-parser-0.7.0.2.4.3.0-227.jar:/usr/hdp/2.4.3.0-227/tez/tez-mapreduce-0.7.0.2.4.3.0-227.jar:/usr/hdp/2.4.3.0-227/tez/tez-runtime-internals-0.7.0.2.4.3.0-227.jar:/usr/hdp/2.4.3.0-227/tez/tez-runtime-library-0.7.0.2.4.3.0-227.jar:/usr/hdp/2.4.3.0-227/tez/tez-tests-0.7.0.2.4.3.0-227.jar:/usr/hdp/2.4.3.0-227/tez/tez-yarn-timeline-cache-plugin-0.7.0.2.4.3.0-227.jar:/usr/hdp/2.4.3.0-227/tez/tez-yarn-timeline-history-0.7.0.2.4.3.0-227.jar:/usr/hdp/2.4.3.0-227/tez/tez-yarn-timeline-history-with-acls-0.7.0.2.4.3.0-227.jar:/usr/hdp/2.4.3.0-227/tez/tez-yarn-timeline-history-with-fs-0.7.0.2.4.3.0-227.jar:/usr/hdp/2.4.3.0-227/tez/lib/commons-cli-1.2.jar:/usr/hdp/2.4.3.0-227/tez/lib/commons-codec-1.4.jar:/usr/hdp/2.4.3.0-227/tez/lib/commons-collections-3.2.2.jar:/usr/hdp/2.4.3.0-227/tez/lib/commons-collections4-4.1.jar:/usr/hdp/2.4.3.0-227/tez/lib/commons-io-2.4.jar:/usr/hdp/2.4.3.0-227/tez/lib/commons-lang-2.6.jar:/usr/hdp/2.4.3.0-227/tez/lib/commons-math3-3.1.1.jar:/usr/hdp/2.4.3.0-227/tez/lib/guava-11.0.2.jar:/usr/hdp/2.4.3.0-227/tez/lib/hadoop-annotations-2.7.1.2.4.3.0-227.jar:/usr/hdp/2.4.3.0-227/tez/lib/hadoop-aws-2.7.1.2.4.3.0-227.jar:/usr/hdp/2.4.3.0-227/tez/lib/hadoop-azure-2.7.1.2.4.3.0-227.jar:/usr/hdp/2.4.3.0-227/tez/lib/hadoop-mapreduce-client-common-2.7.1.2.4.3.0-227.jar:/usr/hdp/2.4.3.0-227/tez/lib/hadoop-mapreduce-client-core-2.7.1.2.4.3.0-227.jar:/usr/hdp/2.4.3.0-227/tez/lib/hadoop-yarn-server-timeline-plugins-2.7.1.2.4.3.0-227.jar:/usr/hdp/2.4.3.0-227/tez/lib/hadoop-yarn-server-web-proxy-2.7.1.2.4.3.0-227.jar:/usr/hdp/2.4.3.0-227/tez/lib/jersey-client-1.9.jar:/usr/hdp/2.4.3.0-227/tez/lib/jersey-json-1.9.jar:/usr/hdp/2.4.3.0-227/tez/lib/jettison-1.3.4.jar:/usr/hdp/2.4.3.0-227/tez/lib/jetty-6.1.26.hwx.jar:/usr/hdp/2.4.3.0-227/tez/lib/jetty-util-6.1.26.hwx.jar:/usr/hdp/2.4.3.0-227/tez/lib/jsr305-2.0.3.jar:/usr/hdp/2.4.3.0-227/tez/lib/protobuf-java-2.5.0.jar:/usr/hdp/2.4.3.0-227/tez/lib/servlet-api-2.5.jar:/usr/hdp/2.4.3.0-227/tez/lib/slf4j-api-1.7.5.jar:/usr/hdp/2.4.3.0-227/tez/conf:postgresql-jdbc2ee.jar:postgresql-jdbc2.jar:postgresql-jdbc3.jar:postgresql-jdbc.jar:postgresql-jdbc2ee.jar:postgresql-jdbc2.jar:postgresql-jdbc3.jar:postgresql-jdbc.jar:/usr/hdp/2.4.3.0-227/tez/tez-api-0.7.0.2.4.3.0-227.jar:/usr/hdp/2.4.3.0-227/tez/tez-common-0.7.0.2.4.3.0-227.jar:/usr/hdp/2.4.3.0-227/tez/tez-dag-0.7.0.2.4.3.0-227.jar:/usr/hdp/2.4.3.0-227/tez/tez-examples-0.7.0.2.4.3.0-227.jar:/usr/hdp/2.4.3.0-227/tez/tez-history-parser-0.7.0.2.4.3.0-227.jar:/usr/hdp/2.4.3.0-227/tez/tez-mapreduce-0.7.0.2.4.3.0-227.jar:/usr/hdp/2.4.3.0-227/tez/tez-runtime-internals-0.7.0.2.4.3.0-227.jar:/usr/hdp/2.4.3.0-227/tez/tez-runtime-library-0.7.0.2.4.3.0-227.jar:/usr/hdp/2.4.3.0-227/tez/tez-tests-0.7.0.2.4.3.0-227.jar:/usr/hdp/2.4.3.0-227/tez/tez-yarn-timeline-cache-plugin-0.7.0.2.4.3.0-227.jar:/usr/hdp/2.4.3.0-227/tez/tez-yarn-timeline-history-0.7.0.2.4.3.0-227.jar:/usr/hdp/2.4.3.0-227/tez/tez-yarn-timeline-history-with-acls-0.7.0.2.4.3.0-227.jar:/usr/hdp/2.4.3.0-227/tez/tez-yarn-timeline-history-with-fs-0.7.0.2.4.3.0-227.jar:/usr/hdp/2.4.3.0-227/tez/lib/commons-cli-1.2.jar:/usr/hdp/2.4.3.0-227/tez/lib/commons-codec-1.4.jar:/usr/hdp/2.4.3.0-227/tez/lib/commons-collections-3.2.2.jar:/usr/hdp/2.4.3.0-227/tez/lib/commons-collections4-4.1.jar:/usr/hdp/2.4.3.0-227/tez/lib/commons-io-2.4.jar:/usr/hdp/2.4.3.0-227/tez/lib/commons-lang-2.6.jar:/usr/hdp/2.4.3.0-227/tez/lib/commons-math3-3.1.1.jar:/usr/hdp/2.4.3.0-227/tez/lib/guava-11.0.2.jar:/usr/hdp/2.4.3.0-227/tez/lib/hadoop-annotations-2.7.1.2.4.3.0-227.jar:/usr/hdp/2.4.3.0-227/tez/lib/hadoop-aws-2.7.1.2.4.3.0-227.jar:/usr/hdp/2.4.3.0-227/tez/lib/hadoop-azure-2.7.1.2.4.3.0-227.jar:/usr/hdp/2.4.3.0-227/tez/lib/hadoop-mapreduce-client-common-2.7.1.2.4.3.0-227.jar:/usr/hdp/2.4.3.0-227/tez/lib/hadoop-mapreduce-client-core-2.7.1.2.4.3.0-227.jar:/usr/hdp/2.4.3.0-227/tez/lib/hadoop-yarn-server-timeline-plugins-2.7.1.2.4.3.0-227.jar:/usr/hdp/2.4.3.0-227/tez/lib/hadoop-yarn-server-web-proxy-2.7.1.2.4.3.0-227.jar:/usr/hdp/2.4.3.0-227/tez/lib/jersey-client-1.9.jar:/usr/hdp/2.4.3.0-227/tez/lib/jersey-json-1.9.jar:/usr/hdp/2.4.3.0-227/tez/lib/jettison-1.3.4.jar:/usr/hdp/2.4.3.0-227/tez/lib/jetty-6.1.26.hwx.jar:/usr/hdp/2.4.3.0-227/tez/lib/jetty-util-6.1.26.hwx.jar:/usr/hdp/2.4.3.0-227/tez/lib/jsr305-2.0.3.jar:/usr/hdp/2.4.3.0-227/tez/lib/protobuf-java-2.5.0.jar:/usr/hdp/2.4.3.0-227/tez/lib/servlet-api-2.5.jar:/usr/hdp/2.4.3.0-227/tez/lib/slf4j-api-1.7.5.jar:/usr/hdp/2.4.3.0-227/tez/conf STARTUP_MSG: build = git@github.com:hortonworks/hadoop.git -r 7e73cf651746a25cc06f303750bf26fa02652e8a; compiled by 'jenkins' on 2016-09-09T22:44Z STARTUP_MSG: java = 1.8.0_60 ************************************************************/ 2017-09-27 08:25:06,621 INFO namenode.NameNode (LogAdapter.java:info(47)) - registered UNIX signal handlers for [TERM, HUP, INT] 2017-09-27 08:25:06,626 INFO namenode.NameNode (NameNode.java:createNameNode(1559)) - createNameNode [] 2017-09-27 08:25:07,017 INFO impl.MetricsConfig (MetricsConfig.java:loadFirst(112)) - loaded properties from hadoop-metrics2.properties 2017-09-27 08:25:07,183 INFO timeline.HadoopTimelineMetricsSink (HadoopTimelineMetricsSink.java:init(64)) - Initializing Timeline metrics sink. 2017-09-27 08:25:07,183 INFO timeline.HadoopTimelineMetricsSink (HadoopTimelineMetricsSink.java:init(82)) - Identified hostname = standbynamenode-t5liwl46t1.hdp.local, serviceName = namenode 2017-09-27 08:25:07,276 INFO timeline.HadoopTimelineMetricsSink (HadoopTimelineMetricsSink.java:init(99)) - Collector Uri: http://bdaap-ce6dol7nyx.hdp.local:6188/ws/v1/timeline/metrics 2017-09-27 08:25:07,280 INFO timeline.HadoopTimelineMetricsSink (HadoopTimelineMetricsSink.java:init(147)) - RPC port properties configured: {8020=client} 2017-09-27 08:25:07,287 INFO impl.MetricsSinkAdapter (MetricsSinkAdapter.java:start(206)) - Sink timeline started 2017-09-27 08:25:07,397 INFO impl.MetricsSystemImpl (MetricsSystemImpl.java:startTimer(376)) - Scheduled snapshot period at 10 second(s). 2017-09-27 08:25:07,397 INFO impl.MetricsSystemImpl (MetricsSystemImpl.java:start(192)) - NameNode metrics system started 2017-09-27 08:25:07,400 INFO namenode.NameNode (NameNode.java:setClientNamenodeAddress(424)) - fs.defaultFS is hdfs://mycluster 2017-09-27 08:25:07,400 INFO namenode.NameNode (NameNode.java:setClientNamenodeAddress(444)) - Clients are to use mycluster to access this namenode/service. 2017-09-27 08:25:07,762 INFO security.UserGroupInformation (UserGroupInformation.java:loginUserFromKeytab(990)) - Login successful for user nn/standbynamenode-t5liwl46t1.hdp.local@HDP.LOCAL using keytab file /etc/security/keytabs/nn.service.keytab 2017-09-27 08:25:07,795 INFO util.JvmPauseMonitor (JvmPauseMonitor.java:run(179)) - Starting JVM pause monitor 2017-09-27 08:25:07,795 INFO hdfs.DFSUtil (DFSUtil.java:httpServerTemplateForNNAndJN(1757)) - Starting web server as: HTTP/standbynamenode-t5liwl46t1.hdp.local@HDP.LOCAL 2017-09-27 08:25:07,797 INFO hdfs.DFSUtil (DFSUtil.java:httpServerTemplateForNNAndJN(1769)) - Starting Web-server for hdfs at: http://standbynamenode-t5liwl46t1.hdp.local:50070 2017-09-27 08:25:07,860 INFO mortbay.log (Slf4jLog.java:info(67)) - Logging to org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2017-09-27 08:25:07,869 INFO server.AuthenticationFilter (AuthenticationFilter.java:constructSecretProvider(294)) - Unable to initialize FileSignerSecretProvider, falling back to use random secrets. 2017-09-27 08:25:07,876 INFO http.HttpRequestLog (HttpRequestLog.java:getRequestLog(80)) - Http request log for http.requests.namenode is not defined 2017-09-27 08:25:07,882 INFO http.HttpServer2 (HttpServer2.java:addGlobalFilter(710)) - Added global filter 'safety' (class=org.apache.hadoop.http.HttpServer2$QuotingInputFilter) 2017-09-27 08:25:07,885 INFO http.HttpServer2 (HttpServer2.java:addFilter(685)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context hdfs 2017-09-27 08:25:07,885 INFO http.HttpServer2 (HttpServer2.java:addFilter(693)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context static 2017-09-27 08:25:07,885 INFO http.HttpServer2 (HttpServer2.java:addFilter(693)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context logs 2017-09-27 08:25:07,886 INFO security.HttpCrossOriginFilterInitializer (HttpCrossOriginFilterInitializer.java:initFilter(49)) - CORS filter not enabled. Please set hadoop.http.cross-origin.enabled to 'true' to enable it 2017-09-27 08:25:07,913 INFO http.HttpServer2 (NameNodeHttpServer.java:initWebHdfs(89)) - Added filter 'org.apache.hadoop.hdfs.web.AuthFilter' (class=org.apache.hadoop.hdfs.web.AuthFilter) 2017-09-27 08:25:07,914 INFO http.HttpServer2 (HttpServer2.java:addJerseyResourcePackage(609)) - addJerseyResourcePackage: packageName=org.apache.hadoop.hdfs.server.namenode.web.resources;org.apache.hadoop.hdfs.web.resources, pathSpec=/webhdfs/v1/* 2017-09-27 08:25:07,934 INFO http.HttpServer2 (HttpServer2.java:addInternalServlet(667)) - Adding Kerberos (SPNEGO) filter to getDelegationToken 2017-09-27 08:25:07,935 INFO http.HttpServer2 (HttpServer2.java:addInternalServlet(667)) - Adding Kerberos (SPNEGO) filter to renewDelegationToken 2017-09-27 08:25:07,936 INFO http.HttpServer2 (HttpServer2.java:addInternalServlet(667)) - Adding Kerberos (SPNEGO) filter to cancelDelegationToken 2017-09-27 08:25:07,937 INFO http.HttpServer2 (HttpServer2.java:addInternalServlet(667)) - Adding Kerberos (SPNEGO) filter to fsck 2017-09-27 08:25:07,938 INFO http.HttpServer2 (HttpServer2.java:addInternalServlet(667)) - Adding Kerberos (SPNEGO) filter to imagetransfer 2017-09-27 08:25:07,950 INFO http.HttpServer2 (HttpServer2.java:openListeners(915)) - Jetty bound to port 50070 2017-09-27 08:25:07,950 INFO mortbay.log (Slf4jLog.java:info(67)) - jetty-6.1.26.hwx 2017-09-27 08:25:08,235 INFO server.KerberosAuthenticationHandler (KerberosAuthenticationHandler.java:init(215)) - Login using keytab /etc/security/keytabs/spnego.service.keytab, for principal HTTP/standbynamenode-t5liwl46t1.hdp.local@HDP.LOCAL 2017-09-27 08:25:08,243 INFO server.KerberosAuthenticationHandler (KerberosAuthenticationHandler.java:init(215)) - Login using keytab /etc/security/keytabs/spnego.service.keytab, for principal HTTP/standbynamenode-t5liwl46t1.hdp.local@HDP.LOCAL 2017-09-27 08:25:08,252 INFO mortbay.log (Slf4jLog.java:info(67)) - Started HttpServer2$SelectChannelConnectorWithSafeStartup@standbynamenode-t5liwl46t1.hdp.local:50070 2017-09-27 08:25:08,284 WARN common.Util (Util.java:stringAsURI(56)) - Path /data/hadoop/hdfs/namenode should be specified as a URI in configuration files. Please update hdfs configuration. 2017-09-27 08:25:08,285 WARN common.Util (Util.java:stringAsURI(56)) - Path /data/hadoop/hdfs/namenode should be specified as a URI in configuration files. Please update hdfs configuration. 2017-09-27 08:25:08,286 WARN namenode.FSNamesystem (FSNamesystem.java:checkConfiguration(654)) - Only one image storage directory (dfs.namenode.name.dir) configured. Beware of data loss due to lack of redundant storage directories! 2017-09-27 08:25:08,291 WARN common.Util (Util.java:stringAsURI(56)) - Path /data/hadoop/hdfs/namenode should be specified as a URI in configuration files. Please update hdfs configuration. 2017-09-27 08:25:08,291 WARN common.Util (Util.java:stringAsURI(56)) - Path /data/hadoop/hdfs/namenode should be specified as a URI in configuration files. Please update hdfs configuration. 2017-09-27 08:25:08,297 WARN common.Storage (NNStorage.java:setRestoreFailedStorage(210)) - set restore failed storage to true 2017-09-27 08:25:08,323 INFO namenode.FSNamesystem (FSNamesystem.java:(723)) - No KeyProvider found. 2017-09-27 08:25:08,323 INFO namenode.FSNamesystem (FSNamesystem.java:(729)) - Enabling async auditlog 2017-09-27 08:25:08,326 INFO namenode.FSNamesystem (FSNamesystem.java:(733)) - fsLock is fair:false 2017-09-27 08:25:08,371 INFO blockmanagement.HeartbeatManager (HeartbeatManager.java:(90)) - Setting heartbeat recheck interval to 30000 since dfs.namenode.stale.datanode.interval is less than dfs.namenode.heartbeat.recheck-interval 2017-09-27 08:25:08,382 INFO blockmanagement.DatanodeManager (DatanodeManager.java:(239)) - dfs.block.invalidate.limit=1000 2017-09-27 08:25:08,382 INFO blockmanagement.DatanodeManager (DatanodeManager.java:(245)) - dfs.namenode.datanode.registration.ip-hostname-check=true 2017-09-27 08:25:08,383 INFO blockmanagement.BlockManager (InvalidateBlocks.java:printBlockDeletionTime(71)) - dfs.namenode.startup.delay.block.deletion.sec is set to 000:01:00:00.000 2017-09-27 08:25:08,383 INFO blockmanagement.BlockManager (InvalidateBlocks.java:printBlockDeletionTime(76)) - The block deletion will start around 2017 Sep 27 09:25:08 2017-09-27 08:25:08,384 INFO util.GSet (LightWeightGSet.java:computeCapacity(354)) - Computing capacity for map BlocksMap 2017-09-27 08:25:08,384 INFO util.GSet (LightWeightGSet.java:computeCapacity(355)) - VM type = 64-bit 2017-09-27 08:25:08,386 INFO util.GSet (LightWeightGSet.java:computeCapacity(356)) - 2.0% max memory 2.0 GB = 40.6 MB 2017-09-27 08:25:08,386 INFO util.GSet (LightWeightGSet.java:computeCapacity(361)) - capacity = 2^22 = 4194304 entries 2017-09-27 08:25:08,394 INFO blockmanagement.BlockManager (BlockManager.java:createBlockTokenSecretManager(399)) - dfs.block.access.token.enable=true 2017-09-27 08:25:08,394 INFO blockmanagement.BlockManager (BlockManager.java:createBlockTokenSecretManager(420)) - dfs.block.access.key.update.interval=600 min(s), dfs.block.access.token.lifetime=600 min(s), dfs.encrypt.data.transfer.algorithm=null 2017-09-27 08:25:08,399 INFO blockmanagement.BlockManager (BlockManager.java:(385)) - defaultReplication = 3 2017-09-27 08:25:08,399 INFO blockmanagement.BlockManager (BlockManager.java:(386)) - maxReplication = 50 2017-09-27 08:25:08,400 INFO blockmanagement.BlockManager (BlockManager.java:(387)) - minReplication = 1 2017-09-27 08:25:08,400 INFO blockmanagement.BlockManager (BlockManager.java:(388)) - maxReplicationStreams = 2 2017-09-27 08:25:08,400 INFO blockmanagement.BlockManager (BlockManager.java:(389)) - replicationRecheckInterval = 3000 2017-09-27 08:25:08,400 INFO blockmanagement.BlockManager (BlockManager.java:(390)) - encryptDataTransfer = false 2017-09-27 08:25:08,400 INFO blockmanagement.BlockManager (BlockManager.java:(391)) - maxNumBlocksToLog = 1000 2017-09-27 08:25:08,402 INFO namenode.FSNamesystem (FSNamesystem.java:(753)) - fsOwner = nn/standbynamenode-t5liwl46t1.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:25:08,402 INFO namenode.FSNamesystem (FSNamesystem.java:(754)) - supergroup = hdfs 2017-09-27 08:25:08,402 INFO namenode.FSNamesystem (FSNamesystem.java:(755)) - isPermissionEnabled = false 2017-09-27 08:25:08,402 INFO namenode.FSNamesystem (FSNamesystem.java:(764)) - Determined nameservice ID: mycluster 2017-09-27 08:25:08,402 INFO namenode.FSNamesystem (FSNamesystem.java:(766)) - HA Enabled: true 2017-09-27 08:25:08,404 INFO namenode.FSNamesystem (FSNamesystem.java:(803)) - Append Enabled: true 2017-09-27 08:25:08,426 INFO util.GSet (LightWeightGSet.java:computeCapacity(354)) - Computing capacity for map INodeMap 2017-09-27 08:25:08,426 INFO util.GSet (LightWeightGSet.java:computeCapacity(355)) - VM type = 64-bit 2017-09-27 08:25:08,426 INFO util.GSet (LightWeightGSet.java:computeCapacity(356)) - 1.0% max memory 2.0 GB = 20.3 MB 2017-09-27 08:25:08,426 INFO util.GSet (LightWeightGSet.java:computeCapacity(361)) - capacity = 2^21 = 2097152 entries 2017-09-27 08:25:08,427 INFO namenode.FSDirectory (FSDirectory.java:(247)) - ACLs enabled? true 2017-09-27 08:25:08,428 INFO namenode.FSDirectory (FSDirectory.java:(251)) - XAttrs enabled? true 2017-09-27 08:25:08,428 INFO namenode.FSDirectory (FSDirectory.java:(259)) - Maximum size of an xattr: 16384 2017-09-27 08:25:08,428 INFO namenode.NameNode (FSDirectory.java:(312)) - Caching file names occuring more than 10 times 2017-09-27 08:25:08,435 INFO util.GSet (LightWeightGSet.java:computeCapacity(354)) - Computing capacity for map cachedBlocks 2017-09-27 08:25:08,435 INFO util.GSet (LightWeightGSet.java:computeCapacity(355)) - VM type = 64-bit 2017-09-27 08:25:08,435 INFO util.GSet (LightWeightGSet.java:computeCapacity(356)) - 0.25% max memory 2.0 GB = 5.1 MB 2017-09-27 08:25:08,435 INFO util.GSet (LightWeightGSet.java:computeCapacity(361)) - capacity = 2^19 = 524288 entries 2017-09-27 08:25:08,437 INFO namenode.FSNamesystem (FSNamesystem.java:(5317)) - dfs.namenode.safemode.threshold-pct = 0.9990000128746033 2017-09-27 08:25:08,437 INFO namenode.FSNamesystem (FSNamesystem.java:(5318)) - dfs.namenode.safemode.min.datanodes = 0 2017-09-27 08:25:08,437 INFO namenode.FSNamesystem (FSNamesystem.java:(5319)) - dfs.namenode.safemode.extension = 30000 2017-09-27 08:25:08,440 INFO metrics.TopMetrics (TopMetrics.java:logConf(65)) - NNTop conf: dfs.namenode.top.window.num.buckets = 10 2017-09-27 08:25:08,440 INFO metrics.TopMetrics (TopMetrics.java:logConf(67)) - NNTop conf: dfs.namenode.top.num.users = 10 2017-09-27 08:25:08,440 INFO metrics.TopMetrics (TopMetrics.java:logConf(69)) - NNTop conf: dfs.namenode.top.windows.minutes = 1,5,25 2017-09-27 08:25:08,442 INFO namenode.FSNamesystem (FSNamesystem.java:initRetryCache(913)) - Retry cache on namenode is enabled 2017-09-27 08:25:08,442 INFO namenode.FSNamesystem (FSNamesystem.java:initRetryCache(921)) - Retry cache will use 0.03 of total heap and retry cache entry expiry time is 600000 millis 2017-09-27 08:25:08,443 INFO util.GSet (LightWeightGSet.java:computeCapacity(354)) - Computing capacity for map NameNodeRetryCache 2017-09-27 08:25:08,443 INFO util.GSet (LightWeightGSet.java:computeCapacity(355)) - VM type = 64-bit 2017-09-27 08:25:08,444 INFO util.GSet (LightWeightGSet.java:computeCapacity(356)) - 0.029999999329447746% max memory 2.0 GB = 623.0 KB 2017-09-27 08:25:08,444 INFO util.GSet (LightWeightGSet.java:computeCapacity(361)) - capacity = 2^16 = 65536 entries 2017-09-27 08:25:08,456 INFO common.Storage (Storage.java:tryLock(774)) - Lock on /data/hadoop/hdfs/namenode/in_use.lock acquired by nodename 21326@standbynamenode-t5liwl46t1.hdp.local 2017-09-27 08:25:09,227 WARN namenode.FSEditLog (JournalSet.java:selectInputStreams(280)) - Unable to determine input streams from QJM to [10.0.0.248:8485, 10.0.0.163:8485, 10.0.0.66:8485]. Skipping. org.apache.hadoop.hdfs.qjournal.client.QuorumException: Got too many exceptions to achieve quorum size 2/3. 1 successful responses: 10.0.0.163:8485: [[1,1533], [1534,2688], [2689,2732], [2733,2782], [2783,2826], [2827,2870], [2871,2920], [2921,2961], [2962,3005], [3006,3055], [3056,3099], [3100,3143], [3144,3193], [3194,3237], [3238,3281], [3282,3331], [3332,3375], [3376,3419], [3420,3469], [3470,3513], [3514,3557], [3558,3607], [3608,3651], [3652,3695], [3696,3745], [3746,3789], [3790,3833], [3834,3883], [3884,3927], [3928,3971], [3972,4021], [4022,4065], [4066,4109], [4110,4159], [4160,4203], [4204,4247], [4248,4297], [4298,4341], [4342,4379], [4380,4429], [4430,4473], [4474,4518], [4519,4529]] 2 exceptions thrown: 10.0.0.66:8485: User nn/standbynamenode-t5liwl46t1.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.qjournal.protocol.QJournalProtocol, expected client Kerberos principal is nn/ec2-34-208-160-33.us-west-2.compute.amazonaws.com@HDP.LOCAL 10.0.0.248:8485: User nn/standbynamenode-t5liwl46t1.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.qjournal.protocol.QJournalProtocol, expected client Kerberos principal is nn/ec2-34-208-160-33.us-west-2.compute.amazonaws.com@HDP.LOCAL at org.apache.hadoop.hdfs.qjournal.client.QuorumException.create(QuorumException.java:81) at org.apache.hadoop.hdfs.qjournal.client.QuorumCall.rethrowException(QuorumCall.java:223) at org.apache.hadoop.hdfs.qjournal.client.AsyncLoggerSet.waitForWriteQuorum(AsyncLoggerSet.java:142) at org.apache.hadoop.hdfs.qjournal.client.QuorumJournalManager.selectInputStreams(QuorumJournalManager.java:471) at org.apache.hadoop.hdfs.server.namenode.JournalSet.selectInputStreams(JournalSet.java:278) at org.apache.hadoop.hdfs.server.namenode.FSEditLog.selectInputStreams(FSEditLog.java:1520) at org.apache.hadoop.hdfs.server.namenode.FSEditLog.selectInputStreams(FSEditLog.java:1544) at org.apache.hadoop.hdfs.server.namenode.FSImage.loadFSImage(FSImage.java:652) at org.apache.hadoop.hdfs.server.namenode.FSImage.recoverTransitionRead(FSImage.java:294) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.loadFSImage(FSNamesystem.java:983) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.loadFromDisk(FSNamesystem.java:688) at org.apache.hadoop.hdfs.server.namenode.NameNode.loadNamesystem(NameNode.java:662) at org.apache.hadoop.hdfs.server.namenode.NameNode.initialize(NameNode.java:726) at org.apache.hadoop.hdfs.server.namenode.NameNode.(NameNode.java:951) at org.apache.hadoop.hdfs.server.namenode.NameNode.(NameNode.java:935) at org.apache.hadoop.hdfs.server.namenode.NameNode.createNameNode(NameNode.java:1641) at org.apache.hadoop.hdfs.server.namenode.NameNode.main(NameNode.java:1709) 2017-09-27 08:25:09,228 INFO namenode.FSImage (FSImage.java:loadFSImage(669)) - No edit log streams selected. 2017-09-27 08:25:09,229 INFO namenode.FSImage (FSImage.java:loadFSImageFile(736)) - Planning to load image: FSImageFile(file=/data/hadoop/hdfs/namenode/current/fsimage_0000000000000000000, cpktTxId=0000000000000000000) 2017-09-27 08:25:09,268 INFO namenode.FSImageFormatPBINode (FSImageFormatPBINode.java:loadINodeSection(255)) - Loading 1 INodes. 2017-09-27 08:25:09,289 INFO namenode.FSImageFormatProtobuf (FSImageFormatProtobuf.java:load(184)) - Loaded FSImage in 0 seconds. 2017-09-27 08:25:09,290 INFO namenode.FSImage (FSImage.java:loadFSImage(976)) - Loaded image for txid 0 from /data/hadoop/hdfs/namenode/current/fsimage_0000000000000000000 2017-09-27 08:25:09,295 INFO namenode.FSNamesystem (FSNamesystem.java:loadFSImage(990)) - Need to save fs image? false (staleImage=false, haEnabled=true, isRollingUpgrade=false) 2017-09-27 08:25:09,295 INFO namenode.NameCache (NameCache.java:initialized(143)) - initialized with 0 entries 0 lookups 2017-09-27 08:25:09,295 INFO namenode.FSNamesystem (FSNamesystem.java:loadFromDisk(695)) - Finished loading FSImage in 849 msecs 2017-09-27 08:25:09,632 INFO namenode.NameNode (NameNodeRpcServer.java:(411)) - RPC server is binding to standbynamenode-t5liwl46t1.hdp.local:8020 2017-09-27 08:25:09,637 INFO ipc.CallQueueManager (CallQueueManager.java:(71)) - Using callQueue: class java.util.concurrent.LinkedBlockingQueue scheduler: class org.apache.hadoop.ipc.DefaultRpcScheduler 2017-09-27 08:25:09,643 INFO ipc.Server (Server.java:run(773)) - Starting Socket Reader #1 for port 8020 2017-09-27 08:25:09,711 INFO namenode.FSNamesystem (FSNamesystem.java:registerMBean(6252)) - Registered FSNamesystemState MBean 2017-09-27 08:25:09,712 WARN common.Util (Util.java:stringAsURI(56)) - Path /data/hadoop/hdfs/namenode should be specified as a URI in configuration files. Please update hdfs configuration. 2017-09-27 08:25:09,736 INFO namenode.LeaseManager (LeaseManager.java:getNumUnderConstructionBlocks(138)) - Number of blocks under construction: 0 2017-09-27 08:25:09,737 INFO hdfs.StateChange (FSNamesystem.java:leave(5404)) - STATE* Leaving safe mode after 1 secs 2017-09-27 08:25:09,737 INFO hdfs.StateChange (FSNamesystem.java:leave(5416)) - STATE* Network topology has 0 racks and 0 datanodes 2017-09-27 08:25:09,737 INFO hdfs.StateChange (FSNamesystem.java:leave(5419)) - STATE* UnderReplicatedBlocks has 0 blocks 2017-09-27 08:25:09,742 INFO blockmanagement.DatanodeDescriptor (DatanodeDescriptor.java:updateHeartbeatState(451)) - Number of failed storage changes from 0 to 0 2017-09-27 08:25:09,776 INFO ipc.Server (Server.java:run(1007)) - IPC Server Responder: starting 2017-09-27 08:25:09,776 INFO ipc.Server (Server.java:run(843)) - IPC Server listener on 8020: starting 2017-09-27 08:25:09,812 INFO ipc.Server (Server.java:saslProcess(1504)) - Auth successful for dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:25:09,814 WARN authorize.ServiceAuthorizationManager (ServiceAuthorizationManager.java:authorize(119)) - Authorization failed for dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) for protocol=interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-212-145-161.us-west-2.compute.amazonaws.com@HDP.LOCAL 2017-09-27 08:25:09,814 INFO ipc.Server (Server.java:authorizeConnection(2161)) - Connection from 10.0.0.210:52999 for protocol org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol is unauthorized for user dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:25:09,815 INFO ipc.Server (Server.java:doRead(949)) - Socket Reader #1 for port 8020: readAndProcess from client 10.0.0.210 threw exception [org.apache.hadoop.security.authorize.AuthorizationException: User dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-212-145-161.us-west-2.compute.amazonaws.com@HDP.LOCAL] 2017-09-27 08:25:09,820 INFO namenode.NameNode (NameNode.java:startCommonServices(835)) - NameNode RPC up at: standbynamenode-t5liwl46t1.hdp.local/10.0.0.163:8020 2017-09-27 08:25:09,826 INFO namenode.FSNamesystem (FSNamesystem.java:startStandbyServices(1254)) - Starting services required for standby state 2017-09-27 08:25:09,829 INFO ha.EditLogTailer (EditLogTailer.java:(117)) - Will roll logs on active node at namenode-ima2khwi0u.hdp.local/10.0.0.248:8020 every 120 seconds. 2017-09-27 08:25:09,834 INFO ha.StandbyCheckpointer (StandbyCheckpointer.java:start(129)) - Starting standby checkpoint thread... 10.0.0.66:8485: User nn/standbynamenode-t5liwl46t1.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.qjournal.protocol.QJournalProtocol, expected client Kerberos principal is nn/ec2-34-208-160-33.us-west-2.compute.amazonaws.com@HDP.LOCAL 10.0.0.248:8485: User nn/standbynamenode-t5liwl46t1.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.qjournal.protocol.QJournalProtocol, expected client Kerberos principal is nn/ec2-34-208-160-33.us-west-2.compute.amazonaws.com@HDP.LOCAL at org.apache.hadoop.hdfs.qjournal.client.QuorumException.create(QuorumException.java:81) at org.apache.hadoop.hdfs.qjournal.client.QuorumCall.rethrowException(QuorumCall.java:223) at org.apache.hadoop.hdfs.qjournal.client.AsyncLoggerSet.waitForWriteQuorum(AsyncLoggerSet.java:142) at org.apache.hadoop.hdfs.qjournal.client.QuorumJournalManager.selectInputStreams(QuorumJournalManager.java:471) at org.apache.hadoop.hdfs.server.namenode.JournalSet.selectInputStreams(JournalSet.java:278) at org.apache.hadoop.hdfs.server.namenode.FSEditLog.selectInputStreams(FSEditLog.java:1520) at org.apache.hadoop.hdfs.server.namenode.FSEditLog.selectInputStreams(FSEditLog.java:1544) at org.apache.hadoop.hdfs.server.namenode.ha.EditLogTailer.doTailEdits(EditLogTailer.java:214) at org.apache.hadoop.hdfs.server.namenode.ha.EditLogTailer$EditLogTailerThread.doWork(EditLogTailer.java:331) at org.apache.hadoop.hdfs.server.namenode.ha.EditLogTailer$EditLogTailerThread.access$200(EditLogTailer.java:284) at org.apache.hadoop.hdfs.server.namenode.ha.EditLogTailer$EditLogTailerThread$1.run(EditLogTailer.java:301) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:360) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1704) at org.apache.hadoop.security.SecurityUtil.doAsLoginUserOrFatal(SecurityUtil.java:447) at org.apache.hadoop.hdfs.server.namenode.ha.EditLogTailer$EditLogTailerThread.run(EditLogTailer.java:297) 2017-09-27 08:30:10,831 INFO ipc.Server (Server.java:saslProcess(1504)) - Auth successful for dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:30:10,838 WARN authorize.ServiceAuthorizationManager (ServiceAuthorizationManager.java:authorize(119)) - Authorization failed for dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) for protocol=interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-212-145-161.us-west-2.compute.amazonaws.com@HDP.LOCAL 2017-09-27 08:30:10,838 INFO ipc.Server (Server.java:authorizeConnection(2161)) - Connection from 10.0.0.210:55627 for protocol org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol is unauthorized for user dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:30:10,838 INFO ipc.Server (Server.java:doRead(949)) - Socket Reader #1 for port 8020: readAndProcess from client 10.0.0.210 threw exception [org.apache.hadoop.security.authorize.AuthorizationException: User dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-212-145-161.us-west-2.compute.amazonaws.com@HDP.LOCAL] 2017-09-27 08:30:11,139 INFO ipc.Server (Server.java:saslProcess(1504)) - Auth successful for dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:30:11,143 WARN authorize.ServiceAuthorizationManager (ServiceAuthorizationManager.java:authorize(119)) - Authorization failed for dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) for protocol=interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-214-181-219.us-west-2.compute.amazonaws.com@HDP.LOCAL 2017-09-27 08:30:11,143 INFO ipc.Server (Server.java:authorizeConnection(2161)) - Connection from 10.0.0.212:60722 for protocol org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol is unauthorized for user dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:30:11,143 INFO ipc.Server (Server.java:doRead(949)) - Socket Reader #1 for port 8020: readAndProcess from client 10.0.0.212 threw exception [org.apache.hadoop.security.authorize.AuthorizationException: User dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-214-181-219.us-west-2.compute.amazonaws.com@HDP.LOCAL] 2017-09-27 08:30:15,849 INFO ipc.Server (Server.java:saslProcess(1504)) - Auth successful for dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:30:15,851 WARN authorize.ServiceAuthorizationManager (ServiceAuthorizationManager.java:authorize(119)) - Authorization failed for dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) for protocol=interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-212-145-161.us-west-2.compute.amazonaws.com@HDP.LOCAL 2017-09-27 08:30:15,851 INFO ipc.Server (Server.java:authorizeConnection(2161)) - Connection from 10.0.0.210:53053 for protocol org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol is unauthorized for user dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:30:15,851 INFO ipc.Server (Server.java:doRead(949)) - Socket Reader #1 for port 8020: readAndProcess from client 10.0.0.210 threw exception [org.apache.hadoop.security.authorize.AuthorizationException: User dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-212-145-161.us-west-2.compute.amazonaws.com@HDP.LOCAL] 2017-09-27 08:30:16,155 INFO ipc.Server (Server.java:saslProcess(1504)) - Auth successful for dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:30:16,166 WARN authorize.ServiceAuthorizationManager (ServiceAuthorizationManager.java:authorize(119)) - Authorization failed for dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) for protocol=interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-214-181-219.us-west-2.compute.amazonaws.com@HDP.LOCAL 2017-09-27 08:30:16,166 INFO ipc.Server (Server.java:authorizeConnection(2161)) - Connection from 10.0.0.212:49196 for protocol org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol is unauthorized for user dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:30:16,166 INFO ipc.Server (Server.java:doRead(949)) - Socket Reader #1 for port 8020: readAndProcess from client 10.0.0.212 threw exception [org.apache.hadoop.security.authorize.AuthorizationException: User dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-214-181-219.us-west-2.compute.amazonaws.com@HDP.LOCAL] 2017-09-27 08:30:20,889 INFO ipc.Server (Server.java:saslProcess(1504)) - Auth successful for dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:30:20,904 WARN authorize.ServiceAuthorizationManager (ServiceAuthorizationManager.java:authorize(119)) - Authorization failed for dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) for protocol=interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-212-145-161.us-west-2.compute.amazonaws.com@HDP.LOCAL 2017-09-27 08:30:20,904 INFO ipc.Server (Server.java:authorizeConnection(2161)) - Connection from 10.0.0.210:50985 for protocol org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol is unauthorized for user dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:30:20,905 INFO ipc.Server (Server.java:doRead(949)) - Socket Reader #1 for port 8020: readAndProcess from client 10.0.0.210 threw exception [org.apache.hadoop.security.authorize.AuthorizationException: User dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-212-145-161.us-west-2.compute.amazonaws.com@HDP.LOCAL] 2017-09-27 08:30:21,192 INFO ipc.Server (Server.java:saslProcess(1504)) - Auth successful for dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:30:21,203 WARN authorize.ServiceAuthorizationManager (ServiceAuthorizationManager.java:authorize(119)) - Authorization failed for dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) for protocol=interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-214-181-219.us-west-2.compute.amazonaws.com@HDP.LOCAL 2017-09-27 08:30:21,203 INFO ipc.Server (Server.java:authorizeConnection(2161)) - Connection from 10.0.0.212:58709 for protocol org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol is unauthorized for user dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:30:21,204 INFO ipc.Server (Server.java:doRead(949)) - Socket Reader #1 for port 8020: readAndProcess from client 10.0.0.212 threw exception [org.apache.hadoop.security.authorize.AuthorizationException: User dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-214-181-219.us-west-2.compute.amazonaws.com@HDP.LOCAL] 2017-09-27 08:30:25,944 INFO ipc.Server (Server.java:saslProcess(1504)) - Auth successful for dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:30:25,948 WARN authorize.ServiceAuthorizationManager (ServiceAuthorizationManager.java:authorize(119)) - Authorization failed for dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) for protocol=interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-212-145-161.us-west-2.compute.amazonaws.com@HDP.LOCAL 2017-09-27 08:30:25,948 INFO ipc.Server (Server.java:authorizeConnection(2161)) - Connection from 10.0.0.210:45550 for protocol org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol is unauthorized for user dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:30:25,949 INFO ipc.Server (Server.java:doRead(949)) - Socket Reader #1 for port 8020: readAndProcess from client 10.0.0.210 threw exception [org.apache.hadoop.security.authorize.AuthorizationException: User dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-212-145-161.us-west-2.compute.amazonaws.com@HDP.LOCAL] 2017-09-27 08:30:26,250 INFO ipc.Server (Server.java:saslProcess(1504)) - Auth successful for dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:30:26,261 WARN authorize.ServiceAuthorizationManager (ServiceAuthorizationManager.java:authorize(119)) - Authorization failed for dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) for protocol=interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-214-181-219.us-west-2.compute.amazonaws.com@HDP.LOCAL 2017-09-27 08:30:26,261 INFO ipc.Server (Server.java:authorizeConnection(2161)) - Connection from 10.0.0.212:53641 for protocol org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol is unauthorized for user dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:30:26,262 INFO ipc.Server (Server.java:doRead(949)) - Socket Reader #1 for port 8020: readAndProcess from client 10.0.0.212 threw exception [org.apache.hadoop.security.authorize.AuthorizationException: User dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-214-181-219.us-west-2.compute.amazonaws.com@HDP.LOCAL] 2017-09-27 08:30:30,954 INFO ipc.Server (Server.java:saslProcess(1504)) - Auth successful for dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:30:30,955 WARN authorize.ServiceAuthorizationManager (ServiceAuthorizationManager.java:authorize(119)) - Authorization failed for dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) for protocol=interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-212-145-161.us-west-2.compute.amazonaws.com@HDP.LOCAL 2017-09-27 08:30:30,955 INFO ipc.Server (Server.java:authorizeConnection(2161)) - Connection from 10.0.0.210:40282 for protocol org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol is unauthorized for user dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:30:30,955 INFO ipc.Server (Server.java:doRead(949)) - Socket Reader #1 for port 8020: readAndProcess from client 10.0.0.210 threw exception [org.apache.hadoop.security.authorize.AuthorizationException: User dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-212-145-161.us-west-2.compute.amazonaws.com@HDP.LOCAL] 2017-09-27 08:30:31,293 INFO ipc.Server (Server.java:saslProcess(1504)) - Auth successful for dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:30:31,297 WARN authorize.ServiceAuthorizationManager (ServiceAuthorizationManager.java:authorize(119)) - Authorization failed for dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) for protocol=interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-214-181-219.us-west-2.compute.amazonaws.com@HDP.LOCAL 2017-09-27 08:30:31,297 INFO ipc.Server (Server.java:authorizeConnection(2161)) - Connection from 10.0.0.212:59296 for protocol org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol is unauthorized for user dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:30:31,297 INFO ipc.Server (Server.java:doRead(949)) - Socket Reader #1 for port 8020: readAndProcess from client 10.0.0.212 threw exception [org.apache.hadoop.security.authorize.AuthorizationException: User dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-214-181-219.us-west-2.compute.amazonaws.com@HDP.LOCAL] 2017-09-27 08:30:35,961 INFO ipc.Server (Server.java:saslProcess(1504)) - Auth successful for dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:30:35,965 WARN authorize.ServiceAuthorizationManager (ServiceAuthorizationManager.java:authorize(119)) - Authorization failed for dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) for protocol=interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-212-145-161.us-west-2.compute.amazonaws.com@HDP.LOCAL 2017-09-27 08:30:35,965 INFO ipc.Server (Server.java:authorizeConnection(2161)) - Connection from 10.0.0.210:43475 for protocol org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol is unauthorized for user dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:30:35,965 INFO ipc.Server (Server.java:doRead(949)) - Socket Reader #1 for port 8020: readAndProcess from client 10.0.0.210 threw exception [org.apache.hadoop.security.authorize.AuthorizationException: User dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-212-145-161.us-west-2.compute.amazonaws.com@HDP.LOCAL] 2017-09-27 08:30:36,303 INFO ipc.Server (Server.java:saslProcess(1504)) - Auth successful for dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:30:36,304 WARN authorize.ServiceAuthorizationManager (ServiceAuthorizationManager.java:authorize(119)) - Authorization failed for dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) for protocol=interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-214-181-219.us-west-2.compute.amazonaws.com@HDP.LOCAL 2017-09-27 08:30:36,304 INFO ipc.Server (Server.java:authorizeConnection(2161)) - Connection from 10.0.0.212:41997 for protocol org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol is unauthorized for user dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:30:36,304 INFO ipc.Server (Server.java:doRead(949)) - Socket Reader #1 for port 8020: readAndProcess from client 10.0.0.212 threw exception [org.apache.hadoop.security.authorize.AuthorizationException: User dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-214-181-219.us-west-2.compute.amazonaws.com@HDP.LOCAL] 2017-09-27 08:30:40,971 INFO ipc.Server (Server.java:saslProcess(1504)) - Auth successful for dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:30:40,972 WARN authorize.ServiceAuthorizationManager (ServiceAuthorizationManager.java:authorize(119)) - Authorization failed for dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) for protocol=interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-212-145-161.us-west-2.compute.amazonaws.com@HDP.LOCAL 2017-09-27 08:30:40,972 INFO ipc.Server (Server.java:authorizeConnection(2161)) - Connection from 10.0.0.210:52917 for protocol org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol is unauthorized for user dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:30:40,973 INFO ipc.Server (Server.java:doRead(949)) - Socket Reader #1 for port 8020: readAndProcess from client 10.0.0.210 threw exception [org.apache.hadoop.security.authorize.AuthorizationException: User dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-212-145-161.us-west-2.compute.amazonaws.com@HDP.LOCAL] 2017-09-27 08:30:41,310 INFO ipc.Server (Server.java:saslProcess(1504)) - Auth successful for dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:30:41,311 WARN authorize.ServiceAuthorizationManager (ServiceAuthorizationManager.java:authorize(119)) - Authorization failed for dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) for protocol=interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-214-181-219.us-west-2.compute.amazonaws.com@HDP.LOCAL 2017-09-27 08:30:41,311 INFO ipc.Server (Server.java:authorizeConnection(2161)) - Connection from 10.0.0.212:43178 for protocol org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol is unauthorized for user dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:30:41,311 INFO ipc.Server (Server.java:doRead(949)) - Socket Reader #1 for port 8020: readAndProcess from client 10.0.0.212 threw exception [org.apache.hadoop.security.authorize.AuthorizationException: User dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-214-181-219.us-west-2.compute.amazonaws.com@HDP.LOCAL] 2017-09-27 08:30:45,979 INFO ipc.Server (Server.java:saslProcess(1504)) - Auth successful for dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:30:45,982 WARN authorize.ServiceAuthorizationManager (ServiceAuthorizationManager.java:authorize(119)) - Authorization failed for dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) for protocol=interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-212-145-161.us-west-2.compute.amazonaws.com@HDP.LOCAL 2017-09-27 08:30:45,982 INFO ipc.Server (Server.java:authorizeConnection(2161)) - Connection from 10.0.0.210:50093 for protocol org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol is unauthorized for user dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:30:45,982 INFO ipc.Server (Server.java:doRead(949)) - Socket Reader #1 for port 8020: readAndProcess from client 10.0.0.210 threw exception [org.apache.hadoop.security.authorize.AuthorizationException: User dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-212-145-161.us-west-2.compute.amazonaws.com@HDP.LOCAL] 2017-09-27 08:30:46,317 INFO ipc.Server (Server.java:saslProcess(1504)) - Auth successful for dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:30:46,318 WARN authorize.ServiceAuthorizationManager (ServiceAuthorizationManager.java:authorize(119)) - Authorization failed for dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) for protocol=interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-214-181-219.us-west-2.compute.amazonaws.com@HDP.LOCAL 2017-09-27 08:30:46,318 INFO ipc.Server (Server.java:authorizeConnection(2161)) - Connection from 10.0.0.212:49041 for protocol org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol is unauthorized for user dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:30:46,318 INFO ipc.Server (Server.java:doRead(949)) - Socket Reader #1 for port 8020: readAndProcess from client 10.0.0.212 threw exception [org.apache.hadoop.security.authorize.AuthorizationException: User dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-214-181-219.us-west-2.compute.amazonaws.com@HDP.LOCAL] 2017-09-27 08:30:50,987 INFO ipc.Server (Server.java:saslProcess(1504)) - Auth successful for dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:30:50,989 WARN authorize.ServiceAuthorizationManager (ServiceAuthorizationManager.java:authorize(119)) - Authorization failed for dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) for protocol=interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-212-145-161.us-west-2.compute.amazonaws.com@HDP.LOCAL 2017-09-27 08:30:50,989 INFO ipc.Server (Server.java:authorizeConnection(2161)) - Connection from 10.0.0.210:41333 for protocol org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol is unauthorized for user dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:30:50,989 INFO ipc.Server (Server.java:doRead(949)) - Socket Reader #1 for port 8020: readAndProcess from client 10.0.0.210 threw exception [org.apache.hadoop.security.authorize.AuthorizationException: User dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-212-145-161.us-west-2.compute.amazonaws.com@HDP.LOCAL] 2017-09-27 08:30:51,325 INFO ipc.Server (Server.java:saslProcess(1504)) - Auth successful for dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:30:51,326 WARN authorize.ServiceAuthorizationManager (ServiceAuthorizationManager.java:authorize(119)) - Authorization failed for dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) for protocol=interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-214-181-219.us-west-2.compute.amazonaws.com@HDP.LOCAL 2017-09-27 08:30:51,327 INFO ipc.Server (Server.java:authorizeConnection(2161)) - Connection from 10.0.0.212:37762 for protocol org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol is unauthorized for user dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:30:51,327 INFO ipc.Server (Server.java:doRead(949)) - Socket Reader #1 for port 8020: readAndProcess from client 10.0.0.212 threw exception [org.apache.hadoop.security.authorize.AuthorizationException: User dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-214-181-219.us-west-2.compute.amazonaws.com@HDP.LOCAL] 2017-09-27 08:30:56,034 INFO ipc.Server (Server.java:saslProcess(1504)) - Auth successful for dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:30:56,035 WARN authorize.ServiceAuthorizationManager (ServiceAuthorizationManager.java:authorize(119)) - Authorization failed for dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) for protocol=interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-212-145-161.us-west-2.compute.amazonaws.com@HDP.LOCAL 2017-09-27 08:30:56,036 INFO ipc.Server (Server.java:authorizeConnection(2161)) - Connection from 10.0.0.210:44937 for protocol org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol is unauthorized for user dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:30:56,036 INFO ipc.Server (Server.java:doRead(949)) - Socket Reader #1 for port 8020: readAndProcess from client 10.0.0.210 threw exception [org.apache.hadoop.security.authorize.AuthorizationException: User dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-212-145-161.us-west-2.compute.amazonaws.com@HDP.LOCAL] 2017-09-27 08:30:56,369 INFO ipc.Server (Server.java:saslProcess(1504)) - Auth successful for dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:30:56,380 WARN authorize.ServiceAuthorizationManager (ServiceAuthorizationManager.java:authorize(119)) - Authorization failed for dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) for protocol=interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-214-181-219.us-west-2.compute.amazonaws.com@HDP.LOCAL 2017-09-27 08:30:56,380 INFO ipc.Server (Server.java:authorizeConnection(2161)) - Connection from 10.0.0.212:53904 for protocol org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol is unauthorized for user dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:30:56,381 INFO ipc.Server (Server.java:doRead(949)) - Socket Reader #1 for port 8020: readAndProcess from client 10.0.0.212 threw exception [org.apache.hadoop.security.authorize.AuthorizationException: User dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-214-181-219.us-west-2.compute.amazonaws.com@HDP.LOCAL] 2017-09-27 08:31:01,074 INFO ipc.Server (Server.java:saslProcess(1504)) - Auth successful for dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:31:01,081 WARN authorize.ServiceAuthorizationManager (ServiceAuthorizationManager.java:authorize(119)) - Authorization failed for dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) for protocol=interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-212-145-161.us-west-2.compute.amazonaws.com@HDP.LOCAL 2017-09-27 08:31:01,081 INFO ipc.Server (Server.java:authorizeConnection(2161)) - Connection from 10.0.0.210:57721 for protocol org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol is unauthorized for user dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:31:01,081 INFO ipc.Server (Server.java:doRead(949)) - Socket Reader #1 for port 8020: readAndProcess from client 10.0.0.210 threw exception [org.apache.hadoop.security.authorize.AuthorizationException: User dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-212-145-161.us-west-2.compute.amazonaws.com@HDP.LOCAL] 2017-09-27 08:31:01,386 INFO ipc.Server (Server.java:saslProcess(1504)) - Auth successful for dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:31:01,387 WARN authorize.ServiceAuthorizationManager (ServiceAuthorizationManager.java:authorize(119)) - Authorization failed for dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) for protocol=interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-214-181-219.us-west-2.compute.amazonaws.com@HDP.LOCAL 2017-09-27 08:31:01,387 INFO ipc.Server (Server.java:authorizeConnection(2161)) - Connection from 10.0.0.212:43660 for protocol org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol is unauthorized for user dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:31:01,387 INFO ipc.Server (Server.java:doRead(949)) - Socket Reader #1 for port 8020: readAndProcess from client 10.0.0.212 threw exception [org.apache.hadoop.security.authorize.AuthorizationException: User dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-214-181-219.us-west-2.compute.amazonaws.com@HDP.LOCAL] 2017-09-27 08:31:06,087 INFO ipc.Server (Server.java:saslProcess(1504)) - Auth successful for dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:31:06,088 WARN authorize.ServiceAuthorizationManager (ServiceAuthorizationManager.java:authorize(119)) - Authorization failed for dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) for protocol=interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-212-145-161.us-west-2.compute.amazonaws.com@HDP.LOCAL 2017-09-27 08:31:06,089 INFO ipc.Server (Server.java:authorizeConnection(2161)) - Connection from 10.0.0.210:60264 for protocol org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol is unauthorized for user dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:31:06,089 INFO ipc.Server (Server.java:doRead(949)) - Socket Reader #1 for port 8020: readAndProcess from client 10.0.0.210 threw exception [org.apache.hadoop.security.authorize.AuthorizationException: User dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-212-145-161.us-west-2.compute.amazonaws.com@HDP.LOCAL] 2017-09-27 08:31:06,395 INFO ipc.Server (Server.java:saslProcess(1504)) - Auth successful for dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:31:06,396 WARN authorize.ServiceAuthorizationManager (ServiceAuthorizationManager.java:authorize(119)) - Authorization failed for dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) for protocol=interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-214-181-219.us-west-2.compute.amazonaws.com@HDP.LOCAL 2017-09-27 08:31:06,396 INFO ipc.Server (Server.java:authorizeConnection(2161)) - Connection from 10.0.0.212:49662 for protocol org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol is unauthorized for user dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:31:06,397 INFO ipc.Server (Server.java:doRead(949)) - Socket Reader #1 for port 8020: readAndProcess from client 10.0.0.212 threw exception [org.apache.hadoop.security.authorize.AuthorizationException: User dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-214-181-219.us-west-2.compute.amazonaws.com@HDP.LOCAL] 2017-09-27 08:31:10,427 WARN namenode.FSEditLog (JournalSet.java:selectInputStreams(280)) - Unable to determine input streams from QJM to [10.0.0.248:8485, 10.0.0.163:8485, 10.0.0.66:8485]. Skipping. org.apache.hadoop.hdfs.qjournal.client.QuorumException: Got too many exceptions to achieve quorum size 2/3. 1 successful responses: 10.0.0.163:8485: [[1,1533], [1534,2688], [2689,2732], [2733,2782], [2783,2826], [2827,2870], [2871,2920], [2921,2961], [2962,3005], [3006,3055], [3056,3099], [3100,3143], [3144,3193], [3194,3237], [3238,3281], [3282,3331], [3332,3375], [3376,3419], [3420,3469], [3470,3513], [3514,3557], [3558,3607], [3608,3651], [3652,3695], [3696,3745], [3746,3789], [3790,3833], [3834,3883], [3884,3927], [3928,3971], [3972,4021], [4022,4065], [4066,4109], [4110,4159], [4160,4203], [4204,4247], [4248,4297], [4298,4341], [4342,4379], [4380,4429], [4430,4473], [4474,4518], [4519,4529]] 2 exceptions thrown: 10.0.0.66:8485: User nn/standbynamenode-t5liwl46t1.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.qjournal.protocol.QJournalProtocol, expected client Kerberos principal is nn/ec2-34-208-160-33.us-west-2.compute.amazonaws.com@HDP.LOCAL 10.0.0.248:8485: User nn/standbynamenode-t5liwl46t1.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.qjournal.protocol.QJournalProtocol, expected client Kerberos principal is nn/ec2-34-208-160-33.us-west-2.compute.amazonaws.com@HDP.LOCAL at org.apache.hadoop.hdfs.qjournal.client.QuorumException.create(QuorumException.java:81) at org.apache.hadoop.hdfs.qjournal.client.QuorumCall.rethrowException(QuorumCall.java:223) at org.apache.hadoop.hdfs.qjournal.client.AsyncLoggerSet.waitForWriteQuorum(AsyncLoggerSet.java:142) at org.apache.hadoop.hdfs.qjournal.client.QuorumJournalManager.selectInputStreams(QuorumJournalManager.java:471) at org.apache.hadoop.hdfs.server.namenode.JournalSet.selectInputStreams(JournalSet.java:278) at org.apache.hadoop.hdfs.server.namenode.FSEditLog.selectInputStreams(FSEditLog.java:1520) at org.apache.hadoop.hdfs.server.namenode.FSEditLog.selectInputStreams(FSEditLog.java:1544) at org.apache.hadoop.hdfs.server.namenode.ha.EditLogTailer.doTailEdits(EditLogTailer.java:214) at org.apache.hadoop.hdfs.server.namenode.ha.EditLogTailer$EditLogTailerThread.doWork(EditLogTailer.java:331) at org.apache.hadoop.hdfs.server.namenode.ha.EditLogTailer$EditLogTailerThread.access$200(EditLogTailer.java:284) at org.apache.hadoop.hdfs.server.namenode.ha.EditLogTailer$EditLogTailerThread$1.run(EditLogTailer.java:301) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:360) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1704) at org.apache.hadoop.security.SecurityUtil.doAsLoginUserOrFatal(SecurityUtil.java:447) at org.apache.hadoop.hdfs.server.namenode.ha.EditLogTailer$EditLogTailerThread.run(EditLogTailer.java:297) 2017-09-27 08:31:11,095 INFO ipc.Server (Server.java:saslProcess(1504)) - Auth successful for dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:31:11,096 WARN authorize.ServiceAuthorizationManager (ServiceAuthorizationManager.java:authorize(119)) - Authorization failed for dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) for protocol=interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-212-145-161.us-west-2.compute.amazonaws.com@HDP.LOCAL 2017-09-27 08:31:11,096 INFO ipc.Server (Server.java:authorizeConnection(2161)) - Connection from 10.0.0.210:55677 for protocol org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol is unauthorized for user dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:31:11,096 INFO ipc.Server (Server.java:doRead(949)) - Socket Reader #1 for port 8020: readAndProcess from client 10.0.0.210 threw exception [org.apache.hadoop.security.authorize.AuthorizationException: User dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-212-145-161.us-west-2.compute.amazonaws.com@HDP.LOCAL] 2017-09-27 08:31:11,402 INFO ipc.Server (Server.java:saslProcess(1504)) - Auth successful for dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:31:56,210 WARN authorize.ServiceAuthorizationManager (ServiceAuthorizationManager.java:authorize(119)) - Authorization failed for dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) for protocol=interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-212-145-161.us-west-2.compute.amazonaws.com@HDP.LOCAL 2017-09-27 08:31:56,210 INFO ipc.Server (Server.java:authorizeConnection(2161)) - Connection from 10.0.0.210:50562 for protocol org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol is unauthorized for user dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:31:56,210 INFO ipc.Server (Server.java:doRead(949)) - Socket Reader #1 for port 8020: readAndProcess from client 10.0.0.210 threw exception [org.apache.hadoop.security.authorize.AuthorizationException: User dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-212-145-161.us-west-2.compute.amazonaws.com@HDP.LOCAL] 2017-09-27 08:31:56,511 INFO ipc.Server (Server.java:saslProcess(1504)) - Auth successful for dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:31:56,512 WARN authorize.ServiceAuthorizationManager (ServiceAuthorizationManager.java:authorize(119)) - Authorization failed for dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) for protocol=interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-214-181-219.us-west-2.compute.amazonaws.com@HDP.LOCAL 2017-09-27 08:31:56,512 INFO ipc.Server (Server.java:authorizeConnection(2161)) - Connection from 10.0.0.212:44193 for protocol org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol is unauthorized for user dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:31:56,512 INFO ipc.Server (Server.java:doRead(949)) - Socket Reader #1 for port 8020: readAndProcess from client 10.0.0.212 threw exception [org.apache.hadoop.security.authorize.AuthorizationException: User dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-214-181-219.us-west-2.compute.amazonaws.com@HDP.LOCAL] 2017-09-27 08:32:01,217 INFO ipc.Server (Server.java:saslProcess(1504)) - Auth successful for dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:32:01,219 WARN authorize.ServiceAuthorizationManager (ServiceAuthorizationManager.java:authorize(119)) - Authorization failed for dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) for protocol=interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-212-145-161.us-west-2.compute.amazonaws.com@HDP.LOCAL 2017-09-27 08:32:01,219 INFO ipc.Server (Server.java:authorizeConnection(2161)) - Connection from 10.0.0.210:53820 for protocol org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol is unauthorized for user dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:32:01,219 INFO ipc.Server (Server.java:doRead(949)) - Socket Reader #1 for port 8020: readAndProcess from client 10.0.0.210 threw exception [org.apache.hadoop.security.authorize.AuthorizationException: User dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-212-145-161.us-west-2.compute.amazonaws.com@HDP.LOCAL] 2017-09-27 08:32:01,518 INFO ipc.Server (Server.java:saslProcess(1504)) - Auth successful for dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:32:01,519 WARN authorize.ServiceAuthorizationManager (ServiceAuthorizationManager.java:authorize(119)) - Authorization failed for dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) for protocol=interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-214-181-219.us-west-2.compute.amazonaws.com@HDP.LOCAL 2017-09-27 08:32:01,519 INFO ipc.Server (Server.java:authorizeConnection(2161)) - Connection from 10.0.0.212:57683 for protocol org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol is unauthorized for user dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:32:01,520 INFO ipc.Server (Server.java:doRead(949)) - Socket Reader #1 for port 8020: readAndProcess from client 10.0.0.212 threw exception [org.apache.hadoop.security.authorize.AuthorizationException: User dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-214-181-219.us-west-2.compute.amazonaws.com@HDP.LOCAL] 2017-09-27 08:32:06,228 INFO ipc.Server (Server.java:saslProcess(1504)) - Auth successful for dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:32:06,229 WARN authorize.ServiceAuthorizationManager (ServiceAuthorizationManager.java:authorize(119)) - Authorization failed for dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) for protocol=interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-212-145-161.us-west-2.compute.amazonaws.com@HDP.LOCAL 2017-09-27 08:32:06,229 INFO ipc.Server (Server.java:authorizeConnection(2161)) - Connection from 10.0.0.210:43701 for protocol org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol is unauthorized for user dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:32:06,230 INFO ipc.Server (Server.java:doRead(949)) - Socket Reader #1 for port 8020: readAndProcess from client 10.0.0.210 threw exception [org.apache.hadoop.security.authorize.AuthorizationException: User dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-212-145-161.us-west-2.compute.amazonaws.com@HDP.LOCAL] 2017-09-27 08:32:06,526 INFO ipc.Server (Server.java:saslProcess(1504)) - Auth successful for dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:32:06,528 WARN authorize.ServiceAuthorizationManager (ServiceAuthorizationManager.java:authorize(119)) - Authorization failed for dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) for protocol=interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-214-181-219.us-west-2.compute.amazonaws.com@HDP.LOCAL 2017-09-27 08:32:06,528 INFO ipc.Server (Server.java:authorizeConnection(2161)) - Connection from 10.0.0.212:34510 for protocol org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol is unauthorized for user dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:32:06,528 INFO ipc.Server (Server.java:doRead(949)) - Socket Reader #1 for port 8020: readAndProcess from client 10.0.0.212 threw exception [org.apache.hadoop.security.authorize.AuthorizationException: User dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-214-181-219.us-west-2.compute.amazonaws.com@HDP.LOCAL] 2017-09-27 08:32:10,472 WARN namenode.FSEditLog (JournalSet.java:selectInputStreams(280)) - Unable to determine input streams from QJM to [10.0.0.248:8485, 10.0.0.163:8485, 10.0.0.66:8485]. Skipping. org.apache.hadoop.hdfs.qjournal.client.QuorumException: Got too many exceptions to achieve quorum size 2/3. 1 successful responses: 10.0.0.163:8485: [[1,1533], [1534,2688], [2689,2732], [2733,2782], [2783,2826], [2827,2870], [2871,2920], [2921,2961], [2962,3005], [3006,3055], [3056,3099], [3100,3143], [3144,3193], [3194,3237], [3238,3281], [3282,3331], [3332,3375], [3376,3419], [3420,3469], [3470,3513], [3514,3557], [3558,3607], [3608,3651], [3652,3695], [3696,3745], [3746,3789], [3790,3833], [3834,3883], [3884,3927], [3928,3971], [3972,4021], [4022,4065], [4066,4109], [4110,4159], [4160,4203], [4204,4247], [4248,4297], [4298,4341], [4342,4379], [4380,4429], [4430,4473], [4474,4518], [4519,4529]] 2 exceptions thrown: 10.0.0.66:8485: User nn/standbynamenode-t5liwl46t1.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.qjournal.protocol.QJournalProtocol, expected client Kerberos principal is nn/ec2-34-208-160-33.us-west-2.compute.amazonaws.com@HDP.LOCAL 10.0.0.248:8485: User nn/standbynamenode-t5liwl46t1.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.qjournal.protocol.QJournalProtocol, expected client Kerberos principal is nn/ec2-34-208-160-33.us-west-2.compute.amazonaws.com@HDP.LOCAL at org.apache.hadoop.hdfs.qjournal.client.QuorumException.create(QuorumException.java:81) at org.apache.hadoop.hdfs.qjournal.client.QuorumCall.rethrowException(QuorumCall.java:223) at org.apache.hadoop.hdfs.qjournal.client.AsyncLoggerSet.waitForWriteQuorum(AsyncLoggerSet.java:142) at org.apache.hadoop.hdfs.qjournal.client.QuorumJournalManager.selectInputStreams(QuorumJournalManager.java:471) at org.apache.hadoop.hdfs.server.namenode.JournalSet.selectInputStreams(JournalSet.java:278) at org.apache.hadoop.hdfs.server.namenode.FSEditLog.selectInputStreams(FSEditLog.java:1520) at org.apache.hadoop.hdfs.server.namenode.FSEditLog.selectInputStreams(FSEditLog.java:1544) at org.apache.hadoop.hdfs.server.namenode.ha.EditLogTailer.doTailEdits(EditLogTailer.java:214) at org.apache.hadoop.hdfs.server.namenode.ha.EditLogTailer$EditLogTailerThread.doWork(EditLogTailer.java:331) at org.apache.hadoop.hdfs.server.namenode.ha.EditLogTailer$EditLogTailerThread.access$200(EditLogTailer.java:284) at org.apache.hadoop.hdfs.server.namenode.ha.EditLogTailer$EditLogTailerThread$1.run(EditLogTailer.java:301) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:360) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1704) at org.apache.hadoop.security.SecurityUtil.doAsLoginUserOrFatal(SecurityUtil.java:447) at org.apache.hadoop.hdfs.server.namenode.ha.EditLogTailer$EditLogTailerThread.run(EditLogTailer.java:297) 2017-09-27 08:32:11,237 INFO ipc.Server (Server.java:saslProcess(1504)) - Auth successful for dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:32:11,239 WARN authorize.ServiceAuthorizationManager (ServiceAuthorizationManager.java:authorize(119)) - Authorization failed for dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) for protocol=interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-212-145-161.us-west-2.compute.amazonaws.com@HDP.LOCAL 2017-09-27 08:32:11,239 INFO ipc.Server (Server.java:authorizeConnection(2161)) - Connection from 10.0.0.210:56231 for protocol org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol is unauthorized for user dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:32:11,239 INFO ipc.Server (Server.java:doRead(949)) - Socket Reader #1 for port 8020: readAndProcess from client 10.0.0.210 threw exception [org.apache.hadoop.security.authorize.AuthorizationException: User dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-212-145-161.us-west-2.compute.amazonaws.com@HDP.LOCAL] 2017-09-27 08:32:11,534 INFO ipc.Server (Server.java:saslProcess(1504)) - Auth successful for dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:32:11,536 WARN authorize.ServiceAuthorizationManager (ServiceAuthorizationManager.java:authorize(119)) - Authorization failed for dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) for protocol=interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-214-181-219.us-west-2.compute.amazonaws.com@HDP.LOCAL 2017-09-27 08:32:11,536 INFO ipc.Server (Server.java:authorizeConnection(2161)) - Connection from 10.0.0.212:46780 for protocol org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol is unauthorized for user dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:32:11,536 INFO ipc.Server (Server.java:doRead(949)) - Socket Reader #1 for port 8020: readAndProcess from client 10.0.0.212 threw exception [org.apache.hadoop.security.authorize.AuthorizationException: User dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-214-181-219.us-west-2.compute.amazonaws.com@HDP.LOCAL] 2017-09-27 08:32:16,246 INFO ipc.Server (Server.java:saslProcess(1504)) - Auth successful for dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:32:16,247 WARN authorize.ServiceAuthorizationManager (ServiceAuthorizationManager.java:authorize(119)) - Authorization failed for dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) for protocol=interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-212-145-161.us-west-2.compute.amazonaws.com@HDP.LOCAL 2017-09-27 08:32:16,247 INFO ipc.Server (Server.java:authorizeConnection(2161)) - Connection from 10.0.0.210:59226 for protocol org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol is unauthorized for user dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:32:16,247 INFO ipc.Server (Server.java:doRead(949)) - Socket Reader #1 for port 8020: readAndProcess from client 10.0.0.210 threw exception [org.apache.hadoop.security.authorize.AuthorizationException: User dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-212-145-161.us-west-2.compute.amazonaws.com@HDP.LOCAL] 2017-09-27 08:32:16,543 INFO ipc.Server (Server.java:saslProcess(1504)) - Auth successful for dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:32:16,544 WARN authorize.ServiceAuthorizationManager (ServiceAuthorizationManager.java:authorize(119)) - Authorization failed for dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) for protocol=interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-214-181-219.us-west-2.compute.amazonaws.com@HDP.LOCAL 2017-09-27 08:32:16,544 INFO ipc.Server (Server.java:authorizeConnection(2161)) - Connection from 10.0.0.212:39754 for protocol org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol is unauthorized for user dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:32:16,544 INFO ipc.Server (Server.java:doRead(949)) - Socket Reader #1 for port 8020: readAndProcess from client 10.0.0.212 threw exception [org.apache.hadoop.security.authorize.AuthorizationException: User dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-214-181-219.us-west-2.compute.amazonaws.com@HDP.LOCAL] 2017-09-27 08:32:21,254 INFO ipc.Server (Server.java:saslProcess(1504)) - Auth successful for dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:32:21,255 WARN authorize.ServiceAuthorizationManager (ServiceAuthorizationManager.java:authorize(119)) - Authorization failed for dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) for protocol=interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-212-145-161.us-west-2.compute.amazonaws.com@HDP.LOCAL 2017-09-27 08:32:21,255 INFO ipc.Server (Server.java:authorizeConnection(2161)) - Connection from 10.0.0.210:36800 for protocol org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol is unauthorized for user dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:32:21,255 INFO ipc.Server (Server.java:doRead(949)) - Socket Reader #1 for port 8020: readAndProcess from client 10.0.0.210 threw exception [org.apache.hadoop.security.authorize.AuthorizationException: User dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-212-145-161.us-west-2.compute.amazonaws.com@HDP.LOCAL] 2017-09-27 08:32:21,550 INFO ipc.Server (Server.java:saslProcess(1504)) - Auth successful for dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:32:21,551 WARN authorize.ServiceAuthorizationManager (ServiceAuthorizationManager.java:authorize(119)) - Authorization failed for dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) for protocol=interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-214-181-219.us-west-2.compute.amazonaws.com@HDP.LOCAL 2017-09-27 08:32:21,552 INFO ipc.Server (Server.java:authorizeConnection(2161)) - Connection from 10.0.0.212:52726 for protocol org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol is unauthorized for user dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:32:21,552 INFO ipc.Server (Server.java:doRead(949)) - Socket Reader #1 for port 8020: readAndProcess from client 10.0.0.212 threw exception [org.apache.hadoop.security.authorize.AuthorizationException: User dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-214-181-219.us-west-2.compute.amazonaws.com@HDP.LOCAL] 2017-09-27 08:32:26,261 INFO ipc.Server (Server.java:saslProcess(1504)) - Auth successful for dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:32:26,262 WARN authorize.ServiceAuthorizationManager (ServiceAuthorizationManager.java:authorize(119)) - Authorization failed for dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) for protocol=interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-212-145-161.us-west-2.compute.amazonaws.com@HDP.LOCAL 2017-09-27 08:32:26,262 INFO ipc.Server (Server.java:authorizeConnection(2161)) - Connection from 10.0.0.210:35259 for protocol org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol is unauthorized for user dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:32:26,262 INFO ipc.Server (Server.java:doRead(949)) - Socket Reader #1 for port 8020: readAndProcess from client 10.0.0.210 threw exception [org.apache.hadoop.security.authorize.AuthorizationException: User dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-212-145-161.us-west-2.compute.amazonaws.com@HDP.LOCAL] 2017-09-27 08:32:26,558 INFO ipc.Server (Server.java:saslProcess(1504)) - Auth successful for dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:32:26,559 WARN authorize.ServiceAuthorizationManager (ServiceAuthorizationManager.java:authorize(119)) - Authorization failed for dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) for protocol=interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-214-181-219.us-west-2.compute.amazonaws.com@HDP.LOCAL 2017-09-27 08:32:26,559 INFO ipc.Server (Server.java:authorizeConnection(2161)) - Connection from 10.0.0.212:55506 for protocol org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol is unauthorized for user dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:32:26,559 INFO ipc.Server (Server.java:doRead(949)) - Socket Reader #1 for port 8020: readAndProcess from client 10.0.0.212 threw exception [org.apache.hadoop.security.authorize.AuthorizationException: User dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-214-181-219.us-west-2.compute.amazonaws.com@HDP.LOCAL] 2017-09-27 08:32:31,269 INFO ipc.Server (Server.java:saslProcess(1504)) - Auth successful for dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:32:31,270 WARN authorize.ServiceAuthorizationManager (ServiceAuthorizationManager.java:authorize(119)) - Authorization failed for dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) for protocol=interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-212-145-161.us-west-2.compute.amazonaws.com@HDP.LOCAL 2017-09-27 08:32:31,270 INFO ipc.Server (Server.java:authorizeConnection(2161)) - Connection from 10.0.0.210:58829 for protocol org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol is unauthorized for user dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:32:31,270 INFO ipc.Server (Server.java:doRead(949)) - Socket Reader #1 for port 8020: readAndProcess from client 10.0.0.210 threw exception [org.apache.hadoop.security.authorize.AuthorizationException: User dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-212-145-161.us-west-2.compute.amazonaws.com@HDP.LOCAL] 2017-09-27 08:32:31,564 INFO ipc.Server (Server.java:saslProcess(1504)) - Auth successful for dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:32:31,565 WARN authorize.ServiceAuthorizationManager (ServiceAuthorizationManager.java:authorize(119)) - Authorization failed for dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) for protocol=interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-214-181-219.us-west-2.compute.amazonaws.com@HDP.LOCAL 2017-09-27 08:32:31,565 INFO ipc.Server (Server.java:authorizeConnection(2161)) - Connection from 10.0.0.212:34626 for protocol org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol is unauthorized for user dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:32:31,566 INFO ipc.Server (Server.java:doRead(949)) - Socket Reader #1 for port 8020: readAndProcess from client 10.0.0.212 threw exception [org.apache.hadoop.security.authorize.AuthorizationException: User dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-214-181-219.us-west-2.compute.amazonaws.com@HDP.LOCAL] 2017-09-27 08:32:36,290 INFO ipc.Server (Server.java:saslProcess(1504)) - Auth successful for dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:32:36,295 WARN authorize.ServiceAuthorizationManager (ServiceAuthorizationManager.java:authorize(119)) - Authorization failed for dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) for protocol=interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-212-145-161.us-west-2.compute.amazonaws.com@HDP.LOCAL 2017-09-27 08:32:36,295 INFO ipc.Server (Server.java:authorizeConnection(2161)) - Connection from 10.0.0.210:55510 for protocol org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol is unauthorized for user dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:32:36,295 INFO ipc.Server (Server.java:doRead(949)) - Socket Reader #1 for port 8020: readAndProcess from client 10.0.0.210 threw exception [org.apache.hadoop.security.authorize.AuthorizationException: User dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-212-145-161.us-west-2.compute.amazonaws.com@HDP.LOCAL] 2017-09-27 08:32:36,574 INFO ipc.Server (Server.java:saslProcess(1504)) - Auth successful for dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:32:36,575 WARN authorize.ServiceAuthorizationManager (ServiceAuthorizationManager.java:authorize(119)) - Authorization failed for dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) for protocol=interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-214-181-219.us-west-2.compute.amazonaws.com@HDP.LOCAL 2017-09-27 08:32:36,575 INFO ipc.Server (Server.java:authorizeConnection(2161)) - Connection from 10.0.0.212:34183 for protocol org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol is unauthorized for user dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:32:36,575 INFO ipc.Server (Server.java:doRead(949)) - Socket Reader #1 for port 8020: readAndProcess from client 10.0.0.212 threw exception [org.apache.hadoop.security.authorize.AuthorizationException: User dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-214-181-219.us-west-2.compute.amazonaws.com@HDP.LOCAL] 2017-09-27 08:32:41,337 INFO ipc.Server (Server.java:saslProcess(1504)) - Auth successful for dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:32:41,348 WARN authorize.ServiceAuthorizationManager (ServiceAuthorizationManager.java:authorize(119)) - Authorization failed for dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) for protocol=interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-212-145-161.us-west-2.compute.amazonaws.com@HDP.LOCAL 2017-09-27 08:32:41,349 INFO ipc.Server (Server.java:authorizeConnection(2161)) - Connection from 10.0.0.210:40596 for protocol org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol is unauthorized for user dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:32:41,349 INFO ipc.Server (Server.java:doRead(949)) - Socket Reader #1 for port 8020: readAndProcess from client 10.0.0.210 threw exception [org.apache.hadoop.security.authorize.AuthorizationException: User dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-212-145-161.us-west-2.compute.amazonaws.com@HDP.LOCAL] 2017-09-27 08:32:41,609 INFO ipc.Server (Server.java:saslProcess(1504)) - Auth successful for dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:32:41,621 WARN authorize.ServiceAuthorizationManager (ServiceAuthorizationManager.java:authorize(119)) - Authorization failed for dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) for protocol=interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-214-181-219.us-west-2.compute.amazonaws.com@HDP.LOCAL 2017-09-27 08:32:41,621 INFO ipc.Server (Server.java:authorizeConnection(2161)) - Connection from 10.0.0.212:41739 for protocol org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol is unauthorized for user dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:32:41,621 INFO ipc.Server (Server.java:doRead(949)) - Socket Reader #1 for port 8020: readAndProcess from client 10.0.0.212 threw exception [org.apache.hadoop.security.authorize.AuthorizationException: User dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-214-181-219.us-west-2.compute.amazonaws.com@HDP.LOCAL] 2017-09-27 08:32:46,355 INFO ipc.Server (Server.java:saslProcess(1504)) - Auth successful for dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:32:46,356 WARN authorize.ServiceAuthorizationManager (ServiceAuthorizationManager.java:authorize(119)) - Authorization failed for dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) for protocol=interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-212-145-161.us-west-2.compute.amazonaws.com@HDP.LOCAL 2017-09-27 08:32:46,356 INFO ipc.Server (Server.java:authorizeConnection(2161)) - Connection from 10.0.0.210:46469 for protocol org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol is unauthorized for user dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:32:46,357 INFO ipc.Server (Server.java:doRead(949)) - Socket Reader #1 for port 8020: readAndProcess from client 10.0.0.210 threw exception [org.apache.hadoop.security.authorize.AuthorizationException: User dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-212-145-161.us-west-2.compute.amazonaws.com@HDP.LOCAL] 2017-09-27 08:32:46,627 INFO ipc.Server (Server.java:saslProcess(1504)) - Auth successful for dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:32:46,628 WARN authorize.ServiceAuthorizationManager (ServiceAuthorizationManager.java:authorize(119)) - Authorization failed for dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) for protocol=interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-214-181-219.us-west-2.compute.amazonaws.com@HDP.LOCAL 2017-09-27 08:32:46,628 INFO ipc.Server (Server.java:authorizeConnection(2161)) - Connection from 10.0.0.212:48981 for protocol org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol is unauthorized for user dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:32:46,629 INFO ipc.Server (Server.java:doRead(949)) - Socket Reader #1 for port 8020: readAndProcess from client 10.0.0.212 threw exception [org.apache.hadoop.security.authorize.AuthorizationException: User dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-214-181-219.us-west-2.compute.amazonaws.com@HDP.LOCAL] 2017-09-27 08:32:51,362 INFO ipc.Server (Server.java:saslProcess(1504)) - Auth successful for dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:32:51,363 WARN authorize.ServiceAuthorizationManager (ServiceAuthorizationManager.java:authorize(119)) - Authorization failed for dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) for protocol=interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-212-145-161.us-west-2.compute.amazonaws.com@HDP.LOCAL 2017-09-27 08:32:51,363 INFO ipc.Server (Server.java:authorizeConnection(2161)) - Connection from 10.0.0.210:57859 for protocol org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol is unauthorized for user dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:32:51,363 INFO ipc.Server (Server.java:doRead(949)) - Socket Reader #1 for port 8020: readAndProcess from client 10.0.0.210 threw exception [org.apache.hadoop.security.authorize.AuthorizationException: User dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-212-145-161.us-west-2.compute.amazonaws.com@HDP.LOCAL] 2017-09-27 08:32:51,635 INFO ipc.Server (Server.java:saslProcess(1504)) - Auth successful for dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:32:51,636 WARN authorize.ServiceAuthorizationManager (ServiceAuthorizationManager.java:authorize(119)) - Authorization failed for dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) for protocol=interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-214-181-219.us-west-2.compute.amazonaws.com@HDP.LOCAL 2017-09-27 08:32:51,636 INFO ipc.Server (Server.java:authorizeConnection(2161)) - Connection from 10.0.0.212:40695 for protocol org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol is unauthorized for user dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:32:51,636 INFO ipc.Server (Server.java:doRead(949)) - Socket Reader #1 for port 8020: readAndProcess from client 10.0.0.212 threw exception [org.apache.hadoop.security.authorize.AuthorizationException: User dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-214-181-219.us-west-2.compute.amazonaws.com@HDP.LOCAL] 2017-09-27 08:32:56,404 INFO ipc.Server (Server.java:saslProcess(1504)) - Auth successful for dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:32:56,405 WARN authorize.ServiceAuthorizationManager (ServiceAuthorizationManager.java:authorize(119)) - Authorization failed for dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) for protocol=interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-212-145-161.us-west-2.compute.amazonaws.com@HDP.LOCAL 2017-09-27 08:32:56,405 INFO ipc.Server (Server.java:authorizeConnection(2161)) - Connection from 10.0.0.210:58665 for protocol org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol is unauthorized for user dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:32:56,405 INFO ipc.Server (Server.java:doRead(949)) - Socket Reader #1 for port 8020: readAndProcess from client 10.0.0.210 threw exception [org.apache.hadoop.security.authorize.AuthorizationException: User dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-212-145-161.us-west-2.compute.amazonaws.com@HDP.LOCAL] 2017-09-27 08:32:56,653 INFO ipc.Server (Server.java:saslProcess(1504)) - Auth successful for dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:32:56,654 WARN authorize.ServiceAuthorizationManager (ServiceAuthorizationManager.java:authorize(119)) - Authorization failed for dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) for protocol=interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-214-181-219.us-west-2.compute.amazonaws.com@HDP.LOCAL 2017-09-27 08:32:56,654 INFO ipc.Server (Server.java:authorizeConnection(2161)) - Connection from 10.0.0.212:37257 for protocol org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol is unauthorized for user dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:32:56,655 INFO ipc.Server (Server.java:doRead(949)) - Socket Reader #1 for port 8020: readAndProcess from client 10.0.0.212 threw exception [org.apache.hadoop.security.authorize.AuthorizationException: User dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-214-181-219.us-west-2.compute.amazonaws.com@HDP.LOCAL] 2017-09-27 08:33:01,414 INFO ipc.Server (Server.java:saslProcess(1504)) - Auth successful for dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:33:01,415 WARN authorize.ServiceAuthorizationManager (ServiceAuthorizationManager.java:authorize(119)) - Authorization failed for dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) for protocol=interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-212-145-161.us-west-2.compute.amazonaws.com@HDP.LOCAL 2017-09-27 08:33:01,415 INFO ipc.Server (Server.java:authorizeConnection(2161)) - Connection from 10.0.0.210:54059 for protocol org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol is unauthorized for user dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:33:01,415 INFO ipc.Server (Server.java:doRead(949)) - Socket Reader #1 for port 8020: readAndProcess from client 10.0.0.210 threw exception [org.apache.hadoop.security.authorize.AuthorizationException: User dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-212-145-161.us-west-2.compute.amazonaws.com@HDP.LOCAL] 2017-09-27 08:33:01,671 INFO ipc.Server (Server.java:saslProcess(1504)) - Auth successful for dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:33:01,672 WARN authorize.ServiceAuthorizationManager (ServiceAuthorizationManager.java:authorize(119)) - Authorization failed for dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) for protocol=interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-214-181-219.us-west-2.compute.amazonaws.com@HDP.LOCAL 2017-09-27 08:33:01,673 INFO ipc.Server (Server.java:authorizeConnection(2161)) - Connection from 10.0.0.212:49582 for protocol org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol is unauthorized for user dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:33:01,673 INFO ipc.Server (Server.java:doRead(949)) - Socket Reader #1 for port 8020: readAndProcess from client 10.0.0.212 threw exception [org.apache.hadoop.security.authorize.AuthorizationException: User dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-214-181-219.us-west-2.compute.amazonaws.com@HDP.LOCAL] 2017-09-27 08:33:06,422 INFO ipc.Server (Server.java:saslProcess(1504)) - Auth successful for dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:33:06,423 WARN authorize.ServiceAuthorizationManager (ServiceAuthorizationManager.java:authorize(119)) - Authorization failed for dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) for protocol=interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-212-145-161.us-west-2.compute.amazonaws.com@HDP.LOCAL 2017-09-27 08:33:06,423 INFO ipc.Server (Server.java:authorizeConnection(2161)) - Connection from 10.0.0.210:58959 for protocol org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol is unauthorized for user dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:33:06,423 INFO ipc.Server (Server.java:doRead(949)) - Socket Reader #1 for port 8020: readAndProcess from client 10.0.0.210 threw exception [org.apache.hadoop.security.authorize.AuthorizationException: User dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-212-145-161.us-west-2.compute.amazonaws.com@HDP.LOCAL] 2017-09-27 08:33:06,679 INFO ipc.Server (Server.java:saslProcess(1504)) - Auth successful for dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:33:06,680 WARN authorize.ServiceAuthorizationManager (ServiceAuthorizationManager.java:authorize(119)) - Authorization failed for dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) for protocol=interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-214-181-219.us-west-2.compute.amazonaws.com@HDP.LOCAL 2017-09-27 08:33:06,680 INFO ipc.Server (Server.java:authorizeConnection(2161)) - Connection from 10.0.0.212:51798 for protocol org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol is unauthorized for user dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:33:06,680 INFO ipc.Server (Server.java:doRead(949)) - Socket Reader #1 for port 8020: readAndProcess from client 10.0.0.212 threw exception [org.apache.hadoop.security.authorize.AuthorizationException: User dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-214-181-219.us-west-2.compute.amazonaws.com@HDP.LOCAL] 2017-09-27 08:33:10,545 WARN namenode.FSEditLog (JournalSet.java:selectInputStreams(280)) - Unable to determine input streams from QJM to [10.0.0.248:8485, 10.0.0.163:8485, 10.0.0.66:8485]. Skipping. org.apache.hadoop.hdfs.qjournal.client.QuorumException: Got too many exceptions to achieve quorum size 2/3. 1 successful responses: 10.0.0.163:8485: [[1,1533], [1534,2688], [2689,2732], [2733,2782], [2783,2826], [2827,2870], [2871,2920], [2921,2961], [2962,3005], [3006,3055], [3056,3099], [3100,3143], [3144,3193], [3194,3237], [3238,3281], [3282,3331], [3332,3375], [3376,3419], [3420,3469], [3470,3513], [3514,3557], [3558,3607], [3608,3651], [3652,3695], [3696,3745], [3746,3789], [3790,3833], [3834,3883], [3884,3927], [3928,3971], [3972,4021], [4022,4065], [4066,4109], [4110,4159], [4160,4203], [4204,4247], [4248,4297], [4298,4341], [4342,4379], [4380,4429], [4430,4473], [4474,4518], [4519,4529]] 2 exceptions thrown: 10.0.0.66:8485: User nn/standbynamenode-t5liwl46t1.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.qjournal.protocol.QJournalProtocol, expected client Kerberos principal is nn/ec2-34-208-160-33.us-west-2.compute.amazonaws.com@HDP.LOCAL 10.0.0.248:8485: User nn/standbynamenode-t5liwl46t1.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.qjournal.protocol.QJournalProtocol, expected client Kerberos principal is nn/ec2-34-208-160-33.us-west-2.compute.amazonaws.com@HDP.LOCAL at org.apache.hadoop.hdfs.qjournal.client.QuorumException.create(QuorumException.java:81) at org.apache.hadoop.hdfs.qjournal.client.QuorumCall.rethrowException(QuorumCall.java:223) at org.apache.hadoop.hdfs.qjournal.client.AsyncLoggerSet.waitForWriteQuorum(AsyncLoggerSet.java:142) at org.apache.hadoop.hdfs.qjournal.client.QuorumJournalManager.selectInputStreams(QuorumJournalManager.java:471) at org.apache.hadoop.hdfs.server.namenode.JournalSet.selectInputStreams(JournalSet.java:278) at org.apache.hadoop.hdfs.server.namenode.FSEditLog.selectInputStreams(FSEditLog.java:1520) at org.apache.hadoop.hdfs.server.namenode.FSEditLog.selectInputStreams(FSEditLog.java:1544) at org.apache.hadoop.hdfs.server.namenode.ha.EditLogTailer.doTailEdits(EditLogTailer.java:214) at org.apache.hadoop.hdfs.server.namenode.ha.EditLogTailer$EditLogTailerThread.doWork(EditLogTailer.java:331) at org.apache.hadoop.hdfs.server.namenode.ha.EditLogTailer$EditLogTailerThread.access$200(EditLogTailer.java:284) at org.apache.hadoop.hdfs.server.namenode.ha.EditLogTailer$EditLogTailerThread$1.run(EditLogTailer.java:301) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:360) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1704) at org.apache.hadoop.security.SecurityUtil.doAsLoginUserOrFatal(SecurityUtil.java:447) at org.apache.hadoop.hdfs.server.namenode.ha.EditLogTailer$EditLogTailerThread.run(EditLogTailer.java:297) 2017-09-27 08:33:11,445 INFO ipc.Server (Server.java:saslProcess(1504)) - Auth successful for dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:33:11,452 WARN authorize.ServiceAuthorizationManager (ServiceAuthorizationManager.java:authorize(119)) - Authorization failed for dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) for protocol=interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-212-145-161.us-west-2.compute.amazonaws.com@HDP.LOCAL 2017-09-27 08:33:11,452 INFO ipc.Server (Server.java:authorizeConnection(2161)) - Connection from 10.0.0.210:36602 for protocol org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol is unauthorized for user dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:33:11,453 INFO ipc.Server (Server.java:doRead(949)) - Socket Reader #1 for port 8020: readAndProcess from client 10.0.0.210 threw exception [org.apache.hadoop.security.authorize.AuthorizationException: User dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-212-145-161.us-west-2.compute.amazonaws.com@HDP.LOCAL] 2017-09-27 08:33:11,712 INFO ipc.Server (Server.java:saslProcess(1504)) - Auth successful for dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:33:11,715 WARN authorize.ServiceAuthorizationManager (ServiceAuthorizationManager.java:authorize(119)) - Authorization failed for dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) for protocol=interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-214-181-219.us-west-2.compute.amazonaws.com@HDP.LOCAL 2017-09-27 08:33:11,715 INFO ipc.Server (Server.java:authorizeConnection(2161)) - Connection from 10.0.0.212:47210 for protocol org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol is unauthorized for user dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:33:11,715 INFO ipc.Server (Server.java:doRead(949)) - Socket Reader #1 for port 8020: readAndProcess from client 10.0.0.212 threw exception [org.apache.hadoop.security.authorize.AuthorizationException: User dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-214-181-219.us-west-2.compute.amazonaws.com@HDP.LOCAL] 2017-09-27 08:33:16,460 INFO ipc.Server (Server.java:saslProcess(1504)) - Auth successful for dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:33:16,463 WARN authorize.ServiceAuthorizationManager (ServiceAuthorizationManager.java:authorize(119)) - Authorization failed for dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) for protocol=interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-212-145-161.us-west-2.compute.amazonaws.com@HDP.LOCAL 2017-09-27 08:33:16,463 INFO ipc.Server (Server.java:authorizeConnection(2161)) - Connection from 10.0.0.210:34983 for protocol org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol is unauthorized for user dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:33:16,463 INFO ipc.Server (Server.java:doRead(949)) - Socket Reader #1 for port 8020: readAndProcess from client 10.0.0.210 threw exception [org.apache.hadoop.security.authorize.AuthorizationException: User dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-212-145-161.us-west-2.compute.amazonaws.com@HDP.LOCAL] 2017-09-27 08:33:16,722 INFO ipc.Server (Server.java:saslProcess(1504)) - Auth successful for dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:33:16,724 WARN authorize.ServiceAuthorizationManager (ServiceAuthorizationManager.java:authorize(119)) - Authorization failed for dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) for protocol=interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-214-181-219.us-west-2.compute.amazonaws.com@HDP.LOCAL 2017-09-27 08:33:16,724 INFO ipc.Server (Server.java:authorizeConnection(2161)) - Connection from 10.0.0.212:50824 for protocol org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol is unauthorized for user dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:33:16,724 INFO ipc.Server (Server.java:doRead(949)) - Socket Reader #1 for port 8020: readAndProcess from client 10.0.0.212 threw exception [org.apache.hadoop.security.authorize.AuthorizationException: User dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-214-181-219.us-west-2.compute.amazonaws.com@HDP.LOCAL] 2017-09-27 08:33:21,468 INFO ipc.Server (Server.java:saslProcess(1504)) - Auth successful for dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:33:21,469 WARN authorize.ServiceAuthorizationManager (ServiceAuthorizationManager.java:authorize(119)) - Authorization failed for dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) for protocol=interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-212-145-161.us-west-2.compute.amazonaws.com@HDP.LOCAL 2017-09-27 08:33:21,469 INFO ipc.Server (Server.java:authorizeConnection(2161)) - Connection from 10.0.0.210:37275 for protocol org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol is unauthorized for user dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:33:21,469 INFO ipc.Server (Server.java:doRead(949)) - Socket Reader #1 for port 8020: readAndProcess from client 10.0.0.210 threw exception [org.apache.hadoop.security.authorize.AuthorizationException: User dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-212-145-161.us-west-2.compute.amazonaws.com@HDP.LOCAL] 2017-09-27 08:33:21,729 INFO ipc.Server (Server.java:saslProcess(1504)) - Auth successful for dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:33:21,730 WARN authorize.ServiceAuthorizationManager (ServiceAuthorizationManager.java:authorize(119)) - Authorization failed for dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) for protocol=interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-214-181-219.us-west-2.compute.amazonaws.com@HDP.LOCAL 2017-09-27 08:33:21,730 INFO ipc.Server (Server.java:authorizeConnection(2161)) - Connection from 10.0.0.212:53265 for protocol org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol is unauthorized for user dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:33:21,730 INFO ipc.Server (Server.java:doRead(949)) - Socket Reader #1 for port 8020: readAndProcess from client 10.0.0.212 threw exception [org.apache.hadoop.security.authorize.AuthorizationException: User dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-214-181-219.us-west-2.compute.amazonaws.com@HDP.LOCAL] 2017-09-27 08:33:26,475 INFO ipc.Server (Server.java:saslProcess(1504)) - Auth successful for dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:33:26,477 WARN authorize.ServiceAuthorizationManager (ServiceAuthorizationManager.java:authorize(119)) - Authorization failed for dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) for protocol=interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-212-145-161.us-west-2.compute.amazonaws.com@HDP.LOCAL 2017-09-27 08:33:26,477 INFO ipc.Server (Server.java:authorizeConnection(2161)) - Connection from 10.0.0.210:50945 for protocol org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol is unauthorized for user dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:33:26,477 INFO ipc.Server (Server.java:doRead(949)) - Socket Reader #1 for port 8020: readAndProcess from client 10.0.0.210 threw exception [org.apache.hadoop.security.authorize.AuthorizationException: User dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-212-145-161.us-west-2.compute.amazonaws.com@HDP.LOCAL] 2017-09-27 08:33:56,573 WARN authorize.ServiceAuthorizationManager (ServiceAuthorizationManager.java:authorize(119)) - Authorization failed for dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) for protocol=interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-212-145-161.us-west-2.compute.amazonaws.com@HDP.LOCAL 2017-09-27 08:33:56,573 INFO ipc.Server (Server.java:authorizeConnection(2161)) - Connection from 10.0.0.210:42419 for protocol org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol is unauthorized for user dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:33:56,573 INFO ipc.Server (Server.java:doRead(949)) - Socket Reader #1 for port 8020: readAndProcess from client 10.0.0.210 threw exception [org.apache.hadoop.security.authorize.AuthorizationException: User dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-212-145-161.us-west-2.compute.amazonaws.com@HDP.LOCAL] 2017-09-27 08:33:56,816 INFO ipc.Server (Server.java:saslProcess(1504)) - Auth successful for dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:33:56,817 WARN authorize.ServiceAuthorizationManager (ServiceAuthorizationManager.java:authorize(119)) - Authorization failed for dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) for protocol=interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-214-181-219.us-west-2.compute.amazonaws.com@HDP.LOCAL 2017-09-27 08:33:56,817 INFO ipc.Server (Server.java:authorizeConnection(2161)) - Connection from 10.0.0.212:59921 for protocol org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol is unauthorized for user dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:33:56,818 INFO ipc.Server (Server.java:doRead(949)) - Socket Reader #1 for port 8020: readAndProcess from client 10.0.0.212 threw exception [org.apache.hadoop.security.authorize.AuthorizationException: User dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-214-181-219.us-west-2.compute.amazonaws.com@HDP.LOCAL] 2017-09-27 08:34:01,579 INFO ipc.Server (Server.java:saslProcess(1504)) - Auth successful for dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:34:01,582 WARN authorize.ServiceAuthorizationManager (ServiceAuthorizationManager.java:authorize(119)) - Authorization failed for dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) for protocol=interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-212-145-161.us-west-2.compute.amazonaws.com@HDP.LOCAL 2017-09-27 08:34:01,582 INFO ipc.Server (Server.java:authorizeConnection(2161)) - Connection from 10.0.0.210:54176 for protocol org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol is unauthorized for user dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:34:01,582 INFO ipc.Server (Server.java:doRead(949)) - Socket Reader #1 for port 8020: readAndProcess from client 10.0.0.210 threw exception [org.apache.hadoop.security.authorize.AuthorizationException: User dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-212-145-161.us-west-2.compute.amazonaws.com@HDP.LOCAL] 2017-09-27 08:34:01,831 INFO ipc.Server (Server.java:saslProcess(1504)) - Auth successful for dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:34:01,832 WARN authorize.ServiceAuthorizationManager (ServiceAuthorizationManager.java:authorize(119)) - Authorization failed for dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) for protocol=interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-214-181-219.us-west-2.compute.amazonaws.com@HDP.LOCAL 2017-09-27 08:34:01,832 INFO ipc.Server (Server.java:authorizeConnection(2161)) - Connection from 10.0.0.212:54765 for protocol org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol is unauthorized for user dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:34:01,832 INFO ipc.Server (Server.java:doRead(949)) - Socket Reader #1 for port 8020: readAndProcess from client 10.0.0.212 threw exception [org.apache.hadoop.security.authorize.AuthorizationException: User dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-214-181-219.us-west-2.compute.amazonaws.com@HDP.LOCAL] 2017-09-27 08:34:06,591 INFO ipc.Server (Server.java:saslProcess(1504)) - Auth successful for dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:34:06,592 WARN authorize.ServiceAuthorizationManager (ServiceAuthorizationManager.java:authorize(119)) - Authorization failed for dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) for protocol=interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-212-145-161.us-west-2.compute.amazonaws.com@HDP.LOCAL 2017-09-27 08:34:06,592 INFO ipc.Server (Server.java:authorizeConnection(2161)) - Connection from 10.0.0.210:44605 for protocol org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol is unauthorized for user dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:34:06,592 INFO ipc.Server (Server.java:doRead(949)) - Socket Reader #1 for port 8020: readAndProcess from client 10.0.0.210 threw exception [org.apache.hadoop.security.authorize.AuthorizationException: User dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-212-145-161.us-west-2.compute.amazonaws.com@HDP.LOCAL] 2017-09-27 08:34:06,838 INFO ipc.Server (Server.java:saslProcess(1504)) - Auth successful for dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:34:06,839 WARN authorize.ServiceAuthorizationManager (ServiceAuthorizationManager.java:authorize(119)) - Authorization failed for dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) for protocol=interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-214-181-219.us-west-2.compute.amazonaws.com@HDP.LOCAL 2017-09-27 08:34:06,839 INFO ipc.Server (Server.java:authorizeConnection(2161)) - Connection from 10.0.0.212:33294 for protocol org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol is unauthorized for user dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:34:06,839 INFO ipc.Server (Server.java:doRead(949)) - Socket Reader #1 for port 8020: readAndProcess from client 10.0.0.212 threw exception [org.apache.hadoop.security.authorize.AuthorizationException: User dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-214-181-219.us-west-2.compute.amazonaws.com@HDP.LOCAL] 2017-09-27 08:34:10,573 WARN namenode.FSEditLog (JournalSet.java:selectInputStreams(280)) - Unable to determine input streams from QJM to [10.0.0.248:8485, 10.0.0.163:8485, 10.0.0.66:8485]. Skipping. org.apache.hadoop.hdfs.qjournal.client.QuorumException: Got too many exceptions to achieve quorum size 2/3. 1 successful responses: 10.0.0.163:8485: [[1,1533], [1534,2688], [2689,2732], [2733,2782], [2783,2826], [2827,2870], [2871,2920], [2921,2961], [2962,3005], [3006,3055], [3056,3099], [3100,3143], [3144,3193], [3194,3237], [3238,3281], [3282,3331], [3332,3375], [3376,3419], [3420,3469], [3470,3513], [3514,3557], [3558,3607], [3608,3651], [3652,3695], [3696,3745], [3746,3789], [3790,3833], [3834,3883], [3884,3927], [3928,3971], [3972,4021], [4022,4065], [4066,4109], [4110,4159], [4160,4203], [4204,4247], [4248,4297], [4298,4341], [4342,4379], [4380,4429], [4430,4473], [4474,4518], [4519,4529]] 2 exceptions thrown: 10.0.0.66:8485: User nn/standbynamenode-t5liwl46t1.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.qjournal.protocol.QJournalProtocol, expected client Kerberos principal is nn/ec2-34-208-160-33.us-west-2.compute.amazonaws.com@HDP.LOCAL 10.0.0.248:8485: User nn/standbynamenode-t5liwl46t1.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.qjournal.protocol.QJournalProtocol, expected client Kerberos principal is nn/ec2-34-208-160-33.us-west-2.compute.amazonaws.com@HDP.LOCAL at org.apache.hadoop.hdfs.qjournal.client.QuorumException.create(QuorumException.java:81) at org.apache.hadoop.hdfs.qjournal.client.QuorumCall.rethrowException(QuorumCall.java:223) at org.apache.hadoop.hdfs.qjournal.client.AsyncLoggerSet.waitForWriteQuorum(AsyncLoggerSet.java:142) at org.apache.hadoop.hdfs.qjournal.client.QuorumJournalManager.selectInputStreams(QuorumJournalManager.java:471) at org.apache.hadoop.hdfs.server.namenode.JournalSet.selectInputStreams(JournalSet.java:278) at org.apache.hadoop.hdfs.server.namenode.FSEditLog.selectInputStreams(FSEditLog.java:1520) at org.apache.hadoop.hdfs.server.namenode.FSEditLog.selectInputStreams(FSEditLog.java:1544) at org.apache.hadoop.hdfs.server.namenode.ha.EditLogTailer.doTailEdits(EditLogTailer.java:214) at org.apache.hadoop.hdfs.server.namenode.ha.EditLogTailer$EditLogTailerThread.doWork(EditLogTailer.java:331) at org.apache.hadoop.hdfs.server.namenode.ha.EditLogTailer$EditLogTailerThread.access$200(EditLogTailer.java:284) at org.apache.hadoop.hdfs.server.namenode.ha.EditLogTailer$EditLogTailerThread$1.run(EditLogTailer.java:301) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:360) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1704) at org.apache.hadoop.security.SecurityUtil.doAsLoginUserOrFatal(SecurityUtil.java:447) at org.apache.hadoop.hdfs.server.namenode.ha.EditLogTailer$EditLogTailerThread.run(EditLogTailer.java:297) 2017-09-27 08:34:11,598 INFO ipc.Server (Server.java:saslProcess(1504)) - Auth successful for dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:34:11,599 WARN authorize.ServiceAuthorizationManager (ServiceAuthorizationManager.java:authorize(119)) - Authorization failed for dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) for protocol=interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-212-145-161.us-west-2.compute.amazonaws.com@HDP.LOCAL 2017-09-27 08:34:11,599 INFO ipc.Server (Server.java:authorizeConnection(2161)) - Connection from 10.0.0.210:45936 for protocol org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol is unauthorized for user dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:34:11,599 INFO ipc.Server (Server.java:doRead(949)) - Socket Reader #1 for port 8020: readAndProcess from client 10.0.0.210 threw exception [org.apache.hadoop.security.authorize.AuthorizationException: User dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-212-145-161.us-west-2.compute.amazonaws.com@HDP.LOCAL] 2017-09-27 08:34:11,845 INFO ipc.Server (Server.java:saslProcess(1504)) - Auth successful for dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:34:46,728 WARN authorize.ServiceAuthorizationManager (ServiceAuthorizationManager.java:authorize(119)) - Authorization failed for dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) for protocol=interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-212-145-161.us-west-2.compute.amazonaws.com@HDP.LOCAL 2017-09-27 08:34:46,728 INFO ipc.Server (Server.java:authorizeConnection(2161)) - Connection from 10.0.0.210:39584 for protocol org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol is unauthorized for user dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:34:46,728 INFO ipc.Server (Server.java:doRead(949)) - Socket Reader #1 for port 8020: readAndProcess from client 10.0.0.210 threw exception [org.apache.hadoop.security.authorize.AuthorizationException: User dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-212-145-161.us-west-2.compute.amazonaws.com@HDP.LOCAL] 2017-09-27 08:34:47,023 INFO ipc.Server (Server.java:saslProcess(1504)) - Auth successful for dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:34:47,025 WARN authorize.ServiceAuthorizationManager (ServiceAuthorizationManager.java:authorize(119)) - Authorization failed for dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) for protocol=interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-214-181-219.us-west-2.compute.amazonaws.com@HDP.LOCAL 2017-09-27 08:34:47,025 INFO ipc.Server (Server.java:authorizeConnection(2161)) - Connection from 10.0.0.212:34006 for protocol org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol is unauthorized for user dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:34:47,025 INFO ipc.Server (Server.java:doRead(949)) - Socket Reader #1 for port 8020: readAndProcess from client 10.0.0.212 threw exception [org.apache.hadoop.security.authorize.AuthorizationException: User dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-214-181-219.us-west-2.compute.amazonaws.com@HDP.LOCAL] 2017-09-27 08:34:51,734 INFO ipc.Server (Server.java:saslProcess(1504)) - Auth successful for dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:34:51,736 WARN authorize.ServiceAuthorizationManager (ServiceAuthorizationManager.java:authorize(119)) - Authorization failed for dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) for protocol=interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-212-145-161.us-west-2.compute.amazonaws.com@HDP.LOCAL 2017-09-27 08:34:51,736 INFO ipc.Server (Server.java:authorizeConnection(2161)) - Connection from 10.0.0.210:43081 for protocol org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol is unauthorized for user dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:34:51,736 INFO ipc.Server (Server.java:doRead(949)) - Socket Reader #1 for port 8020: readAndProcess from client 10.0.0.210 threw exception [org.apache.hadoop.security.authorize.AuthorizationException: User dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-212-145-161.us-west-2.compute.amazonaws.com@HDP.LOCAL] 2017-09-27 08:34:52,032 INFO ipc.Server (Server.java:saslProcess(1504)) - Auth successful for dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:34:52,033 WARN authorize.ServiceAuthorizationManager (ServiceAuthorizationManager.java:authorize(119)) - Authorization failed for dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) for protocol=interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-214-181-219.us-west-2.compute.amazonaws.com@HDP.LOCAL 2017-09-27 08:34:52,033 INFO ipc.Server (Server.java:authorizeConnection(2161)) - Connection from 10.0.0.212:59808 for protocol org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol is unauthorized for user dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:34:52,033 INFO ipc.Server (Server.java:doRead(949)) - Socket Reader #1 for port 8020: readAndProcess from client 10.0.0.212 threw exception [org.apache.hadoop.security.authorize.AuthorizationException: User dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-214-181-219.us-west-2.compute.amazonaws.com@HDP.LOCAL] 2017-09-27 08:34:56,752 INFO ipc.Server (Server.java:saslProcess(1504)) - Auth successful for dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:34:56,753 WARN authorize.ServiceAuthorizationManager (ServiceAuthorizationManager.java:authorize(119)) - Authorization failed for dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) for protocol=interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-212-145-161.us-west-2.compute.amazonaws.com@HDP.LOCAL 2017-09-27 08:34:56,753 INFO ipc.Server (Server.java:authorizeConnection(2161)) - Connection from 10.0.0.210:51756 for protocol org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol is unauthorized for user dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:34:56,753 INFO ipc.Server (Server.java:doRead(949)) - Socket Reader #1 for port 8020: readAndProcess from client 10.0.0.210 threw exception [org.apache.hadoop.security.authorize.AuthorizationException: User dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-212-145-161.us-west-2.compute.amazonaws.com@HDP.LOCAL] 2017-09-27 08:34:57,041 INFO ipc.Server (Server.java:saslProcess(1504)) - Auth successful for dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:34:57,042 WARN authorize.ServiceAuthorizationManager (ServiceAuthorizationManager.java:authorize(119)) - Authorization failed for dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) for protocol=interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-214-181-219.us-west-2.compute.amazonaws.com@HDP.LOCAL 2017-09-27 08:34:57,042 INFO ipc.Server (Server.java:authorizeConnection(2161)) - Connection from 10.0.0.212:56549 for protocol org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol is unauthorized for user dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:34:57,042 INFO ipc.Server (Server.java:doRead(949)) - Socket Reader #1 for port 8020: readAndProcess from client 10.0.0.212 threw exception [org.apache.hadoop.security.authorize.AuthorizationException: User dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-214-181-219.us-west-2.compute.amazonaws.com@HDP.LOCAL] 2017-09-27 08:35:01,759 INFO ipc.Server (Server.java:saslProcess(1504)) - Auth successful for dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:35:01,760 WARN authorize.ServiceAuthorizationManager (ServiceAuthorizationManager.java:authorize(119)) - Authorization failed for dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) for protocol=interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-212-145-161.us-west-2.compute.amazonaws.com@HDP.LOCAL 2017-09-27 08:35:01,760 INFO ipc.Server (Server.java:authorizeConnection(2161)) - Connection from 10.0.0.210:60898 for protocol org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol is unauthorized for user dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:35:01,761 INFO ipc.Server (Server.java:doRead(949)) - Socket Reader #1 for port 8020: readAndProcess from client 10.0.0.210 threw exception [org.apache.hadoop.security.authorize.AuthorizationException: User dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-212-145-161.us-west-2.compute.amazonaws.com@HDP.LOCAL] 2017-09-27 08:35:02,048 INFO ipc.Server (Server.java:saslProcess(1504)) - Auth successful for dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:35:02,050 WARN authorize.ServiceAuthorizationManager (ServiceAuthorizationManager.java:authorize(119)) - Authorization failed for dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) for protocol=interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-214-181-219.us-west-2.compute.amazonaws.com@HDP.LOCAL 2017-09-27 08:35:02,050 INFO ipc.Server (Server.java:authorizeConnection(2161)) - Connection from 10.0.0.212:40440 for protocol org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol is unauthorized for user dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:35:02,050 INFO ipc.Server (Server.java:doRead(949)) - Socket Reader #1 for port 8020: readAndProcess from client 10.0.0.212 threw exception [org.apache.hadoop.security.authorize.AuthorizationException: User dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-214-181-219.us-west-2.compute.amazonaws.com@HDP.LOCAL] 2017-09-27 08:35:06,766 INFO ipc.Server (Server.java:saslProcess(1504)) - Auth successful for dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:35:06,768 WARN authorize.ServiceAuthorizationManager (ServiceAuthorizationManager.java:authorize(119)) - Authorization failed for dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) for protocol=interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-212-145-161.us-west-2.compute.amazonaws.com@HDP.LOCAL 2017-09-27 08:35:06,768 INFO ipc.Server (Server.java:authorizeConnection(2161)) - Connection from 10.0.0.210:32920 for protocol org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol is unauthorized for user dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:35:06,768 INFO ipc.Server (Server.java:doRead(949)) - Socket Reader #1 for port 8020: readAndProcess from client 10.0.0.210 threw exception [org.apache.hadoop.security.authorize.AuthorizationException: User dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-212-145-161.us-west-2.compute.amazonaws.com@HDP.LOCAL] 2017-09-27 08:35:07,055 INFO ipc.Server (Server.java:saslProcess(1504)) - Auth successful for dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:35:07,056 WARN authorize.ServiceAuthorizationManager (ServiceAuthorizationManager.java:authorize(119)) - Authorization failed for dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) for protocol=interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-214-181-219.us-west-2.compute.amazonaws.com@HDP.LOCAL 2017-09-27 08:35:07,056 INFO ipc.Server (Server.java:authorizeConnection(2161)) - Connection from 10.0.0.212:35536 for protocol org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol is unauthorized for user dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:35:07,056 INFO ipc.Server (Server.java:doRead(949)) - Socket Reader #1 for port 8020: readAndProcess from client 10.0.0.212 threw exception [org.apache.hadoop.security.authorize.AuthorizationException: User dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-214-181-219.us-west-2.compute.amazonaws.com@HDP.LOCAL] 2017-09-27 08:35:10,617 WARN namenode.FSEditLog (JournalSet.java:selectInputStreams(280)) - Unable to determine input streams from QJM to [10.0.0.248:8485, 10.0.0.163:8485, 10.0.0.66:8485]. Skipping. org.apache.hadoop.hdfs.qjournal.client.QuorumException: Got too many exceptions to achieve quorum size 2/3. 1 successful responses: 10.0.0.163:8485: [[1,1533], [1534,2688], [2689,2732], [2733,2782], [2783,2826], [2827,2870], [2871,2920], [2921,2961], [2962,3005], [3006,3055], [3056,3099], [3100,3143], [3144,3193], [3194,3237], [3238,3281], [3282,3331], [3332,3375], [3376,3419], [3420,3469], [3470,3513], [3514,3557], [3558,3607], [3608,3651], [3652,3695], [3696,3745], [3746,3789], [3790,3833], [3834,3883], [3884,3927], [3928,3971], [3972,4021], [4022,4065], [4066,4109], [4110,4159], [4160,4203], [4204,4247], [4248,4297], [4298,4341], [4342,4379], [4380,4429], [4430,4473], [4474,4518], [4519,4529]] 2 exceptions thrown: 10.0.0.66:8485: User nn/standbynamenode-t5liwl46t1.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.qjournal.protocol.QJournalProtocol, expected client Kerberos principal is nn/ec2-34-208-160-33.us-west-2.compute.amazonaws.com@HDP.LOCAL 10.0.0.248:8485: User nn/standbynamenode-t5liwl46t1.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.qjournal.protocol.QJournalProtocol, expected client Kerberos principal is nn/ec2-34-208-160-33.us-west-2.compute.amazonaws.com@HDP.LOCAL at org.apache.hadoop.hdfs.qjournal.client.QuorumException.create(QuorumException.java:81) at org.apache.hadoop.hdfs.qjournal.client.QuorumCall.rethrowException(QuorumCall.java:223) at org.apache.hadoop.hdfs.qjournal.client.AsyncLoggerSet.waitForWriteQuorum(AsyncLoggerSet.java:142) at org.apache.hadoop.hdfs.qjournal.client.QuorumJournalManager.selectInputStreams(QuorumJournalManager.java:471) at org.apache.hadoop.hdfs.server.namenode.JournalSet.selectInputStreams(JournalSet.java:278) at org.apache.hadoop.hdfs.server.namenode.FSEditLog.selectInputStreams(FSEditLog.java:1520) at org.apache.hadoop.hdfs.server.namenode.FSEditLog.selectInputStreams(FSEditLog.java:1544) at org.apache.hadoop.hdfs.server.namenode.ha.EditLogTailer.doTailEdits(EditLogTailer.java:214) at org.apache.hadoop.hdfs.server.namenode.ha.EditLogTailer$EditLogTailerThread.doWork(EditLogTailer.java:331) at org.apache.hadoop.hdfs.server.namenode.ha.EditLogTailer$EditLogTailerThread.access$200(EditLogTailer.java:284) at org.apache.hadoop.hdfs.server.namenode.ha.EditLogTailer$EditLogTailerThread$1.run(EditLogTailer.java:301) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:360) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1704) at org.apache.hadoop.security.SecurityUtil.doAsLoginUserOrFatal(SecurityUtil.java:447) at org.apache.hadoop.hdfs.server.namenode.ha.EditLogTailer$EditLogTailerThread.run(EditLogTailer.java:297) 2017-09-27 08:35:11,776 INFO ipc.Server (Server.java:saslProcess(1504)) - Auth successful for dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:35:11,778 WARN authorize.ServiceAuthorizationManager (ServiceAuthorizationManager.java:authorize(119)) - Authorization failed for dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) for protocol=interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-212-145-161.us-west-2.compute.amazonaws.com@HDP.LOCAL 2017-09-27 08:35:11,778 INFO ipc.Server (Server.java:authorizeConnection(2161)) - Connection from 10.0.0.210:57227 for protocol org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol is unauthorized for user dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:35:11,778 INFO ipc.Server (Server.java:doRead(949)) - Socket Reader #1 for port 8020: readAndProcess from client 10.0.0.210 threw exception [org.apache.hadoop.security.authorize.AuthorizationException: User dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-212-145-161.us-west-2.compute.amazonaws.com@HDP.LOCAL] 2017-09-27 08:35:12,063 INFO ipc.Server (Server.java:saslProcess(1504)) - Auth successful for dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:35:12,065 WARN authorize.ServiceAuthorizationManager (ServiceAuthorizationManager.java:authorize(119)) - Authorization failed for dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) for protocol=interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-214-181-219.us-west-2.compute.amazonaws.com@HDP.LOCAL 2017-09-27 08:35:12,065 INFO ipc.Server (Server.java:authorizeConnection(2161)) - Connection from 10.0.0.212:42543 for protocol org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol is unauthorized for user dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:35:12,065 INFO ipc.Server (Server.java:doRead(949)) - Socket Reader #1 for port 8020: readAndProcess from client 10.0.0.212 threw exception [org.apache.hadoop.security.authorize.AuthorizationException: User dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-214-181-219.us-west-2.compute.amazonaws.com@HDP.LOCAL] 2017-09-27 08:35:16,784 INFO ipc.Server (Server.java:saslProcess(1504)) - Auth successful for dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:35:16,785 WARN authorize.ServiceAuthorizationManager (ServiceAuthorizationManager.java:authorize(119)) - Authorization failed for dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) for protocol=interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-212-145-161.us-west-2.compute.amazonaws.com@HDP.LOCAL 2017-09-27 08:35:16,785 INFO ipc.Server (Server.java:authorizeConnection(2161)) - Connection from 10.0.0.210:40937 for protocol org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol is unauthorized for user dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:35:16,785 INFO ipc.Server (Server.java:doRead(949)) - Socket Reader #1 for port 8020: readAndProcess from client 10.0.0.210 threw exception [org.apache.hadoop.security.authorize.AuthorizationException: User dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-212-145-161.us-west-2.compute.amazonaws.com@HDP.LOCAL] 2017-09-27 08:35:17,070 INFO ipc.Server (Server.java:saslProcess(1504)) - Auth successful for dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:35:17,071 WARN authorize.ServiceAuthorizationManager (ServiceAuthorizationManager.java:authorize(119)) - Authorization failed for dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) for protocol=interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-214-181-219.us-west-2.compute.amazonaws.com@HDP.LOCAL 2017-09-27 08:35:17,071 INFO ipc.Server (Server.java:authorizeConnection(2161)) - Connection from 10.0.0.212:58779 for protocol org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol is unauthorized for user dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:35:17,071 INFO ipc.Server (Server.java:doRead(949)) - Socket Reader #1 for port 8020: readAndProcess from client 10.0.0.212 threw exception [org.apache.hadoop.security.authorize.AuthorizationException: User dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-214-181-219.us-west-2.compute.amazonaws.com@HDP.LOCAL] 2017-09-27 08:35:21,792 INFO ipc.Server (Server.java:saslProcess(1504)) - Auth successful for dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:36:02,198 WARN authorize.ServiceAuthorizationManager (ServiceAuthorizationManager.java:authorize(119)) - Authorization failed for dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) for protocol=interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-214-181-219.us-west-2.compute.amazonaws.com@HDP.LOCAL 2017-09-27 08:36:02,198 INFO ipc.Server (Server.java:authorizeConnection(2161)) - Connection from 10.0.0.212:40529 for protocol org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol is unauthorized for user dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:36:02,198 INFO ipc.Server (Server.java:doRead(949)) - Socket Reader #1 for port 8020: readAndProcess from client 10.0.0.212 threw exception [org.apache.hadoop.security.authorize.AuthorizationException: User dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-214-181-219.us-west-2.compute.amazonaws.com@HDP.LOCAL] 2017-09-27 08:36:06,888 INFO ipc.Server (Server.java:saslProcess(1504)) - Auth successful for dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:36:06,890 WARN authorize.ServiceAuthorizationManager (ServiceAuthorizationManager.java:authorize(119)) - Authorization failed for dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) for protocol=interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-212-145-161.us-west-2.compute.amazonaws.com@HDP.LOCAL 2017-09-27 08:36:06,890 INFO ipc.Server (Server.java:authorizeConnection(2161)) - Connection from 10.0.0.210:59632 for protocol org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol is unauthorized for user dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:36:06,890 INFO ipc.Server (Server.java:doRead(949)) - Socket Reader #1 for port 8020: readAndProcess from client 10.0.0.210 threw exception [org.apache.hadoop.security.authorize.AuthorizationException: User dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-212-145-161.us-west-2.compute.amazonaws.com@HDP.LOCAL] 2017-09-27 08:36:07,203 INFO ipc.Server (Server.java:saslProcess(1504)) - Auth successful for dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:36:07,205 WARN authorize.ServiceAuthorizationManager (ServiceAuthorizationManager.java:authorize(119)) - Authorization failed for dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) for protocol=interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-214-181-219.us-west-2.compute.amazonaws.com@HDP.LOCAL 2017-09-27 08:36:07,205 INFO ipc.Server (Server.java:authorizeConnection(2161)) - Connection from 10.0.0.212:55513 for protocol org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol is unauthorized for user dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:36:07,205 INFO ipc.Server (Server.java:doRead(949)) - Socket Reader #1 for port 8020: readAndProcess from client 10.0.0.212 threw exception [org.apache.hadoop.security.authorize.AuthorizationException: User dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-214-181-219.us-west-2.compute.amazonaws.com@HDP.LOCAL] 2017-09-27 08:36:10,650 WARN namenode.FSEditLog (JournalSet.java:selectInputStreams(280)) - Unable to determine input streams from QJM to [10.0.0.248:8485, 10.0.0.163:8485, 10.0.0.66:8485]. Skipping. org.apache.hadoop.hdfs.qjournal.client.QuorumException: Got too many exceptions to achieve quorum size 2/3. 1 successful responses: 10.0.0.163:8485: [[1,1533], [1534,2688], [2689,2732], [2733,2782], [2783,2826], [2827,2870], [2871,2920], [2921,2961], [2962,3005], [3006,3055], [3056,3099], [3100,3143], [3144,3193], [3194,3237], [3238,3281], [3282,3331], [3332,3375], [3376,3419], [3420,3469], [3470,3513], [3514,3557], [3558,3607], [3608,3651], [3652,3695], [3696,3745], [3746,3789], [3790,3833], [3834,3883], [3884,3927], [3928,3971], [3972,4021], [4022,4065], [4066,4109], [4110,4159], [4160,4203], [4204,4247], [4248,4297], [4298,4341], [4342,4379], [4380,4429], [4430,4473], [4474,4518], [4519,4529]] 2 exceptions thrown: 10.0.0.66:8485: User nn/standbynamenode-t5liwl46t1.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.qjournal.protocol.QJournalProtocol, expected client Kerberos principal is nn/ec2-34-208-160-33.us-west-2.compute.amazonaws.com@HDP.LOCAL 10.0.0.248:8485: User nn/standbynamenode-t5liwl46t1.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.qjournal.protocol.QJournalProtocol, expected client Kerberos principal is nn/ec2-34-208-160-33.us-west-2.compute.amazonaws.com@HDP.LOCAL at org.apache.hadoop.hdfs.qjournal.client.QuorumException.create(QuorumException.java:81) at org.apache.hadoop.hdfs.qjournal.client.QuorumCall.rethrowException(QuorumCall.java:223) at org.apache.hadoop.hdfs.qjournal.client.AsyncLoggerSet.waitForWriteQuorum(AsyncLoggerSet.java:142) at org.apache.hadoop.hdfs.qjournal.client.QuorumJournalManager.selectInputStreams(QuorumJournalManager.java:471) at org.apache.hadoop.hdfs.server.namenode.JournalSet.selectInputStreams(JournalSet.java:278) at org.apache.hadoop.hdfs.server.namenode.FSEditLog.selectInputStreams(FSEditLog.java:1520) at org.apache.hadoop.hdfs.server.namenode.FSEditLog.selectInputStreams(FSEditLog.java:1544) at org.apache.hadoop.hdfs.server.namenode.ha.EditLogTailer.doTailEdits(EditLogTailer.java:214) at org.apache.hadoop.hdfs.server.namenode.ha.EditLogTailer$EditLogTailerThread.doWork(EditLogTailer.java:331) at org.apache.hadoop.hdfs.server.namenode.ha.EditLogTailer$EditLogTailerThread.access$200(EditLogTailer.java:284) at org.apache.hadoop.hdfs.server.namenode.ha.EditLogTailer$EditLogTailerThread$1.run(EditLogTailer.java:301) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:360) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1704) at org.apache.hadoop.security.SecurityUtil.doAsLoginUserOrFatal(SecurityUtil.java:447) at org.apache.hadoop.hdfs.server.namenode.ha.EditLogTailer$EditLogTailerThread.run(EditLogTailer.java:297) 2017-09-27 08:36:11,896 INFO ipc.Server (Server.java:saslProcess(1504)) - Auth successful for dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:36:11,897 WARN authorize.ServiceAuthorizationManager (ServiceAuthorizationManager.java:authorize(119)) - Authorization failed for dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) for protocol=interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-212-145-161.us-west-2.compute.amazonaws.com@HDP.LOCAL 2017-09-27 08:36:11,898 INFO ipc.Server (Server.java:authorizeConnection(2161)) - Connection from 10.0.0.210:48049 for protocol org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol is unauthorized for user dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:36:11,898 INFO ipc.Server (Server.java:doRead(949)) - Socket Reader #1 for port 8020: readAndProcess from client 10.0.0.210 threw exception [org.apache.hadoop.security.authorize.AuthorizationException: User dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-212-145-161.us-west-2.compute.amazonaws.com@HDP.LOCAL] 2017-09-27 08:36:12,212 INFO ipc.Server (Server.java:saslProcess(1504)) - Auth successful for dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:36:12,215 WARN authorize.ServiceAuthorizationManager (ServiceAuthorizationManager.java:authorize(119)) - Authorization failed for dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) for protocol=interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-214-181-219.us-west-2.compute.amazonaws.com@HDP.LOCAL 2017-09-27 08:36:12,215 INFO ipc.Server (Server.java:authorizeConnection(2161)) - Connection from 10.0.0.212:48030 for protocol org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol is unauthorized for user dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:36:12,215 INFO ipc.Server (Server.java:doRead(949)) - Socket Reader #1 for port 8020: readAndProcess from client 10.0.0.212 threw exception [org.apache.hadoop.security.authorize.AuthorizationException: User dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-214-181-219.us-west-2.compute.amazonaws.com@HDP.LOCAL] 2017-09-27 08:36:16,903 INFO ipc.Server (Server.java:saslProcess(1504)) - Auth successful for dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:36:16,904 WARN authorize.ServiceAuthorizationManager (ServiceAuthorizationManager.java:authorize(119)) - Authorization failed for dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) for protocol=interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-212-145-161.us-west-2.compute.amazonaws.com@HDP.LOCAL 2017-09-27 08:36:16,904 INFO ipc.Server (Server.java:authorizeConnection(2161)) - Connection from 10.0.0.210:51518 for protocol org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol is unauthorized for user dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:36:16,904 INFO ipc.Server (Server.java:doRead(949)) - Socket Reader #1 for port 8020: readAndProcess from client 10.0.0.210 threw exception [org.apache.hadoop.security.authorize.AuthorizationException: User dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-212-145-161.us-west-2.compute.amazonaws.com@HDP.LOCAL] 2017-09-27 08:36:17,220 INFO ipc.Server (Server.java:saslProcess(1504)) - Auth successful for dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:36:17,221 WARN authorize.ServiceAuthorizationManager (ServiceAuthorizationManager.java:authorize(119)) - Authorization failed for dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) for protocol=interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-214-181-219.us-west-2.compute.amazonaws.com@HDP.LOCAL 2017-09-27 08:36:17,221 INFO ipc.Server (Server.java:authorizeConnection(2161)) - Connection from 10.0.0.212:40738 for protocol org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol is unauthorized for user dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:36:17,221 INFO ipc.Server (Server.java:doRead(949)) - Socket Reader #1 for port 8020: readAndProcess from client 10.0.0.212 threw exception [org.apache.hadoop.security.authorize.AuthorizationException: User dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-214-181-219.us-west-2.compute.amazonaws.com@HDP.LOCAL] 2017-09-27 08:36:21,909 INFO ipc.Server (Server.java:saslProcess(1504)) - Auth successful for dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:36:52,269 WARN authorize.ServiceAuthorizationManager (ServiceAuthorizationManager.java:authorize(119)) - Authorization failed for dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) for protocol=interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-214-181-219.us-west-2.compute.amazonaws.com@HDP.LOCAL 2017-09-27 08:36:52,269 INFO ipc.Server (Server.java:authorizeConnection(2161)) - Connection from 10.0.0.212:60721 for protocol org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol is unauthorized for user dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:36:52,270 INFO ipc.Server (Server.java:doRead(949)) - Socket Reader #1 for port 8020: readAndProcess from client 10.0.0.212 threw exception [org.apache.hadoop.security.authorize.AuthorizationException: User dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-214-181-219.us-west-2.compute.amazonaws.com@HDP.LOCAL] 2017-09-27 08:36:56,961 INFO ipc.Server (Server.java:saslProcess(1504)) - Auth successful for dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:36:56,962 WARN authorize.ServiceAuthorizationManager (ServiceAuthorizationManager.java:authorize(119)) - Authorization failed for dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) for protocol=interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-212-145-161.us-west-2.compute.amazonaws.com@HDP.LOCAL 2017-09-27 08:36:56,962 INFO ipc.Server (Server.java:authorizeConnection(2161)) - Connection from 10.0.0.210:41350 for protocol org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol is unauthorized for user dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:36:56,962 INFO ipc.Server (Server.java:doRead(949)) - Socket Reader #1 for port 8020: readAndProcess from client 10.0.0.210 threw exception [org.apache.hadoop.security.authorize.AuthorizationException: User dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-212-145-161.us-west-2.compute.amazonaws.com@HDP.LOCAL] 2017-09-27 08:36:57,274 INFO ipc.Server (Server.java:saslProcess(1504)) - Auth successful for dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:36:57,275 WARN authorize.ServiceAuthorizationManager (ServiceAuthorizationManager.java:authorize(119)) - Authorization failed for dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) for protocol=interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-214-181-219.us-west-2.compute.amazonaws.com@HDP.LOCAL 2017-09-27 08:36:57,275 INFO ipc.Server (Server.java:authorizeConnection(2161)) - Connection from 10.0.0.212:37574 for protocol org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol is unauthorized for user dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:36:57,275 INFO ipc.Server (Server.java:doRead(949)) - Socket Reader #1 for port 8020: readAndProcess from client 10.0.0.212 threw exception [org.apache.hadoop.security.authorize.AuthorizationException: User dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-214-181-219.us-west-2.compute.amazonaws.com@HDP.LOCAL] 2017-09-27 08:37:01,968 INFO ipc.Server (Server.java:saslProcess(1504)) - Auth successful for dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:37:01,969 WARN authorize.ServiceAuthorizationManager (ServiceAuthorizationManager.java:authorize(119)) - Authorization failed for dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) for protocol=interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-212-145-161.us-west-2.compute.amazonaws.com@HDP.LOCAL 2017-09-27 08:37:01,969 INFO ipc.Server (Server.java:authorizeConnection(2161)) - Connection from 10.0.0.210:43601 for protocol org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol is unauthorized for user dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:37:01,969 INFO ipc.Server (Server.java:doRead(949)) - Socket Reader #1 for port 8020: readAndProcess from client 10.0.0.210 threw exception [org.apache.hadoop.security.authorize.AuthorizationException: User dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-212-145-161.us-west-2.compute.amazonaws.com@HDP.LOCAL] 2017-09-27 08:37:02,280 INFO ipc.Server (Server.java:saslProcess(1504)) - Auth successful for dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:37:02,282 WARN authorize.ServiceAuthorizationManager (ServiceAuthorizationManager.java:authorize(119)) - Authorization failed for dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) for protocol=interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-214-181-219.us-west-2.compute.amazonaws.com@HDP.LOCAL 2017-09-27 08:37:02,282 INFO ipc.Server (Server.java:authorizeConnection(2161)) - Connection from 10.0.0.212:36984 for protocol org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol is unauthorized for user dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:37:02,282 INFO ipc.Server (Server.java:doRead(949)) - Socket Reader #1 for port 8020: readAndProcess from client 10.0.0.212 threw exception [org.apache.hadoop.security.authorize.AuthorizationException: User dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-214-181-219.us-west-2.compute.amazonaws.com@HDP.LOCAL] 2017-09-27 08:37:06,974 INFO ipc.Server (Server.java:saslProcess(1504)) - Auth successful for dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:37:06,975 WARN authorize.ServiceAuthorizationManager (ServiceAuthorizationManager.java:authorize(119)) - Authorization failed for dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) for protocol=interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-212-145-161.us-west-2.compute.amazonaws.com@HDP.LOCAL 2017-09-27 08:37:06,975 INFO ipc.Server (Server.java:authorizeConnection(2161)) - Connection from 10.0.0.210:41524 for protocol org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol is unauthorized for user dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:37:06,975 INFO ipc.Server (Server.java:doRead(949)) - Socket Reader #1 for port 8020: readAndProcess from client 10.0.0.210 threw exception [org.apache.hadoop.security.authorize.AuthorizationException: User dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-212-145-161.us-west-2.compute.amazonaws.com@HDP.LOCAL] 2017-09-27 08:37:07,289 INFO ipc.Server (Server.java:saslProcess(1504)) - Auth successful for dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:37:07,290 WARN authorize.ServiceAuthorizationManager (ServiceAuthorizationManager.java:authorize(119)) - Authorization failed for dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) for protocol=interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-214-181-219.us-west-2.compute.amazonaws.com@HDP.LOCAL 2017-09-27 08:37:07,290 INFO ipc.Server (Server.java:authorizeConnection(2161)) - Connection from 10.0.0.212:46482 for protocol org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol is unauthorized for user dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:37:07,290 INFO ipc.Server (Server.java:doRead(949)) - Socket Reader #1 for port 8020: readAndProcess from client 10.0.0.212 threw exception [org.apache.hadoop.security.authorize.AuthorizationException: User dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-214-181-219.us-west-2.compute.amazonaws.com@HDP.LOCAL] 2017-09-27 08:37:10,674 WARN namenode.FSEditLog (JournalSet.java:selectInputStreams(280)) - Unable to determine input streams from QJM to [10.0.0.248:8485, 10.0.0.163:8485, 10.0.0.66:8485]. Skipping. org.apache.hadoop.hdfs.qjournal.client.QuorumException: Got too many exceptions to achieve quorum size 2/3. 1 successful responses: 10.0.0.163:8485: [[1,1533], [1534,2688], [2689,2732], [2733,2782], [2783,2826], [2827,2870], [2871,2920], [2921,2961], [2962,3005], [3006,3055], [3056,3099], [3100,3143], [3144,3193], [3194,3237], [3238,3281], [3282,3331], [3332,3375], [3376,3419], [3420,3469], [3470,3513], [3514,3557], [3558,3607], [3608,3651], [3652,3695], [3696,3745], [3746,3789], [3790,3833], [3834,3883], [3884,3927], [3928,3971], [3972,4021], [4022,4065], [4066,4109], [4110,4159], [4160,4203], [4204,4247], [4248,4297], [4298,4341], [4342,4379], [4380,4429], [4430,4473], [4474,4518], [4519,4529]] 2 exceptions thrown: 10.0.0.163:8485: [[1,1533], [1534,2688], [2689,2732], [2733,2782], [2783,2826], [2827,2870], [2871,2920], [2921,2961], [2962,3005], [3006,3055], [3056,3099], [3100,3143], [3144,3193], [3194,3237], [3238,3281], [3282,3331], [3332,3375], [3376,3419], [3420,3469], [3470,3513], [3514,3557], [3558,3607], [3608,3651], [3652,3695], [3696,3745], [3746,3789], [3790,3833], [3834,3883], [3884,3927], [3928,3971], [3972,4021], [4022,4065], [4066,4109], [4110,4159], [4160,4203], [4204,4247], [4248,4297], [4298,4341], [4342,4379], [4380,4429], [4430,4473], [4474,4518], [4519,4529]] 10.0.0.66:8485: User nn/standbynamenode-t5liwl46t1.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.qjournal.protocol.QJournalProtocol, expected client Kerberos principal is nn/ec2-34-208-160-33.us-west-2.compute.amazonaws.com@HDP.LOCAL 10.0.0.248:8485: User nn/standbynamenode-t5liwl46t1.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.qjournal.protocol.QJournalProtocol, expected client Kerberos principal is nn/ec2-34-208-160-33.us-west-2.compute.amazonaws.com@HDP.LOCAL at org.apache.hadoop.hdfs.qjournal.client.QuorumException.create(QuorumException.java:81) at org.apache.hadoop.hdfs.qjournal.client.QuorumCall.rethrowException(QuorumCall.java:223) at org.apache.hadoop.hdfs.qjournal.client.AsyncLoggerSet.waitForWriteQuorum(AsyncLoggerSet.java:142) at org.apache.hadoop.hdfs.qjournal.client.QuorumJournalManager.selectInputStreams(QuorumJournalManager.java:471) at org.apache.hadoop.hdfs.server.namenode.JournalSet.selectInputStreams(JournalSet.java:278) at org.apache.hadoop.hdfs.server.namenode.FSEditLog.selectInputStreams(FSEditLog.java:1520) at org.apache.hadoop.hdfs.server.namenode.FSEditLog.selectInputStreams(FSEditLog.java:1544) at org.apache.hadoop.hdfs.server.namenode.ha.EditLogTailer.doTailEdits(EditLogTailer.java:214) at org.apache.hadoop.hdfs.server.namenode.ha.EditLogTailer$EditLogTailerThread.doWork(EditLogTailer.java:331) at org.apache.hadoop.hdfs.server.namenode.ha.EditLogTailer$EditLogTailerThread.access$200(EditLogTailer.java:284) at org.apache.hadoop.hdfs.server.namenode.ha.EditLogTailer$EditLogTailerThread$1.run(EditLogTailer.java:301) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:360) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1704) at org.apache.hadoop.security.SecurityUtil.doAsLoginUserOrFatal(SecurityUtil.java:447) at org.apache.hadoop.hdfs.server.namenode.ha.EditLogTailer$EditLogTailerThread.run(EditLogTailer.java:297) 2017-09-27 08:45:12,996 INFO ipc.Server (Server.java:saslProcess(1504)) - Auth successful for dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:45:12,997 WARN authorize.ServiceAuthorizationManager (ServiceAuthorizationManager.java:authorize(119)) - Authorization failed for dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) for protocol=interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-212-145-161.us-west-2.compute.amazonaws.com@HDP.LOCAL 2017-09-27 08:45:12,997 INFO ipc.Server (Server.java:authorizeConnection(2161)) - Connection from 10.0.0.210:43917 for protocol org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol is unauthorized for user dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:45:12,997 INFO ipc.Server (Server.java:doRead(949)) - Socket Reader #1 for port 8020: readAndProcess from client 10.0.0.210 threw exception [org.apache.hadoop.security.authorize.AuthorizationException: User dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-212-145-161.us-west-2.compute.amazonaws.com@HDP.LOCAL] 2017-09-27 08:45:13,378 INFO ipc.Server (Server.java:saslProcess(1504)) - Auth successful for dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:45:13,380 WARN authorize.ServiceAuthorizationManager (ServiceAuthorizationManager.java:authorize(119)) - Authorization failed for dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) for protocol=interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-214-181-219.us-west-2.compute.amazonaws.com@HDP.LOCAL 2017-09-27 08:45:13,380 INFO ipc.Server (Server.java:authorizeConnection(2161)) - Connection from 10.0.0.212:44541 for protocol org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol is unauthorized for user dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:45:13,380 INFO ipc.Server (Server.java:doRead(949)) - Socket Reader #1 for port 8020: readAndProcess from client 10.0.0.212 threw exception [org.apache.hadoop.security.authorize.AuthorizationException: User dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-214-181-219.us-west-2.compute.amazonaws.com@HDP.LOCAL] 2017-09-27 08:45:18,002 INFO ipc.Server (Server.java:saslProcess(1504)) - Auth successful for dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:45:18,005 WARN authorize.ServiceAuthorizationManager (ServiceAuthorizationManager.java:authorize(119)) - Authorization failed for dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) for protocol=interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-212-145-161.us-west-2.compute.amazonaws.com@HDP.LOCAL 2017-09-27 08:45:18,005 INFO ipc.Server (Server.java:authorizeConnection(2161)) - Connection from 10.0.0.210:60410 for protocol org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol is unauthorized for user dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:45:18,005 INFO ipc.Server (Server.java:doRead(949)) - Socket Reader #1 for port 8020: readAndProcess from client 10.0.0.210 threw exception [org.apache.hadoop.security.authorize.AuthorizationException: User dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-212-145-161.us-west-2.compute.amazonaws.com@HDP.LOCAL] 2017-09-27 08:45:18,385 INFO ipc.Server (Server.java:saslProcess(1504)) - Auth successful for dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:45:18,386 WARN authorize.ServiceAuthorizationManager (ServiceAuthorizationManager.java:authorize(119)) - Authorization failed for dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) for protocol=interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-214-181-219.us-west-2.compute.amazonaws.com@HDP.LOCAL 2017-09-27 08:46:03,104 WARN authorize.ServiceAuthorizationManager (ServiceAuthorizationManager.java:authorize(119)) - Authorization failed for dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) for protocol=interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-212-145-161.us-west-2.compute.amazonaws.com@HDP.LOCAL 2017-09-27 08:46:03,104 INFO ipc.Server (Server.java:authorizeConnection(2161)) - Connection from 10.0.0.210:37206 for protocol org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol is unauthorized for user dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:46:03,104 INFO ipc.Server (Server.java:doRead(949)) - Socket Reader #1 for port 8020: readAndProcess from client 10.0.0.210 threw exception [org.apache.hadoop.security.authorize.AuthorizationException: User dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-212-145-161.us-west-2.compute.amazonaws.com@HDP.LOCAL] 2017-09-27 08:46:03,442 INFO ipc.Server (Server.java:saslProcess(1504)) - Auth successful for dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:46:03,443 WARN authorize.ServiceAuthorizationManager (ServiceAuthorizationManager.java:authorize(119)) - Authorization failed for dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) for protocol=interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-214-181-219.us-west-2.compute.amazonaws.com@HDP.LOCAL 2017-09-27 08:46:03,443 INFO ipc.Server (Server.java:authorizeConnection(2161)) - Connection from 10.0.0.212:43897 for protocol org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol is unauthorized for user dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:46:03,443 INFO ipc.Server (Server.java:doRead(949)) - Socket Reader #1 for port 8020: readAndProcess from client 10.0.0.212 threw exception [org.apache.hadoop.security.authorize.AuthorizationException: User dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-214-181-219.us-west-2.compute.amazonaws.com@HDP.LOCAL] 2017-09-27 08:46:08,109 INFO ipc.Server (Server.java:saslProcess(1504)) - Auth successful for dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:46:08,110 WARN authorize.ServiceAuthorizationManager (ServiceAuthorizationManager.java:authorize(119)) - Authorization failed for dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) for protocol=interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-212-145-161.us-west-2.compute.amazonaws.com@HDP.LOCAL 2017-09-27 08:46:08,110 INFO ipc.Server (Server.java:authorizeConnection(2161)) - Connection from 10.0.0.210:47608 for protocol org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol is unauthorized for user dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:46:08,110 INFO ipc.Server (Server.java:doRead(949)) - Socket Reader #1 for port 8020: readAndProcess from client 10.0.0.210 threw exception [org.apache.hadoop.security.authorize.AuthorizationException: User dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-212-145-161.us-west-2.compute.amazonaws.com@HDP.LOCAL] 2017-09-27 08:46:08,464 INFO ipc.Server (Server.java:saslProcess(1504)) - Auth successful for dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:46:08,466 WARN authorize.ServiceAuthorizationManager (ServiceAuthorizationManager.java:authorize(119)) - Authorization failed for dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) for protocol=interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-214-181-219.us-west-2.compute.amazonaws.com@HDP.LOCAL 2017-09-27 08:46:08,466 INFO ipc.Server (Server.java:authorizeConnection(2161)) - Connection from 10.0.0.212:50171 for protocol org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol is unauthorized for user dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:46:08,467 INFO ipc.Server (Server.java:doRead(949)) - Socket Reader #1 for port 8020: readAndProcess from client 10.0.0.212 threw exception [org.apache.hadoop.security.authorize.AuthorizationException: User dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-214-181-219.us-west-2.compute.amazonaws.com@HDP.LOCAL] 2017-09-27 08:46:10,974 WARN namenode.FSEditLog (JournalSet.java:selectInputStreams(280)) - Unable to determine input streams from QJM to [10.0.0.248:8485, 10.0.0.163:8485, 10.0.0.66:8485]. Skipping. org.apache.hadoop.hdfs.qjournal.client.QuorumException: Got too many exceptions to achieve quorum size 2/3. 1 successful responses: 10.0.0.163:8485: [[1,1533], [1534,2688], [2689,2732], [2733,2782], [2783,2826], [2827,2870], [2871,2920], [2921,2961], [2962,3005], [3006,3055], [3056,3099], [3100,3143], [3144,3193], [3194,3237], [3238,3281], [3282,3331], [3332,3375], [3376,3419], [3420,3469], [3470,3513], [3514,3557], [3558,3607], [3608,3651], [3652,3695], [3696,3745], [3746,3789], [3790,3833], [3834,3883], [3884,3927], [3928,3971], [3972,4021], [4022,4065], [4066,4109], [4110,4159], [4160,4203], [4204,4247], [4248,4297], [4298,4341], [4342,4379], [4380,4429], [4430,4473], [4474,4518], [4519,4529]] 2 exceptions thrown: 10.0.0.66:8485: User nn/standbynamenode-t5liwl46t1.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.qjournal.protocol.QJournalProtocol, expected client Kerberos principal is nn/ec2-34-208-160-33.us-west-2.compute.amazonaws.com@HDP.LOCAL 10.0.0.248:8485: User nn/standbynamenode-t5liwl46t1.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.qjournal.protocol.QJournalProtocol, expected client Kerberos principal is nn/ec2-34-208-160-33.us-west-2.compute.amazonaws.com@HDP.LOCAL at org.apache.hadoop.hdfs.qjournal.client.QuorumException.create(QuorumException.java:81) at org.apache.hadoop.hdfs.qjournal.client.QuorumCall.rethrowException(QuorumCall.java:223) at org.apache.hadoop.hdfs.qjournal.client.AsyncLoggerSet.waitForWriteQuorum(AsyncLoggerSet.java:142) at org.apache.hadoop.hdfs.qjournal.client.QuorumJournalManager.selectInputStreams(QuorumJournalManager.java:471) at org.apache.hadoop.hdfs.server.namenode.JournalSet.selectInputStreams(JournalSet.java:278) at org.apache.hadoop.hdfs.server.namenode.FSEditLog.selectInputStreams(FSEditLog.java:1520) at org.apache.hadoop.hdfs.server.namenode.FSEditLog.selectInputStreams(FSEditLog.java:1544) at org.apache.hadoop.hdfs.server.namenode.ha.EditLogTailer.doTailEdits(EditLogTailer.java:214) at org.apache.hadoop.hdfs.server.namenode.ha.EditLogTailer$EditLogTailerThread.doWork(EditLogTailer.java:331) at org.apache.hadoop.hdfs.server.namenode.ha.EditLogTailer$EditLogTailerThread.access$200(EditLogTailer.java:284) at org.apache.hadoop.hdfs.server.namenode.ha.EditLogTailer$EditLogTailerThread$1.run(EditLogTailer.java:301) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:360) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1704) at org.apache.hadoop.security.SecurityUtil.doAsLoginUserOrFatal(SecurityUtil.java:447) at org.apache.hadoop.hdfs.server.namenode.ha.EditLogTailer$EditLogTailerThread.run(EditLogTailer.java:297) 2017-09-27 08:46:13,114 INFO ipc.Server (Server.java:saslProcess(1504)) - Auth successful for dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:46:13,115 WARN authorize.ServiceAuthorizationManager (ServiceAuthorizationManager.java:authorize(119)) - Authorization failed for dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) for protocol=interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-212-145-161.us-west-2.compute.amazonaws.com@HDP.LOCAL 2017-09-27 08:46:13,116 INFO ipc.Server (Server.java:authorizeConnection(2161)) - Connection from 10.0.0.210:37666 for protocol org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol is unauthorized for user dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:46:13,116 INFO ipc.Server (Server.java:doRead(949)) - Socket Reader #1 for port 8020: readAndProcess from client 10.0.0.210 threw exception [org.apache.hadoop.security.authorize.AuthorizationException: User dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-212-145-161.us-west-2.compute.amazonaws.com@HDP.LOCAL] 2017-09-27 08:46:13,472 INFO ipc.Server (Server.java:saslProcess(1504)) - Auth successful for dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:46:13,474 WARN authorize.ServiceAuthorizationManager (ServiceAuthorizationManager.java:authorize(119)) - Authorization failed for dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) for protocol=interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-214-181-219.us-west-2.compute.amazonaws.com@HDP.LOCAL 2017-09-27 08:46:13,474 INFO ipc.Server (Server.java:authorizeConnection(2161)) - Connection from 10.0.0.212:38657 for protocol org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol is unauthorized for user dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:46:13,474 INFO ipc.Server (Server.java:doRead(949)) - Socket Reader #1 for port 8020: readAndProcess from client 10.0.0.212 threw exception [org.apache.hadoop.security.authorize.AuthorizationException: User dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-214-181-219.us-west-2.compute.amazonaws.com@HDP.LOCAL] 2017-09-27 08:46:18,121 INFO ipc.Server (Server.java:saslProcess(1504)) - Auth successful for dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:46:18,122 WARN authorize.ServiceAuthorizationManager (ServiceAuthorizationManager.java:authorize(119)) - Authorization failed for dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) for protocol=interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-212-145-161.us-west-2.compute.amazonaws.com@HDP.LOCAL 2017-09-27 08:46:18,122 INFO ipc.Server (Server.java:authorizeConnection(2161)) - Connection from 10.0.0.210:44342 for protocol org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol is unauthorized for user dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:46:18,122 INFO ipc.Server (Server.java:doRead(949)) - Socket Reader #1 for port 8020: readAndProcess from client 10.0.0.210 threw exception [org.apache.hadoop.security.authorize.AuthorizationException: User dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-212-145-161.us-west-2.compute.amazonaws.com@HDP.LOCAL] 2017-09-27 08:46:18,478 INFO ipc.Server (Server.java:saslProcess(1504)) - Auth successful for dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:47:03,175 WARN authorize.ServiceAuthorizationManager (ServiceAuthorizationManager.java:authorize(119)) - Authorization failed for dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) for protocol=interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-212-145-161.us-west-2.compute.amazonaws.com@HDP.LOCAL 2017-09-27 08:47:03,175 INFO ipc.Server (Server.java:authorizeConnection(2161)) - Connection from 10.0.0.210:38750 for protocol org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol is unauthorized for user dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:47:03,175 INFO ipc.Server (Server.java:doRead(949)) - Socket Reader #1 for port 8020: readAndProcess from client 10.0.0.210 threw exception [org.apache.hadoop.security.authorize.AuthorizationException: User dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-212-145-161.us-west-2.compute.amazonaws.com@HDP.LOCAL] 2017-09-27 08:47:03,537 INFO ipc.Server (Server.java:saslProcess(1504)) - Auth successful for dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:47:03,539 WARN authorize.ServiceAuthorizationManager (ServiceAuthorizationManager.java:authorize(119)) - Authorization failed for dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) for protocol=interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-214-181-219.us-west-2.compute.amazonaws.com@HDP.LOCAL 2017-09-27 08:47:03,539 INFO ipc.Server (Server.java:authorizeConnection(2161)) - Connection from 10.0.0.212:36432 for protocol org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol is unauthorized for user dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:47:03,539 INFO ipc.Server (Server.java:doRead(949)) - Socket Reader #1 for port 8020: readAndProcess from client 10.0.0.212 threw exception [org.apache.hadoop.security.authorize.AuthorizationException: User dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-214-181-219.us-west-2.compute.amazonaws.com@HDP.LOCAL] 2017-09-27 08:47:08,180 INFO ipc.Server (Server.java:saslProcess(1504)) - Auth successful for dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:47:08,180 WARN authorize.ServiceAuthorizationManager (ServiceAuthorizationManager.java:authorize(119)) - Authorization failed for dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) for protocol=interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-212-145-161.us-west-2.compute.amazonaws.com@HDP.LOCAL 2017-09-27 08:47:08,181 INFO ipc.Server (Server.java:authorizeConnection(2161)) - Connection from 10.0.0.210:56842 for protocol org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol is unauthorized for user dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:47:08,181 INFO ipc.Server (Server.java:doRead(949)) - Socket Reader #1 for port 8020: readAndProcess from client 10.0.0.210 threw exception [org.apache.hadoop.security.authorize.AuthorizationException: User dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-212-145-161.us-west-2.compute.amazonaws.com@HDP.LOCAL] 2017-09-27 08:47:08,544 INFO ipc.Server (Server.java:saslProcess(1504)) - Auth successful for dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:47:08,546 WARN authorize.ServiceAuthorizationManager (ServiceAuthorizationManager.java:authorize(119)) - Authorization failed for dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) for protocol=interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-214-181-219.us-west-2.compute.amazonaws.com@HDP.LOCAL 2017-09-27 08:47:08,546 INFO ipc.Server (Server.java:authorizeConnection(2161)) - Connection from 10.0.0.212:53570 for protocol org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol is unauthorized for user dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:47:08,546 INFO ipc.Server (Server.java:doRead(949)) - Socket Reader #1 for port 8020: readAndProcess from client 10.0.0.212 threw exception [org.apache.hadoop.security.authorize.AuthorizationException: User dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-214-181-219.us-west-2.compute.amazonaws.com@HDP.LOCAL] 2017-09-27 08:47:11,002 WARN namenode.FSEditLog (JournalSet.java:selectInputStreams(280)) - Unable to determine input streams from QJM to [10.0.0.248:8485, 10.0.0.163:8485, 10.0.0.66:8485]. Skipping. org.apache.hadoop.hdfs.qjournal.client.QuorumException: Got too many exceptions to achieve quorum size 2/3. 1 successful responses: 10.0.0.163:8485: [[1,1533], [1534,2688], [2689,2732], [2733,2782], [2783,2826], [2827,2870], [2871,2920], [2921,2961], [2962,3005], [3006,3055], [3056,3099], [3100,3143], [3144,3193], [3194,3237], [3238,3281], [3282,3331], [3332,3375], [3376,3419], [3420,3469], [3470,3513], [3514,3557], [3558,3607], [3608,3651], [3652,3695], [3696,3745], [3746,3789], [3790,3833], [3834,3883], [3884,3927], [3928,3971], [3972,4021], [4022,4065], [4066,4109], [4110,4159], [4160,4203], [4204,4247], [4248,4297], [4298,4341], [4342,4379], [4380,4429], [4430,4473], [4474,4518], [4519,4529]] 2 exceptions thrown: 10.0.0.66:8485: User nn/standbynamenode-t5liwl46t1.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.qjournal.protocol.QJournalProtocol, expected client Kerberos principal is nn/ec2-34-208-160-33.us-west-2.compute.amazonaws.com@HDP.LOCAL 10.0.0.248:8485: User nn/standbynamenode-t5liwl46t1.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.qjournal.protocol.QJournalProtocol, expected client Kerberos principal is nn/ec2-34-208-160-33.us-west-2.compute.amazonaws.com@HDP.LOCAL at org.apache.hadoop.hdfs.qjournal.client.QuorumException.create(QuorumException.java:81) at org.apache.hadoop.hdfs.qjournal.client.QuorumCall.rethrowException(QuorumCall.java:223) at org.apache.hadoop.hdfs.qjournal.client.AsyncLoggerSet.waitForWriteQuorum(AsyncLoggerSet.java:142) at org.apache.hadoop.hdfs.qjournal.client.QuorumJournalManager.selectInputStreams(QuorumJournalManager.java:471) at org.apache.hadoop.hdfs.server.namenode.JournalSet.selectInputStreams(JournalSet.java:278) at org.apache.hadoop.hdfs.server.namenode.FSEditLog.selectInputStreams(FSEditLog.java:1520) at org.apache.hadoop.hdfs.server.namenode.FSEditLog.selectInputStreams(FSEditLog.java:1544) at org.apache.hadoop.hdfs.server.namenode.ha.EditLogTailer.doTailEdits(EditLogTailer.java:214) at org.apache.hadoop.hdfs.server.namenode.ha.EditLogTailer$EditLogTailerThread.doWork(EditLogTailer.java:331) at org.apache.hadoop.hdfs.server.namenode.ha.EditLogTailer$EditLogTailerThread.access$200(EditLogTailer.java:284) at org.apache.hadoop.hdfs.server.namenode.ha.EditLogTailer$EditLogTailerThread$1.run(EditLogTailer.java:301) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:360) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1704) at org.apache.hadoop.security.SecurityUtil.doAsLoginUserOrFatal(SecurityUtil.java:447) at org.apache.hadoop.hdfs.server.namenode.ha.EditLogTailer$EditLogTailerThread.run(EditLogTailer.java:297) 2017-09-27 08:47:13,185 INFO ipc.Server (Server.java:saslProcess(1504)) - Auth successful for dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:47:13,186 WARN authorize.ServiceAuthorizationManager (ServiceAuthorizationManager.java:authorize(119)) - Authorization failed for dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) for protocol=interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-212-145-161.us-west-2.compute.amazonaws.com@HDP.LOCAL 2017-09-27 08:47:13,186 INFO ipc.Server (Server.java:authorizeConnection(2161)) - Connection from 10.0.0.210:44300 for protocol org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol is unauthorized for user dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:47:13,186 INFO ipc.Server (Server.java:doRead(949)) - Socket Reader #1 for port 8020: readAndProcess from client 10.0.0.210 threw exception [org.apache.hadoop.security.authorize.AuthorizationException: User dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-212-145-161.us-west-2.compute.amazonaws.com@HDP.LOCAL] 2017-09-27 08:47:13,550 INFO ipc.Server (Server.java:saslProcess(1504)) - Auth successful for dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:47:13,551 WARN authorize.ServiceAuthorizationManager (ServiceAuthorizationManager.java:authorize(119)) - Authorization failed for dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) for protocol=interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-214-181-219.us-west-2.compute.amazonaws.com@HDP.LOCAL 2017-09-27 08:47:13,552 INFO ipc.Server (Server.java:authorizeConnection(2161)) - Connection from 10.0.0.212:46448 for protocol org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol is unauthorized for user dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:47:13,552 INFO ipc.Server (Server.java:doRead(949)) - Socket Reader #1 for port 8020: readAndProcess from client 10.0.0.212 threw exception [org.apache.hadoop.security.authorize.AuthorizationException: User dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-214-181-219.us-west-2.compute.amazonaws.com@HDP.LOCAL] 2017-09-27 08:47:18,192 INFO ipc.Server (Server.java:saslProcess(1504)) - Auth successful for dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:47:18,193 WARN authorize.ServiceAuthorizationManager (ServiceAuthorizationManager.java:authorize(119)) - Authorization failed for dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) for protocol=interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-212-145-161.us-west-2.compute.amazonaws.com@HDP.LOCAL 2017-09-27 08:47:18,193 INFO ipc.Server (Server.java:authorizeConnection(2161)) - Connection from 10.0.0.210:33488 for protocol org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol is unauthorized for user dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:47:18,193 INFO ipc.Server (Server.java:doRead(949)) - Socket Reader #1 for port 8020: readAndProcess from client 10.0.0.210 threw exception [org.apache.hadoop.security.authorize.AuthorizationException: User dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-212-145-161.us-west-2.compute.amazonaws.com@HDP.LOCAL] 2017-09-27 08:47:18,557 INFO ipc.Server (Server.java:saslProcess(1504)) - Auth successful for dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:47:18,558 WARN authorize.ServiceAuthorizationManager (ServiceAuthorizationManager.java:authorize(119)) - Authorization failed for dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) for protocol=interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-214-181-219.us-west-2.compute.amazonaws.com@HDP.LOCAL 2017-09-27 08:47:18,558 INFO ipc.Server (Server.java:authorizeConnection(2161)) - Connection from 10.0.0.212:53631 for protocol org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol is unauthorized for user dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:47:18,558 INFO ipc.Server (Server.java:doRead(949)) - Socket Reader #1 for port 8020: readAndProcess from client 10.0.0.212 threw exception [org.apache.hadoop.security.authorize.AuthorizationException: User dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-214-181-219.us-west-2.compute.amazonaws.com@HDP.LOCAL] 2017-09-27 08:47:23,197 INFO ipc.Server (Server.java:saslProcess(1504)) - Auth successful for dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:47:58,288 WARN authorize.ServiceAuthorizationManager (ServiceAuthorizationManager.java:authorize(119)) - Authorization failed for dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) for protocol=interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-212-145-161.us-west-2.compute.amazonaws.com@HDP.LOCAL 2017-09-27 08:47:58,288 INFO ipc.Server (Server.java:authorizeConnection(2161)) - Connection from 10.0.0.210:33045 for protocol org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol is unauthorized for user dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:47:58,288 INFO ipc.Server (Server.java:doRead(949)) - Socket Reader #1 for port 8020: readAndProcess from client 10.0.0.210 threw exception [org.apache.hadoop.security.authorize.AuthorizationException: User dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-212-145-161.us-west-2.compute.amazonaws.com@HDP.LOCAL] 2017-09-27 08:47:58,605 INFO ipc.Server (Server.java:saslProcess(1504)) - Auth successful for dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:47:58,606 WARN authorize.ServiceAuthorizationManager (ServiceAuthorizationManager.java:authorize(119)) - Authorization failed for dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) for protocol=interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-214-181-219.us-west-2.compute.amazonaws.com@HDP.LOCAL 2017-09-27 08:47:58,606 INFO ipc.Server (Server.java:authorizeConnection(2161)) - Connection from 10.0.0.212:33844 for protocol org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol is unauthorized for user dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:47:58,606 INFO ipc.Server (Server.java:doRead(949)) - Socket Reader #1 for port 8020: readAndProcess from client 10.0.0.212 threw exception [org.apache.hadoop.security.authorize.AuthorizationException: User dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-214-181-219.us-west-2.compute.amazonaws.com@HDP.LOCAL] 2017-09-27 08:48:03,293 INFO ipc.Server (Server.java:saslProcess(1504)) - Auth successful for dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:48:03,294 WARN authorize.ServiceAuthorizationManager (ServiceAuthorizationManager.java:authorize(119)) - Authorization failed for dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) for protocol=interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-212-145-161.us-west-2.compute.amazonaws.com@HDP.LOCAL 2017-09-27 08:48:03,294 INFO ipc.Server (Server.java:authorizeConnection(2161)) - Connection from 10.0.0.210:56120 for protocol org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol is unauthorized for user dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:48:03,294 INFO ipc.Server (Server.java:doRead(949)) - Socket Reader #1 for port 8020: readAndProcess from client 10.0.0.210 threw exception [org.apache.hadoop.security.authorize.AuthorizationException: User dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-212-145-161.us-west-2.compute.amazonaws.com@HDP.LOCAL] 2017-09-27 08:48:03,612 INFO ipc.Server (Server.java:saslProcess(1504)) - Auth successful for dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:48:03,613 WARN authorize.ServiceAuthorizationManager (ServiceAuthorizationManager.java:authorize(119)) - Authorization failed for dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) for protocol=interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-214-181-219.us-west-2.compute.amazonaws.com@HDP.LOCAL 2017-09-27 08:48:03,613 INFO ipc.Server (Server.java:authorizeConnection(2161)) - Connection from 10.0.0.212:50125 for protocol org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol is unauthorized for user dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:48:03,613 INFO ipc.Server (Server.java:doRead(949)) - Socket Reader #1 for port 8020: readAndProcess from client 10.0.0.212 threw exception [org.apache.hadoop.security.authorize.AuthorizationException: User dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-214-181-219.us-west-2.compute.amazonaws.com@HDP.LOCAL] 2017-09-27 08:48:08,300 INFO ipc.Server (Server.java:saslProcess(1504)) - Auth successful for dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:48:08,300 WARN authorize.ServiceAuthorizationManager (ServiceAuthorizationManager.java:authorize(119)) - Authorization failed for dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) for protocol=interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-212-145-161.us-west-2.compute.amazonaws.com@HDP.LOCAL 2017-09-27 08:48:08,300 INFO ipc.Server (Server.java:authorizeConnection(2161)) - Connection from 10.0.0.210:46067 for protocol org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol is unauthorized for user dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:48:08,300 INFO ipc.Server (Server.java:doRead(949)) - Socket Reader #1 for port 8020: readAndProcess from client 10.0.0.210 threw exception [org.apache.hadoop.security.authorize.AuthorizationException: User dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-212-145-161.us-west-2.compute.amazonaws.com@HDP.LOCAL] 2017-09-27 08:48:08,617 INFO ipc.Server (Server.java:saslProcess(1504)) - Auth successful for dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:48:08,618 WARN authorize.ServiceAuthorizationManager (ServiceAuthorizationManager.java:authorize(119)) - Authorization failed for dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) for protocol=interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-214-181-219.us-west-2.compute.amazonaws.com@HDP.LOCAL 2017-09-27 08:48:08,618 INFO ipc.Server (Server.java:authorizeConnection(2161)) - Connection from 10.0.0.212:42214 for protocol org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol is unauthorized for user dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:48:08,618 INFO ipc.Server (Server.java:doRead(949)) - Socket Reader #1 for port 8020: readAndProcess from client 10.0.0.212 threw exception [org.apache.hadoop.security.authorize.AuthorizationException: User dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-214-181-219.us-west-2.compute.amazonaws.com@HDP.LOCAL] 2017-09-27 08:48:11,027 WARN namenode.FSEditLog (JournalSet.java:selectInputStreams(280)) - Unable to determine input streams from QJM to [10.0.0.248:8485, 10.0.0.163:8485, 10.0.0.66:8485]. Skipping. org.apache.hadoop.hdfs.qjournal.client.QuorumException: Got too many exceptions to achieve quorum size 2/3. 1 successful responses: 10.0.0.163:8485: [[1,1533], [1534,2688], [2689,2732], [2733,2782], [2783,2826], [2827,2870], [2871,2920], [2921,2961], [2962,3005], [3006,3055], [3056,3099], [3100,3143], [3144,3193], [3194,3237], [3238,3281], [3282,3331], [3332,3375], [3376,3419], [3420,3469], [3470,3513], [3514,3557], [3558,3607], [3608,3651], [3652,3695], [3696,3745], [3746,3789], [3790,3833], [3834,3883], [3884,3927], [3928,3971], [3972,4021], [4022,4065], [4066,4109], [4110,4159], [4160,4203], [4204,4247], [4248,4297], [4298,4341], [4342,4379], [4380,4429], [4430,4473], [4474,4518], [4519,4529]] 2 exceptions thrown: 10.0.0.66:8485: User nn/standbynamenode-t5liwl46t1.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.qjournal.protocol.QJournalProtocol, expected client Kerberos principal is nn/ec2-34-208-160-33.us-west-2.compute.amazonaws.com@HDP.LOCAL 10.0.0.248:8485: User nn/standbynamenode-t5liwl46t1.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.qjournal.protocol.QJournalProtocol, expected client Kerberos principal is nn/ec2-34-208-160-33.us-west-2.compute.amazonaws.com@HDP.LOCAL at org.apache.hadoop.hdfs.qjournal.client.QuorumException.create(QuorumException.java:81) at org.apache.hadoop.hdfs.qjournal.client.QuorumCall.rethrowException(QuorumCall.java:223) at org.apache.hadoop.hdfs.qjournal.client.AsyncLoggerSet.waitForWriteQuorum(AsyncLoggerSet.java:142) at org.apache.hadoop.hdfs.qjournal.client.QuorumJournalManager.selectInputStreams(QuorumJournalManager.java:471) at org.apache.hadoop.hdfs.server.namenode.JournalSet.selectInputStreams(JournalSet.java:278) at org.apache.hadoop.hdfs.server.namenode.FSEditLog.selectInputStreams(FSEditLog.java:1520) at org.apache.hadoop.hdfs.server.namenode.FSEditLog.selectInputStreams(FSEditLog.java:1544) at org.apache.hadoop.hdfs.server.namenode.ha.EditLogTailer.doTailEdits(EditLogTailer.java:214) at org.apache.hadoop.hdfs.server.namenode.ha.EditLogTailer$EditLogTailerThread.doWork(EditLogTailer.java:331) at org.apache.hadoop.hdfs.server.namenode.ha.EditLogTailer$EditLogTailerThread.access$200(EditLogTailer.java:284) at org.apache.hadoop.hdfs.server.namenode.ha.EditLogTailer$EditLogTailerThread$1.run(EditLogTailer.java:301) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:360) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1704) at org.apache.hadoop.security.SecurityUtil.doAsLoginUserOrFatal(SecurityUtil.java:447) at org.apache.hadoop.hdfs.server.namenode.ha.EditLogTailer$EditLogTailerThread.run(EditLogTailer.java:297) 2017-09-27 08:48:13,305 INFO ipc.Server (Server.java:saslProcess(1504)) - Auth successful for dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:48:13,306 WARN authorize.ServiceAuthorizationManager (ServiceAuthorizationManager.java:authorize(119)) - Authorization failed for dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) for protocol=interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-212-145-161.us-west-2.compute.amazonaws.com@HDP.LOCAL 2017-09-27 08:48:13,306 INFO ipc.Server (Server.java:authorizeConnection(2161)) - Connection from 10.0.0.210:43441 for protocol org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol is unauthorized for user dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:48:13,306 INFO ipc.Server (Server.java:doRead(949)) - Socket Reader #1 for port 8020: readAndProcess from client 10.0.0.210 threw exception [org.apache.hadoop.security.authorize.AuthorizationException: User dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-212-145-161.us-west-2.compute.amazonaws.com@HDP.LOCAL] 2017-09-27 08:48:13,622 INFO ipc.Server (Server.java:saslProcess(1504)) - Auth successful for dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:48:13,624 WARN authorize.ServiceAuthorizationManager (ServiceAuthorizationManager.java:authorize(119)) - Authorization failed for dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) for protocol=interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-214-181-219.us-west-2.compute.amazonaws.com@HDP.LOCAL 2017-09-27 08:48:13,624 INFO ipc.Server (Server.java:authorizeConnection(2161)) - Connection from 10.0.0.212:43134 for protocol org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol is unauthorized for user dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:48:13,624 INFO ipc.Server (Server.java:doRead(949)) - Socket Reader #1 for port 8020: readAndProcess from client 10.0.0.212 threw exception [org.apache.hadoop.security.authorize.AuthorizationException: User dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-214-181-219.us-west-2.compute.amazonaws.com@HDP.LOCAL] 2017-09-27 08:48:18,310 INFO ipc.Server (Server.java:saslProcess(1504)) - Auth successful for dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:48:18,311 WARN authorize.ServiceAuthorizationManager (ServiceAuthorizationManager.java:authorize(119)) - Authorization failed for dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) for protocol=interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-212-145-161.us-west-2.compute.amazonaws.com@HDP.LOCAL 2017-09-27 08:48:18,311 INFO ipc.Server (Server.java:authorizeConnection(2161)) - Connection from 10.0.0.210:39103 for protocol org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol is unauthorized for user dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:48:18,311 INFO ipc.Server (Server.java:doRead(949)) - Socket Reader #1 for port 8020: readAndProcess from client 10.0.0.210 threw exception [org.apache.hadoop.security.authorize.AuthorizationException: User dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-212-145-161.us-west-2.compute.amazonaws.com@HDP.LOCAL] 2017-09-27 08:48:18,629 INFO ipc.Server (Server.java:saslProcess(1504)) - Auth successful for dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:48:18,630 WARN authorize.ServiceAuthorizationManager (ServiceAuthorizationManager.java:authorize(119)) - Authorization failed for dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) for protocol=interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-214-181-219.us-west-2.compute.amazonaws.com@HDP.LOCAL 2017-09-27 08:48:18,630 INFO ipc.Server (Server.java:authorizeConnection(2161)) - Connection from 10.0.0.212:37968 for protocol org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol is unauthorized for user dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:48:18,630 INFO ipc.Server (Server.java:doRead(949)) - Socket Reader #1 for port 8020: readAndProcess from client 10.0.0.212 threw exception [org.apache.hadoop.security.authorize.AuthorizationException: User dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-214-181-219.us-west-2.compute.amazonaws.com@HDP.LOCAL] 2017-09-27 08:48:23,319 INFO ipc.Server (Server.java:saslProcess(1504)) - Auth successful for dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:48:23,320 WARN authorize.ServiceAuthorizationManager (ServiceAuthorizationManager.java:authorize(119)) - Authorization failed for dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) for protocol=interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-212-145-161.us-west-2.compute.amazonaws.com@HDP.LOCAL 2017-09-27 08:48:23,320 INFO ipc.Server (Server.java:authorizeConnection(2161)) - Connection from 10.0.0.210:59168 for protocol org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol is unauthorized for user dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:48:23,320 INFO ipc.Server (Server.java:doRead(949)) - Socket Reader #1 for port 8020: readAndProcess from client 10.0.0.210 threw exception [org.apache.hadoop.security.authorize.AuthorizationException: User dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-212-145-161.us-west-2.compute.amazonaws.com@HDP.LOCAL] 2017-09-27 08:48:23,636 INFO ipc.Server (Server.java:saslProcess(1504)) - Auth successful for dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:48:23,637 WARN authorize.ServiceAuthorizationManager (ServiceAuthorizationManager.java:authorize(119)) - Authorization failed for dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) for protocol=interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-214-181-219.us-west-2.compute.amazonaws.com@HDP.LOCAL 2017-09-27 08:48:23,637 INFO ipc.Server (Server.java:authorizeConnection(2161)) - Connection from 10.0.0.212:36831 for protocol org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol is unauthorized for user dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:48:23,637 INFO ipc.Server (Server.java:doRead(949)) - Socket Reader #1 for port 8020: readAndProcess from client 10.0.0.212 threw exception [org.apache.hadoop.security.authorize.AuthorizationException: User dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-214-181-219.us-west-2.compute.amazonaws.com@HDP.LOCAL] 2017-09-27 08:48:28,325 INFO ipc.Server (Server.java:saslProcess(1504)) - Auth successful for dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:48:28,326 WARN authorize.ServiceAuthorizationManager (ServiceAuthorizationManager.java:authorize(119)) - Authorization failed for dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) for protocol=interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-212-145-161.us-west-2.compute.amazonaws.com@HDP.LOCAL 2017-09-27 08:48:28,326 INFO ipc.Server (Server.java:authorizeConnection(2161)) - Connection from 10.0.0.210:47516 for protocol org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol is unauthorized for user dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:48:28,326 INFO ipc.Server (Server.java:doRead(949)) - Socket Reader #1 for port 8020: readAndProcess from client 10.0.0.210 threw exception [org.apache.hadoop.security.authorize.AuthorizationException: User dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-212-145-161.us-west-2.compute.amazonaws.com@HDP.LOCAL] 2017-09-27 08:48:28,641 INFO ipc.Server (Server.java:saslProcess(1504)) - Auth successful for dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:48:28,642 WARN authorize.ServiceAuthorizationManager (ServiceAuthorizationManager.java:authorize(119)) - Authorization failed for dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) for protocol=interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-214-181-219.us-west-2.compute.amazonaws.com@HDP.LOCAL 2017-09-27 08:48:28,642 INFO ipc.Server (Server.java:authorizeConnection(2161)) - Connection from 10.0.0.212:55668 for protocol org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol is unauthorized for user dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:48:28,642 INFO ipc.Server (Server.java:doRead(949)) - Socket Reader #1 for port 8020: readAndProcess from client 10.0.0.212 threw exception [org.apache.hadoop.security.authorize.AuthorizationException: User dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-214-181-219.us-west-2.compute.amazonaws.com@HDP.LOCAL] 2017-09-27 08:48:33,331 INFO ipc.Server (Server.java:saslProcess(1504)) - Auth successful for dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:48:33,332 WARN authorize.ServiceAuthorizationManager (ServiceAuthorizationManager.java:authorize(119)) - Authorization failed for dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) for protocol=interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-212-145-161.us-west-2.compute.amazonaws.com@HDP.LOCAL 2017-09-27 08:48:33,332 INFO ipc.Server (Server.java:authorizeConnection(2161)) - Connection from 10.0.0.210:43157 for protocol org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol is unauthorized for user dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:48:33,332 INFO ipc.Server (Server.java:doRead(949)) - Socket Reader #1 for port 8020: readAndProcess from client 10.0.0.210 threw exception [org.apache.hadoop.security.authorize.AuthorizationException: User dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-212-145-161.us-west-2.compute.amazonaws.com@HDP.LOCAL] 2017-09-27 08:48:33,647 INFO ipc.Server (Server.java:saslProcess(1504)) - Auth successful for dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:48:33,648 WARN authorize.ServiceAuthorizationManager (ServiceAuthorizationManager.java:authorize(119)) - Authorization failed for dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) for protocol=interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-214-181-219.us-west-2.compute.amazonaws.com@HDP.LOCAL 2017-09-27 08:48:33,648 INFO ipc.Server (Server.java:authorizeConnection(2161)) - Connection from 10.0.0.212:48791 for protocol org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol is unauthorized for user dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:48:33,648 INFO ipc.Server (Server.java:doRead(949)) - Socket Reader #1 for port 8020: readAndProcess from client 10.0.0.212 threw exception [org.apache.hadoop.security.authorize.AuthorizationException: User dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-214-181-219.us-west-2.compute.amazonaws.com@HDP.LOCAL] 2017-09-27 08:48:58,364 WARN authorize.ServiceAuthorizationManager (ServiceAuthorizationManager.java:authorize(119)) - Authorization failed for dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) for protocol=interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-212-145-161.us-west-2.compute.amazonaws.com@HDP.LOCAL 2017-09-27 08:48:58,364 INFO ipc.Server (Server.java:authorizeConnection(2161)) - Connection from 10.0.0.210:35716 for protocol org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol is unauthorized for user dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:48:58,364 INFO ipc.Server (Server.java:doRead(949)) - Socket Reader #1 for port 8020: readAndProcess from client 10.0.0.210 threw exception [org.apache.hadoop.security.authorize.AuthorizationException: User dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-212-145-161.us-west-2.compute.amazonaws.com@HDP.LOCAL] 2017-09-27 08:48:58,707 INFO ipc.Server (Server.java:saslProcess(1504)) - Auth successful for dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:48:58,708 WARN authorize.ServiceAuthorizationManager (ServiceAuthorizationManager.java:authorize(119)) - Authorization failed for dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) for protocol=interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-214-181-219.us-west-2.compute.amazonaws.com@HDP.LOCAL 2017-09-27 08:48:58,708 INFO ipc.Server (Server.java:authorizeConnection(2161)) - Connection from 10.0.0.212:39253 for protocol org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol is unauthorized for user dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:48:58,708 INFO ipc.Server (Server.java:doRead(949)) - Socket Reader #1 for port 8020: readAndProcess from client 10.0.0.212 threw exception [org.apache.hadoop.security.authorize.AuthorizationException: User dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-214-181-219.us-west-2.compute.amazonaws.com@HDP.LOCAL] 2017-09-27 08:49:03,369 INFO ipc.Server (Server.java:saslProcess(1504)) - Auth successful for dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:49:03,370 WARN authorize.ServiceAuthorizationManager (ServiceAuthorizationManager.java:authorize(119)) - Authorization failed for dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) for protocol=interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-212-145-161.us-west-2.compute.amazonaws.com@HDP.LOCAL 2017-09-27 08:49:03,370 INFO ipc.Server (Server.java:authorizeConnection(2161)) - Connection from 10.0.0.210:39542 for protocol org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol is unauthorized for user dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:49:03,370 INFO ipc.Server (Server.java:doRead(949)) - Socket Reader #1 for port 8020: readAndProcess from client 10.0.0.210 threw exception [org.apache.hadoop.security.authorize.AuthorizationException: User dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-212-145-161.us-west-2.compute.amazonaws.com@HDP.LOCAL] 2017-09-27 08:49:03,713 INFO ipc.Server (Server.java:saslProcess(1504)) - Auth successful for dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:49:03,714 WARN authorize.ServiceAuthorizationManager (ServiceAuthorizationManager.java:authorize(119)) - Authorization failed for dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) for protocol=interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-214-181-219.us-west-2.compute.amazonaws.com@HDP.LOCAL 2017-09-27 08:49:03,714 INFO ipc.Server (Server.java:authorizeConnection(2161)) - Connection from 10.0.0.212:43773 for protocol org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol is unauthorized for user dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:49:03,714 INFO ipc.Server (Server.java:doRead(949)) - Socket Reader #1 for port 8020: readAndProcess from client 10.0.0.212 threw exception [org.apache.hadoop.security.authorize.AuthorizationException: User dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-214-181-219.us-west-2.compute.amazonaws.com@HDP.LOCAL] 2017-09-27 08:49:08,375 INFO ipc.Server (Server.java:saslProcess(1504)) - Auth successful for dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:49:08,376 WARN authorize.ServiceAuthorizationManager (ServiceAuthorizationManager.java:authorize(119)) - Authorization failed for dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) for protocol=interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-212-145-161.us-west-2.compute.amazonaws.com@HDP.LOCAL 2017-09-27 08:49:08,376 INFO ipc.Server (Server.java:authorizeConnection(2161)) - Connection from 10.0.0.210:38541 for protocol org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol is unauthorized for user dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:49:08,376 INFO ipc.Server (Server.java:doRead(949)) - Socket Reader #1 for port 8020: readAndProcess from client 10.0.0.210 threw exception [org.apache.hadoop.security.authorize.AuthorizationException: User dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-212-145-161.us-west-2.compute.amazonaws.com@HDP.LOCAL] 2017-09-27 08:49:08,719 INFO ipc.Server (Server.java:saslProcess(1504)) - Auth successful for dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:49:08,720 WARN authorize.ServiceAuthorizationManager (ServiceAuthorizationManager.java:authorize(119)) - Authorization failed for dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) for protocol=interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-214-181-219.us-west-2.compute.amazonaws.com@HDP.LOCAL 2017-09-27 08:49:08,720 INFO ipc.Server (Server.java:authorizeConnection(2161)) - Connection from 10.0.0.212:55155 for protocol org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol is unauthorized for user dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:49:08,720 INFO ipc.Server (Server.java:doRead(949)) - Socket Reader #1 for port 8020: readAndProcess from client 10.0.0.212 threw exception [org.apache.hadoop.security.authorize.AuthorizationException: User dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-214-181-219.us-west-2.compute.amazonaws.com@HDP.LOCAL] 2017-09-27 08:49:11,054 WARN namenode.FSEditLog (JournalSet.java:selectInputStreams(280)) - Unable to determine input streams from QJM to [10.0.0.248:8485, 10.0.0.163:8485, 10.0.0.66:8485]. Skipping. org.apache.hadoop.hdfs.qjournal.client.QuorumException: Got too many exceptions to achieve quorum size 2/3. 1 successful responses: 10.0.0.163:8485: [[1,1533], [1534,2688], [2689,2732], [2733,2782], [2783,2826], [2827,2870], [2871,2920], [2921,2961], [2962,3005], [3006,3055], [3056,3099], [3100,3143], [3144,3193], [3194,3237], [3238,3281], [3282,3331], [3332,3375], [3376,3419], [3420,3469], [3470,3513], [3514,3557], [3558,3607], [3608,3651], [3652,3695], [3696,3745], [3746,3789], [3790,3833], [3834,3883], [3884,3927], [3928,3971], [3972,4021], [4022,4065], [4066,4109], [4110,4159], [4160,4203], [4204,4247], [4248,4297], [4298,4341], [4342,4379], [4380,4429], [4430,4473], [4474,4518], [4519,4529]] 2 exceptions thrown: 10.0.0.66:8485: User nn/standbynamenode-t5liwl46t1.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.qjournal.protocol.QJournalProtocol, expected client Kerberos principal is nn/ec2-34-208-160-33.us-west-2.compute.amazonaws.com@HDP.LOCAL 10.0.0.248:8485: User nn/standbynamenode-t5liwl46t1.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.qjournal.protocol.QJournalProtocol, expected client Kerberos principal is nn/ec2-34-208-160-33.us-west-2.compute.amazonaws.com@HDP.LOCAL at org.apache.hadoop.hdfs.qjournal.client.QuorumException.create(QuorumException.java:81) at org.apache.hadoop.hdfs.qjournal.client.QuorumCall.rethrowException(QuorumCall.java:223) at org.apache.hadoop.hdfs.qjournal.client.AsyncLoggerSet.waitForWriteQuorum(AsyncLoggerSet.java:142) at org.apache.hadoop.hdfs.qjournal.client.QuorumJournalManager.selectInputStreams(QuorumJournalManager.java:471) at org.apache.hadoop.hdfs.server.namenode.JournalSet.selectInputStreams(JournalSet.java:278) at org.apache.hadoop.hdfs.server.namenode.FSEditLog.selectInputStreams(FSEditLog.java:1520) at org.apache.hadoop.hdfs.server.namenode.FSEditLog.selectInputStreams(FSEditLog.java:1544) at org.apache.hadoop.hdfs.server.namenode.ha.EditLogTailer.doTailEdits(EditLogTailer.java:214) at org.apache.hadoop.hdfs.server.namenode.ha.EditLogTailer$EditLogTailerThread.doWork(EditLogTailer.java:331) at org.apache.hadoop.hdfs.server.namenode.ha.EditLogTailer$EditLogTailerThread.access$200(EditLogTailer.java:284) at org.apache.hadoop.hdfs.server.namenode.ha.EditLogTailer$EditLogTailerThread$1.run(EditLogTailer.java:301) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:360) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1704) at org.apache.hadoop.security.SecurityUtil.doAsLoginUserOrFatal(SecurityUtil.java:447) at org.apache.hadoop.hdfs.server.namenode.ha.EditLogTailer$EditLogTailerThread.run(EditLogTailer.java:297) 2017-09-27 08:49:13,380 INFO ipc.Server (Server.java:saslProcess(1504)) - Auth successful for dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:49:13,381 WARN authorize.ServiceAuthorizationManager (ServiceAuthorizationManager.java:authorize(119)) - Authorization failed for dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) for protocol=interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-212-145-161.us-west-2.compute.amazonaws.com@HDP.LOCAL 2017-09-27 08:49:13,381 INFO ipc.Server (Server.java:authorizeConnection(2161)) - Connection from 10.0.0.210:47371 for protocol org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol is unauthorized for user dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:49:13,381 INFO ipc.Server (Server.java:doRead(949)) - Socket Reader #1 for port 8020: readAndProcess from client 10.0.0.210 threw exception [org.apache.hadoop.security.authorize.AuthorizationException: User dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-212-145-161.us-west-2.compute.amazonaws.com@HDP.LOCAL] 2017-09-27 08:49:13,725 INFO ipc.Server (Server.java:saslProcess(1504)) - Auth successful for dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:49:13,726 WARN authorize.ServiceAuthorizationManager (ServiceAuthorizationManager.java:authorize(119)) - Authorization failed for dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) for protocol=interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-214-181-219.us-west-2.compute.amazonaws.com@HDP.LOCAL 2017-09-27 08:49:13,726 INFO ipc.Server (Server.java:authorizeConnection(2161)) - Connection from 10.0.0.212:53063 for protocol org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol is unauthorized for user dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:49:13,726 INFO ipc.Server (Server.java:doRead(949)) - Socket Reader #1 for port 8020: readAndProcess from client 10.0.0.212 threw exception [org.apache.hadoop.security.authorize.AuthorizationException: User dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-214-181-219.us-west-2.compute.amazonaws.com@HDP.LOCAL] 2017-09-27 08:49:18,386 INFO ipc.Server (Server.java:saslProcess(1504)) - Auth successful for dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:49:18,387 WARN authorize.ServiceAuthorizationManager (ServiceAuthorizationManager.java:authorize(119)) - Authorization failed for dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) for protocol=interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-212-145-161.us-west-2.compute.amazonaws.com@HDP.LOCAL 2017-09-27 08:49:18,387 INFO ipc.Server (Server.java:authorizeConnection(2161)) - Connection from 10.0.0.210:47503 for protocol org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol is unauthorized for user dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:49:18,387 INFO ipc.Server (Server.java:doRead(949)) - Socket Reader #1 for port 8020: readAndProcess from client 10.0.0.210 threw exception [org.apache.hadoop.security.authorize.AuthorizationException: User dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-212-145-161.us-west-2.compute.amazonaws.com@HDP.LOCAL] 2017-09-27 08:49:18,730 INFO ipc.Server (Server.java:saslProcess(1504)) - Auth successful for dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:49:18,731 WARN authorize.ServiceAuthorizationManager (ServiceAuthorizationManager.java:authorize(119)) - Authorization failed for dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) for protocol=interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-214-181-219.us-west-2.compute.amazonaws.com@HDP.LOCAL 2017-09-27 08:49:18,731 INFO ipc.Server (Server.java:authorizeConnection(2161)) - Connection from 10.0.0.212:34918 for protocol org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol is unauthorized for user dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:49:18,731 INFO ipc.Server (Server.java:doRead(949)) - Socket Reader #1 for port 8020: readAndProcess from client 10.0.0.212 threw exception [org.apache.hadoop.security.authorize.AuthorizationException: User dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-214-181-219.us-west-2.compute.amazonaws.com@HDP.LOCAL] 2017-09-27 08:49:23,391 INFO ipc.Server (Server.java:saslProcess(1504)) - Auth successful for dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:49:23,392 WARN authorize.ServiceAuthorizationManager (ServiceAuthorizationManager.java:authorize(119)) - Authorization failed for dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) for protocol=interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-212-145-161.us-west-2.compute.amazonaws.com@HDP.LOCAL 2017-09-27 08:49:23,392 INFO ipc.Server (Server.java:authorizeConnection(2161)) - Connection from 10.0.0.210:59964 for protocol org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol is unauthorized for user dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:49:23,392 INFO ipc.Server (Server.java:doRead(949)) - Socket Reader #1 for port 8020: readAndProcess from client 10.0.0.210 threw exception [org.apache.hadoop.security.authorize.AuthorizationException: User dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-212-145-161.us-west-2.compute.amazonaws.com@HDP.LOCAL] 2017-09-27 08:49:23,736 INFO ipc.Server (Server.java:saslProcess(1504)) - Auth successful for dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:49:23,737 WARN authorize.ServiceAuthorizationManager (ServiceAuthorizationManager.java:authorize(119)) - Authorization failed for dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) for protocol=interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-214-181-219.us-west-2.compute.amazonaws.com@HDP.LOCAL 2017-09-27 08:49:23,737 INFO ipc.Server (Server.java:authorizeConnection(2161)) - Connection from 10.0.0.212:44633 for protocol org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol is unauthorized for user dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:49:23,737 INFO ipc.Server (Server.java:doRead(949)) - Socket Reader #1 for port 8020: readAndProcess from client 10.0.0.212 threw exception [org.apache.hadoop.security.authorize.AuthorizationException: User dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-214-181-219.us-west-2.compute.amazonaws.com@HDP.LOCAL] 2017-09-27 08:49:28,397 INFO ipc.Server (Server.java:saslProcess(1504)) - Auth successful for dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:49:28,398 WARN authorize.ServiceAuthorizationManager (ServiceAuthorizationManager.java:authorize(119)) - Authorization failed for dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) for protocol=interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-212-145-161.us-west-2.compute.amazonaws.com@HDP.LOCAL 2017-09-27 08:49:28,399 INFO ipc.Server (Server.java:authorizeConnection(2161)) - Connection from 10.0.0.210:34021 for protocol org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol is unauthorized for user dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:49:28,399 INFO ipc.Server (Server.java:doRead(949)) - Socket Reader #1 for port 8020: readAndProcess from client 10.0.0.210 threw exception [org.apache.hadoop.security.authorize.AuthorizationException: User dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-212-145-161.us-west-2.compute.amazonaws.com@HDP.LOCAL] 2017-09-27 08:49:28,741 INFO ipc.Server (Server.java:saslProcess(1504)) - Auth successful for dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:49:28,742 WARN authorize.ServiceAuthorizationManager (ServiceAuthorizationManager.java:authorize(119)) - Authorization failed for dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) for protocol=interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-214-181-219.us-west-2.compute.amazonaws.com@HDP.LOCAL 2017-09-27 08:49:28,742 INFO ipc.Server (Server.java:authorizeConnection(2161)) - Connection from 10.0.0.212:46804 for protocol org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol is unauthorized for user dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:49:28,742 INFO ipc.Server (Server.java:doRead(949)) - Socket Reader #1 for port 8020: readAndProcess from client 10.0.0.212 threw exception [org.apache.hadoop.security.authorize.AuthorizationException: User dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-214-181-219.us-west-2.compute.amazonaws.com@HDP.LOCAL] 2017-09-27 08:49:33,403 INFO ipc.Server (Server.java:saslProcess(1504)) - Auth successful for dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:49:33,403 WARN authorize.ServiceAuthorizationManager (ServiceAuthorizationManager.java:authorize(119)) - Authorization failed for dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) for protocol=interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-212-145-161.us-west-2.compute.amazonaws.com@HDP.LOCAL 2017-09-27 08:49:33,404 INFO ipc.Server (Server.java:authorizeConnection(2161)) - Connection from 10.0.0.210:48955 for protocol org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol is unauthorized for user dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:49:33,404 INFO ipc.Server (Server.java:doRead(949)) - Socket Reader #1 for port 8020: readAndProcess from client 10.0.0.210 threw exception [org.apache.hadoop.security.authorize.AuthorizationException: User dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-212-145-161.us-west-2.compute.amazonaws.com@HDP.LOCAL] 2017-09-27 08:49:33,747 INFO ipc.Server (Server.java:saslProcess(1504)) - Auth successful for dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:49:33,748 WARN authorize.ServiceAuthorizationManager (ServiceAuthorizationManager.java:authorize(119)) - Authorization failed for dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) for protocol=interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-214-181-219.us-west-2.compute.amazonaws.com@HDP.LOCAL 2017-09-27 08:49:33,748 INFO ipc.Server (Server.java:authorizeConnection(2161)) - Connection from 10.0.0.212:41998 for protocol org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol is unauthorized for user dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:49:33,748 INFO ipc.Server (Server.java:doRead(949)) - Socket Reader #1 for port 8020: readAndProcess from client 10.0.0.212 threw exception [org.apache.hadoop.security.authorize.AuthorizationException: User dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-214-181-219.us-west-2.compute.amazonaws.com@HDP.LOCAL] 2017-09-27 08:49:38,409 INFO ipc.Server (Server.java:saslProcess(1504)) - Auth successful for dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:49:38,410 WARN authorize.ServiceAuthorizationManager (ServiceAuthorizationManager.java:authorize(119)) - Authorization failed for dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) for protocol=interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-212-145-161.us-west-2.compute.amazonaws.com@HDP.LOCAL 2017-09-27 08:49:38,410 INFO ipc.Server (Server.java:authorizeConnection(2161)) - Connection from 10.0.0.210:46399 for protocol org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol is unauthorized for user dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:49:38,410 INFO ipc.Server (Server.java:doRead(949)) - Socket Reader #1 for port 8020: readAndProcess from client 10.0.0.210 threw exception [org.apache.hadoop.security.authorize.AuthorizationException: User dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-212-145-161.us-west-2.compute.amazonaws.com@HDP.LOCAL] 2017-09-27 08:49:38,754 INFO ipc.Server (Server.java:saslProcess(1504)) - Auth successful for dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:49:38,755 WARN authorize.ServiceAuthorizationManager (ServiceAuthorizationManager.java:authorize(119)) - Authorization failed for dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) for protocol=interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-214-181-219.us-west-2.compute.amazonaws.com@HDP.LOCAL 2017-09-27 08:49:38,755 INFO ipc.Server (Server.java:authorizeConnection(2161)) - Connection from 10.0.0.212:33607 for protocol org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol is unauthorized for user dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:49:38,755 INFO ipc.Server (Server.java:doRead(949)) - Socket Reader #1 for port 8020: readAndProcess from client 10.0.0.212 threw exception [org.apache.hadoop.security.authorize.AuthorizationException: User dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-214-181-219.us-west-2.compute.amazonaws.com@HDP.LOCAL] 2017-09-27 08:49:43,415 INFO ipc.Server (Server.java:saslProcess(1504)) - Auth successful for dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:49:43,416 WARN authorize.ServiceAuthorizationManager (ServiceAuthorizationManager.java:authorize(119)) - Authorization failed for dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) for protocol=interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-212-145-161.us-west-2.compute.amazonaws.com@HDP.LOCAL 2017-09-27 08:49:43,416 INFO ipc.Server (Server.java:authorizeConnection(2161)) - Connection from 10.0.0.210:58720 for protocol org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol is unauthorized for user dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:49:43,416 INFO ipc.Server (Server.java:doRead(949)) - Socket Reader #1 for port 8020: readAndProcess from client 10.0.0.210 threw exception [org.apache.hadoop.security.authorize.AuthorizationException: User dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-212-145-161.us-west-2.compute.amazonaws.com@HDP.LOCAL] 2017-09-27 08:49:43,760 INFO ipc.Server (Server.java:saslProcess(1504)) - Auth successful for dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:49:43,761 WARN authorize.ServiceAuthorizationManager (ServiceAuthorizationManager.java:authorize(119)) - Authorization failed for dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) for protocol=interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-214-181-219.us-west-2.compute.amazonaws.com@HDP.LOCAL 2017-09-27 08:49:43,761 INFO ipc.Server (Server.java:authorizeConnection(2161)) - Connection from 10.0.0.212:36113 for protocol org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol is unauthorized for user dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:49:43,761 INFO ipc.Server (Server.java:doRead(949)) - Socket Reader #1 for port 8020: readAndProcess from client 10.0.0.212 threw exception [org.apache.hadoop.security.authorize.AuthorizationException: User dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-214-181-219.us-west-2.compute.amazonaws.com@HDP.LOCAL] 2017-09-27 08:49:48,421 INFO ipc.Server (Server.java:saslProcess(1504)) - Auth successful for dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:49:48,422 WARN authorize.ServiceAuthorizationManager (ServiceAuthorizationManager.java:authorize(119)) - Authorization failed for dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) for protocol=interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-212-145-161.us-west-2.compute.amazonaws.com@HDP.LOCAL 2017-09-27 08:49:48,422 INFO ipc.Server (Server.java:authorizeConnection(2161)) - Connection from 10.0.0.210:40540 for protocol org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol is unauthorized for user dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:49:48,422 INFO ipc.Server (Server.java:doRead(949)) - Socket Reader #1 for port 8020: readAndProcess from client 10.0.0.210 threw exception [org.apache.hadoop.security.authorize.AuthorizationException: User dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-212-145-161.us-west-2.compute.amazonaws.com@HDP.LOCAL] 2017-09-27 08:49:48,765 INFO ipc.Server (Server.java:saslProcess(1504)) - Auth successful for dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:49:48,766 WARN authorize.ServiceAuthorizationManager (ServiceAuthorizationManager.java:authorize(119)) - Authorization failed for dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) for protocol=interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-214-181-219.us-west-2.compute.amazonaws.com@HDP.LOCAL 2017-09-27 08:49:48,767 INFO ipc.Server (Server.java:authorizeConnection(2161)) - Connection from 10.0.0.212:58437 for protocol org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol is unauthorized for user dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:49:48,767 INFO ipc.Server (Server.java:doRead(949)) - Socket Reader #1 for port 8020: readAndProcess from client 10.0.0.212 threw exception [org.apache.hadoop.security.authorize.AuthorizationException: User dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-214-181-219.us-west-2.compute.amazonaws.com@HDP.LOCAL] 2017-09-27 08:49:53,427 INFO ipc.Server (Server.java:saslProcess(1504)) - Auth successful for dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:49:53,428 WARN authorize.ServiceAuthorizationManager (ServiceAuthorizationManager.java:authorize(119)) - Authorization failed for dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) for protocol=interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-212-145-161.us-west-2.compute.amazonaws.com@HDP.LOCAL 2017-09-27 08:49:53,428 INFO ipc.Server (Server.java:authorizeConnection(2161)) - Connection from 10.0.0.210:54712 for protocol org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol is unauthorized for user dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:49:53,428 INFO ipc.Server (Server.java:doRead(949)) - Socket Reader #1 for port 8020: readAndProcess from client 10.0.0.210 threw exception [org.apache.hadoop.security.authorize.AuthorizationException: User dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-212-145-161.us-west-2.compute.amazonaws.com@HDP.LOCAL] 2017-09-27 08:49:53,771 INFO ipc.Server (Server.java:saslProcess(1504)) - Auth successful for dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:49:53,772 WARN authorize.ServiceAuthorizationManager (ServiceAuthorizationManager.java:authorize(119)) - Authorization failed for dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) for protocol=interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-214-181-219.us-west-2.compute.amazonaws.com@HDP.LOCAL 2017-09-27 08:49:53,772 INFO ipc.Server (Server.java:authorizeConnection(2161)) - Connection from 10.0.0.212:50523 for protocol org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol is unauthorized for user dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:49:53,772 INFO ipc.Server (Server.java:doRead(949)) - Socket Reader #1 for port 8020: readAndProcess from client 10.0.0.212 threw exception [org.apache.hadoop.security.authorize.AuthorizationException: User dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-214-181-219.us-west-2.compute.amazonaws.com@HDP.LOCAL] 2017-09-27 08:49:58,433 INFO ipc.Server (Server.java:saslProcess(1504)) - Auth successful for dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:49:58,434 WARN authorize.ServiceAuthorizationManager (ServiceAuthorizationManager.java:authorize(119)) - Authorization failed for dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) for protocol=interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-212-145-161.us-west-2.compute.amazonaws.com@HDP.LOCAL 2017-09-27 08:49:58,434 INFO ipc.Server (Server.java:authorizeConnection(2161)) - Connection from 10.0.0.210:38307 for protocol org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol is unauthorized for user dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:49:58,434 INFO ipc.Server (Server.java:doRead(949)) - Socket Reader #1 for port 8020: readAndProcess from client 10.0.0.210 threw exception [org.apache.hadoop.security.authorize.AuthorizationException: User dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-212-145-161.us-west-2.compute.amazonaws.com@HDP.LOCAL] 2017-09-27 08:49:58,776 INFO ipc.Server (Server.java:saslProcess(1504)) - Auth successful for dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:49:58,777 WARN authorize.ServiceAuthorizationManager (ServiceAuthorizationManager.java:authorize(119)) - Authorization failed for dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) for protocol=interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-214-181-219.us-west-2.compute.amazonaws.com@HDP.LOCAL 2017-09-27 08:49:58,777 INFO ipc.Server (Server.java:authorizeConnection(2161)) - Connection from 10.0.0.212:60742 for protocol org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol is unauthorized for user dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:49:58,777 INFO ipc.Server (Server.java:doRead(949)) - Socket Reader #1 for port 8020: readAndProcess from client 10.0.0.212 threw exception [org.apache.hadoop.security.authorize.AuthorizationException: User dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-214-181-219.us-west-2.compute.amazonaws.com@HDP.LOCAL] 2017-09-27 08:50:03,438 INFO ipc.Server (Server.java:saslProcess(1504)) - Auth successful for dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:50:03,439 WARN authorize.ServiceAuthorizationManager (ServiceAuthorizationManager.java:authorize(119)) - Authorization failed for dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) for protocol=interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-212-145-161.us-west-2.compute.amazonaws.com@HDP.LOCAL 2017-09-27 08:50:03,439 INFO ipc.Server (Server.java:authorizeConnection(2161)) - Connection from 10.0.0.210:45670 for protocol org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol is unauthorized for user dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:50:03,439 INFO ipc.Server (Server.java:doRead(949)) - Socket Reader #1 for port 8020: readAndProcess from client 10.0.0.210 threw exception [org.apache.hadoop.security.authorize.AuthorizationException: User dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-212-145-161.us-west-2.compute.amazonaws.com@HDP.LOCAL] 2017-09-27 08:50:03,781 INFO ipc.Server (Server.java:saslProcess(1504)) - Auth successful for dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:50:03,782 WARN authorize.ServiceAuthorizationManager (ServiceAuthorizationManager.java:authorize(119)) - Authorization failed for dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) for protocol=interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-214-181-219.us-west-2.compute.amazonaws.com@HDP.LOCAL 2017-09-27 08:50:03,782 INFO ipc.Server (Server.java:authorizeConnection(2161)) - Connection from 10.0.0.212:39866 for protocol org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol is unauthorized for user dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:50:03,782 INFO ipc.Server (Server.java:doRead(949)) - Socket Reader #1 for port 8020: readAndProcess from client 10.0.0.212 threw exception [org.apache.hadoop.security.authorize.AuthorizationException: User dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-214-181-219.us-west-2.compute.amazonaws.com@HDP.LOCAL] 2017-09-27 08:50:08,444 INFO ipc.Server (Server.java:saslProcess(1504)) - Auth successful for dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:50:08,444 WARN authorize.ServiceAuthorizationManager (ServiceAuthorizationManager.java:authorize(119)) - Authorization failed for dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) for protocol=interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-212-145-161.us-west-2.compute.amazonaws.com@HDP.LOCAL 2017-09-27 08:50:08,444 INFO ipc.Server (Server.java:authorizeConnection(2161)) - Connection from 10.0.0.210:57843 for protocol org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol is unauthorized for user dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:50:08,444 INFO ipc.Server (Server.java:doRead(949)) - Socket Reader #1 for port 8020: readAndProcess from client 10.0.0.210 threw exception [org.apache.hadoop.security.authorize.AuthorizationException: User dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-212-145-161.us-west-2.compute.amazonaws.com@HDP.LOCAL] 2017-09-27 08:50:08,787 INFO ipc.Server (Server.java:saslProcess(1504)) - Auth successful for dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:50:08,787 WARN authorize.ServiceAuthorizationManager (ServiceAuthorizationManager.java:authorize(119)) - Authorization failed for dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) for protocol=interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-214-181-219.us-west-2.compute.amazonaws.com@HDP.LOCAL 2017-09-27 08:50:08,788 INFO ipc.Server (Server.java:authorizeConnection(2161)) - Connection from 10.0.0.212:42001 for protocol org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol is unauthorized for user dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:50:08,788 INFO ipc.Server (Server.java:doRead(949)) - Socket Reader #1 for port 8020: readAndProcess from client 10.0.0.212 threw exception [org.apache.hadoop.security.authorize.AuthorizationException: User dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-214-181-219.us-west-2.compute.amazonaws.com@HDP.LOCAL] 2017-09-27 08:50:11,077 WARN namenode.FSEditLog (JournalSet.java:selectInputStreams(280)) - Unable to determine input streams from QJM to [10.0.0.248:8485, 10.0.0.163:8485, 10.0.0.66:8485]. Skipping. org.apache.hadoop.hdfs.qjournal.client.QuorumException: Got too many exceptions to achieve quorum size 2/3. 1 successful responses: 10.0.0.163:8485: [[1,1533], [1534,2688], [2689,2732], [2733,2782], [2783,2826], [2827,2870], [2871,2920], [2921,2961], [2962,3005], [3006,3055], [3056,3099], [3100,3143], [3144,3193], [3194,3237], [3238,3281], [3282,3331], [3332,3375], [3376,3419], [3420,3469], [3470,3513], [3514,3557], [3558,3607], [3608,3651], [3652,3695], [3696,3745], [3746,3789], [3790,3833], [3834,3883], [3884,3927], [3928,3971], [3972,4021], [4022,4065], [4066,4109], [4110,4159], [4160,4203], [4204,4247], [4248,4297], [4298,4341], [4342,4379], [4380,4429], [4430,4473], [4474,4518], [4519,4529]] 2 exceptions thrown: 10.0.0.66:8485: User nn/standbynamenode-t5liwl46t1.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.qjournal.protocol.QJournalProtocol, expected client Kerberos principal is nn/ec2-34-208-160-33.us-west-2.compute.amazonaws.com@HDP.LOCAL 10.0.0.248:8485: User nn/standbynamenode-t5liwl46t1.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.qjournal.protocol.QJournalProtocol, expected client Kerberos principal is nn/ec2-34-208-160-33.us-west-2.compute.amazonaws.com@HDP.LOCAL at org.apache.hadoop.hdfs.qjournal.client.QuorumException.create(QuorumException.java:81) at org.apache.hadoop.hdfs.qjournal.client.QuorumCall.rethrowException(QuorumCall.java:223) at org.apache.hadoop.hdfs.qjournal.client.AsyncLoggerSet.waitForWriteQuorum(AsyncLoggerSet.java:142) at org.apache.hadoop.hdfs.qjournal.client.QuorumJournalManager.selectInputStreams(QuorumJournalManager.java:471) at org.apache.hadoop.hdfs.server.namenode.JournalSet.selectInputStreams(JournalSet.java:278) at org.apache.hadoop.hdfs.server.namenode.FSEditLog.selectInputStreams(FSEditLog.java:1520) at org.apache.hadoop.hdfs.server.namenode.FSEditLog.selectInputStreams(FSEditLog.java:1544) at org.apache.hadoop.hdfs.server.namenode.ha.EditLogTailer.doTailEdits(EditLogTailer.java:214) at org.apache.hadoop.hdfs.server.namenode.ha.EditLogTailer$EditLogTailerThread.doWork(EditLogTailer.java:331) at org.apache.hadoop.hdfs.server.namenode.ha.EditLogTailer$EditLogTailerThread.access$200(EditLogTailer.java:284) at org.apache.hadoop.hdfs.server.namenode.ha.EditLogTailer$EditLogTailerThread$1.run(EditLogTailer.java:301) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:360) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1704) at org.apache.hadoop.security.SecurityUtil.doAsLoginUserOrFatal(SecurityUtil.java:447) at org.apache.hadoop.hdfs.server.namenode.ha.EditLogTailer$EditLogTailerThread.run(EditLogTailer.java:297) 2017-09-27 08:50:13,448 INFO ipc.Server (Server.java:saslProcess(1504)) - Auth successful for dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:50:13,449 WARN authorize.ServiceAuthorizationManager (ServiceAuthorizationManager.java:authorize(119)) - Authorization failed for dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) for protocol=interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-212-145-161.us-west-2.compute.amazonaws.com@HDP.LOCAL 2017-09-27 08:50:13,449 INFO ipc.Server (Server.java:authorizeConnection(2161)) - Connection from 10.0.0.210:55934 for protocol org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol is unauthorized for user dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:50:13,449 INFO ipc.Server (Server.java:doRead(949)) - Socket Reader #1 for port 8020: readAndProcess from client 10.0.0.210 threw exception [org.apache.hadoop.security.authorize.AuthorizationException: User dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-212-145-161.us-west-2.compute.amazonaws.com@HDP.LOCAL] 2017-09-27 08:50:13,791 INFO ipc.Server (Server.java:saslProcess(1504)) - Auth successful for dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:50:13,793 WARN authorize.ServiceAuthorizationManager (ServiceAuthorizationManager.java:authorize(119)) - Authorization failed for dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) for protocol=interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-214-181-219.us-west-2.compute.amazonaws.com@HDP.LOCAL 2017-09-27 08:50:13,793 INFO ipc.Server (Server.java:authorizeConnection(2161)) - Connection from 10.0.0.212:54578 for protocol org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol is unauthorized for user dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:50:13,793 INFO ipc.Server (Server.java:doRead(949)) - Socket Reader #1 for port 8020: readAndProcess from client 10.0.0.212 threw exception [org.apache.hadoop.security.authorize.AuthorizationException: User dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-214-181-219.us-west-2.compute.amazonaws.com@HDP.LOCAL] 2017-09-27 08:50:18,453 INFO ipc.Server (Server.java:saslProcess(1504)) - Auth successful for dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:50:18,454 WARN authorize.ServiceAuthorizationManager (ServiceAuthorizationManager.java:authorize(119)) - Authorization failed for dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) for protocol=interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-212-145-161.us-west-2.compute.amazonaws.com@HDP.LOCAL 2017-09-27 08:50:18,454 INFO ipc.Server (Server.java:authorizeConnection(2161)) - Connection from 10.0.0.210:34443 for protocol org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol is unauthorized for user dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:50:18,454 INFO ipc.Server (Server.java:doRead(949)) - Socket Reader #1 for port 8020: readAndProcess from client 10.0.0.210 threw exception [org.apache.hadoop.security.authorize.AuthorizationException: User dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-212-145-161.us-west-2.compute.amazonaws.com@HDP.LOCAL] 2017-09-27 08:50:18,798 INFO ipc.Server (Server.java:saslProcess(1504)) - Auth successful for dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:50:18,798 WARN authorize.ServiceAuthorizationManager (ServiceAuthorizationManager.java:authorize(119)) - Authorization failed for dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) for protocol=interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-214-181-219.us-west-2.compute.amazonaws.com@HDP.LOCAL 2017-09-27 08:50:18,799 INFO ipc.Server (Server.java:authorizeConnection(2161)) - Connection from 10.0.0.212:42255 for protocol org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol is unauthorized for user dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:50:58,867 WARN authorize.ServiceAuthorizationManager (ServiceAuthorizationManager.java:authorize(119)) - Authorization failed for dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) for protocol=interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-214-181-219.us-west-2.compute.amazonaws.com@HDP.LOCAL 2017-09-27 08:50:58,867 INFO ipc.Server (Server.java:authorizeConnection(2161)) - Connection from 10.0.0.212:59115 for protocol org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol is unauthorized for user dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:50:58,867 INFO ipc.Server (Server.java:doRead(949)) - Socket Reader #1 for port 8020: readAndProcess from client 10.0.0.212 threw exception [org.apache.hadoop.security.authorize.AuthorizationException: User dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-214-181-219.us-west-2.compute.amazonaws.com@HDP.LOCAL] 2017-09-27 08:51:03,515 INFO ipc.Server (Server.java:saslProcess(1504)) - Auth successful for dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:51:03,516 WARN authorize.ServiceAuthorizationManager (ServiceAuthorizationManager.java:authorize(119)) - Authorization failed for dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) for protocol=interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-212-145-161.us-west-2.compute.amazonaws.com@HDP.LOCAL 2017-09-27 08:51:03,516 INFO ipc.Server (Server.java:authorizeConnection(2161)) - Connection from 10.0.0.210:56205 for protocol org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol is unauthorized for user dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:51:03,516 INFO ipc.Server (Server.java:doRead(949)) - Socket Reader #1 for port 8020: readAndProcess from client 10.0.0.210 threw exception [org.apache.hadoop.security.authorize.AuthorizationException: User dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-212-145-161.us-west-2.compute.amazonaws.com@HDP.LOCAL] 2017-09-27 08:51:03,871 INFO ipc.Server (Server.java:saslProcess(1504)) - Auth successful for dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:51:03,873 WARN authorize.ServiceAuthorizationManager (ServiceAuthorizationManager.java:authorize(119)) - Authorization failed for dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) for protocol=interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-214-181-219.us-west-2.compute.amazonaws.com@HDP.LOCAL 2017-09-27 08:51:03,873 INFO ipc.Server (Server.java:authorizeConnection(2161)) - Connection from 10.0.0.212:33008 for protocol org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol is unauthorized for user dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:51:03,873 INFO ipc.Server (Server.java:doRead(949)) - Socket Reader #1 for port 8020: readAndProcess from client 10.0.0.212 threw exception [org.apache.hadoop.security.authorize.AuthorizationException: User dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-214-181-219.us-west-2.compute.amazonaws.com@HDP.LOCAL] 2017-09-27 08:51:08,520 INFO ipc.Server (Server.java:saslProcess(1504)) - Auth successful for dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:51:08,521 WARN authorize.ServiceAuthorizationManager (ServiceAuthorizationManager.java:authorize(119)) - Authorization failed for dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) for protocol=interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-212-145-161.us-west-2.compute.amazonaws.com@HDP.LOCAL 2017-09-27 08:51:08,521 INFO ipc.Server (Server.java:authorizeConnection(2161)) - Connection from 10.0.0.210:34791 for protocol org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol is unauthorized for user dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:51:08,521 INFO ipc.Server (Server.java:doRead(949)) - Socket Reader #1 for port 8020: readAndProcess from client 10.0.0.210 threw exception [org.apache.hadoop.security.authorize.AuthorizationException: User dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-212-145-161.us-west-2.compute.amazonaws.com@HDP.LOCAL] 2017-09-27 08:51:08,877 INFO ipc.Server (Server.java:saslProcess(1504)) - Auth successful for dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:51:08,878 WARN authorize.ServiceAuthorizationManager (ServiceAuthorizationManager.java:authorize(119)) - Authorization failed for dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) for protocol=interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-214-181-219.us-west-2.compute.amazonaws.com@HDP.LOCAL 2017-09-27 08:51:08,878 INFO ipc.Server (Server.java:authorizeConnection(2161)) - Connection from 10.0.0.212:58371 for protocol org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol is unauthorized for user dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:51:08,878 INFO ipc.Server (Server.java:doRead(949)) - Socket Reader #1 for port 8020: readAndProcess from client 10.0.0.212 threw exception [org.apache.hadoop.security.authorize.AuthorizationException: User dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-214-181-219.us-west-2.compute.amazonaws.com@HDP.LOCAL] 2017-09-27 08:51:11,103 WARN namenode.FSEditLog (JournalSet.java:selectInputStreams(280)) - Unable to determine input streams from QJM to [10.0.0.248:8485, 10.0.0.163:8485, 10.0.0.66:8485]. Skipping. org.apache.hadoop.hdfs.qjournal.client.QuorumException: Got too many exceptions to achieve quorum size 2/3. 1 successful responses: 10.0.0.163:8485: [[1,1533], [1534,2688], [2689,2732], [2733,2782], [2783,2826], [2827,2870], [2871,2920], [2921,2961], [2962,3005], [3006,3055], [3056,3099], [3100,3143], [3144,3193], [3194,3237], [3238,3281], [3282,3331], [3332,3375], [3376,3419], [3420,3469], [3470,3513], [3514,3557], [3558,3607], [3608,3651], [3652,3695], [3696,3745], [3746,3789], [3790,3833], [3834,3883], [3884,3927], [3928,3971], [3972,4021], [4022,4065], [4066,4109], [4110,4159], [4160,4203], [4204,4247], [4248,4297], [4298,4341], [4342,4379], [4380,4429], [4430,4473], [4474,4518], [4519,4529]] 2 exceptions thrown: 10.0.0.66:8485: User nn/standbynamenode-t5liwl46t1.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.qjournal.protocol.QJournalProtocol, expected client Kerberos principal is nn/ec2-34-208-160-33.us-west-2.compute.amazonaws.com@HDP.LOCAL 10.0.0.248:8485: User nn/standbynamenode-t5liwl46t1.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.qjournal.protocol.QJournalProtocol, expected client Kerberos principal is nn/ec2-34-208-160-33.us-west-2.compute.amazonaws.com@HDP.LOCAL at org.apache.hadoop.hdfs.qjournal.client.QuorumException.create(QuorumException.java:81) at org.apache.hadoop.hdfs.qjournal.client.QuorumCall.rethrowException(QuorumCall.java:223) at org.apache.hadoop.hdfs.qjournal.client.AsyncLoggerSet.waitForWriteQuorum(AsyncLoggerSet.java:142) at org.apache.hadoop.hdfs.qjournal.client.QuorumJournalManager.selectInputStreams(QuorumJournalManager.java:471) at org.apache.hadoop.hdfs.server.namenode.JournalSet.selectInputStreams(JournalSet.java:278) at org.apache.hadoop.hdfs.server.namenode.FSEditLog.selectInputStreams(FSEditLog.java:1520) at org.apache.hadoop.hdfs.server.namenode.FSEditLog.selectInputStreams(FSEditLog.java:1544) at org.apache.hadoop.hdfs.server.namenode.ha.EditLogTailer.doTailEdits(EditLogTailer.java:214) at org.apache.hadoop.hdfs.server.namenode.ha.EditLogTailer$EditLogTailerThread.doWork(EditLogTailer.java:331) at org.apache.hadoop.hdfs.server.namenode.ha.EditLogTailer$EditLogTailerThread.access$200(EditLogTailer.java:284) at org.apache.hadoop.hdfs.server.namenode.ha.EditLogTailer$EditLogTailerThread$1.run(EditLogTailer.java:301) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:360) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1704) at org.apache.hadoop.security.SecurityUtil.doAsLoginUserOrFatal(SecurityUtil.java:447) at org.apache.hadoop.hdfs.server.namenode.ha.EditLogTailer$EditLogTailerThread.run(EditLogTailer.java:297) 2017-09-27 08:51:13,526 INFO ipc.Server (Server.java:saslProcess(1504)) - Auth successful for dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:51:13,527 WARN authorize.ServiceAuthorizationManager (ServiceAuthorizationManager.java:authorize(119)) - Authorization failed for dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) for protocol=interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-212-145-161.us-west-2.compute.amazonaws.com@HDP.LOCAL 2017-09-27 08:51:13,527 INFO ipc.Server (Server.java:authorizeConnection(2161)) - Connection from 10.0.0.210:56006 for protocol org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol is unauthorized for user dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:51:13,528 INFO ipc.Server (Server.java:doRead(949)) - Socket Reader #1 for port 8020: readAndProcess from client 10.0.0.210 threw exception [org.apache.hadoop.security.authorize.AuthorizationException: User dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-212-145-161.us-west-2.compute.amazonaws.com@HDP.LOCAL] 2017-09-27 08:51:13,883 INFO ipc.Server (Server.java:saslProcess(1504)) - Auth successful for dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:51:13,884 WARN authorize.ServiceAuthorizationManager (ServiceAuthorizationManager.java:authorize(119)) - Authorization failed for dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) for protocol=interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-214-181-219.us-west-2.compute.amazonaws.com@HDP.LOCAL 2017-09-27 08:51:13,884 INFO ipc.Server (Server.java:authorizeConnection(2161)) - Connection from 10.0.0.212:55989 for protocol org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol is unauthorized for user dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:51:13,885 INFO ipc.Server (Server.java:doRead(949)) - Socket Reader #1 for port 8020: readAndProcess from client 10.0.0.212 threw exception [org.apache.hadoop.security.authorize.AuthorizationException: User dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-214-181-219.us-west-2.compute.amazonaws.com@HDP.LOCAL] 2017-09-27 08:51:18,531 INFO ipc.Server (Server.java:saslProcess(1504)) - Auth successful for dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:51:18,532 WARN authorize.ServiceAuthorizationManager (ServiceAuthorizationManager.java:authorize(119)) - Authorization failed for dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) for protocol=interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-212-145-161.us-west-2.compute.amazonaws.com@HDP.LOCAL 2017-09-27 08:51:18,532 INFO ipc.Server (Server.java:authorizeConnection(2161)) - Connection from 10.0.0.210:56486 for protocol org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol is unauthorized for user dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:51:18,532 INFO ipc.Server (Server.java:doRead(949)) - Socket Reader #1 for port 8020: readAndProcess from client 10.0.0.210 threw exception [org.apache.hadoop.security.authorize.AuthorizationException: User dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-212-145-161.us-west-2.compute.amazonaws.com@HDP.LOCAL] 2017-09-27 08:51:18,888 INFO ipc.Server (Server.java:saslProcess(1504)) - Auth successful for dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:51:18,889 WARN authorize.ServiceAuthorizationManager (ServiceAuthorizationManager.java:authorize(119)) - Authorization failed for dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) for protocol=interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-214-181-219.us-west-2.compute.amazonaws.com@HDP.LOCAL 2017-09-27 08:51:18,889 INFO ipc.Server (Server.java:authorizeConnection(2161)) - Connection from 10.0.0.212:57320 for protocol org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol is unauthorized for user dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:51:18,890 INFO ipc.Server (Server.java:doRead(949)) - Socket Reader #1 for port 8020: readAndProcess from client 10.0.0.212 threw exception [org.apache.hadoop.security.authorize.AuthorizationException: User dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-214-181-219.us-west-2.compute.amazonaws.com@HDP.LOCAL] 2017-09-27 08:51:23,538 INFO ipc.Server (Server.java:saslProcess(1504)) - Auth successful for dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:51:23,539 WARN authorize.ServiceAuthorizationManager (ServiceAuthorizationManager.java:authorize(119)) - Authorization failed for dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) for protocol=interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-212-145-161.us-west-2.compute.amazonaws.com@HDP.LOCAL 2017-09-27 08:51:58,936 WARN authorize.ServiceAuthorizationManager (ServiceAuthorizationManager.java:authorize(119)) - Authorization failed for dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) for protocol=interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-214-181-219.us-west-2.compute.amazonaws.com@HDP.LOCAL 2017-09-27 08:51:58,936 INFO ipc.Server (Server.java:authorizeConnection(2161)) - Connection from 10.0.0.212:54670 for protocol org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol is unauthorized for user dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:51:58,936 INFO ipc.Server (Server.java:doRead(949)) - Socket Reader #1 for port 8020: readAndProcess from client 10.0.0.212 threw exception [org.apache.hadoop.security.authorize.AuthorizationException: User dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-214-181-219.us-west-2.compute.amazonaws.com@HDP.LOCAL] 2017-09-27 08:52:03,591 INFO ipc.Server (Server.java:saslProcess(1504)) - Auth successful for dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:52:03,592 WARN authorize.ServiceAuthorizationManager (ServiceAuthorizationManager.java:authorize(119)) - Authorization failed for dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) for protocol=interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-212-145-161.us-west-2.compute.amazonaws.com@HDP.LOCAL 2017-09-27 08:52:03,592 INFO ipc.Server (Server.java:authorizeConnection(2161)) - Connection from 10.0.0.210:57289 for protocol org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol is unauthorized for user dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:52:03,592 INFO ipc.Server (Server.java:doRead(949)) - Socket Reader #1 for port 8020: readAndProcess from client 10.0.0.210 threw exception [org.apache.hadoop.security.authorize.AuthorizationException: User dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-212-145-161.us-west-2.compute.amazonaws.com@HDP.LOCAL] 2017-09-27 08:52:03,941 INFO ipc.Server (Server.java:saslProcess(1504)) - Auth successful for dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:52:03,941 WARN authorize.ServiceAuthorizationManager (ServiceAuthorizationManager.java:authorize(119)) - Authorization failed for dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) for protocol=interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-214-181-219.us-west-2.compute.amazonaws.com@HDP.LOCAL 2017-09-27 08:52:03,941 INFO ipc.Server (Server.java:authorizeConnection(2161)) - Connection from 10.0.0.212:46136 for protocol org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol is unauthorized for user dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:52:03,942 INFO ipc.Server (Server.java:doRead(949)) - Socket Reader #1 for port 8020: readAndProcess from client 10.0.0.212 threw exception [org.apache.hadoop.security.authorize.AuthorizationException: User dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-214-181-219.us-west-2.compute.amazonaws.com@HDP.LOCAL] 2017-09-27 08:52:08,596 INFO ipc.Server (Server.java:saslProcess(1504)) - Auth successful for dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:52:08,597 WARN authorize.ServiceAuthorizationManager (ServiceAuthorizationManager.java:authorize(119)) - Authorization failed for dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) for protocol=interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-212-145-161.us-west-2.compute.amazonaws.com@HDP.LOCAL 2017-09-27 08:52:08,597 INFO ipc.Server (Server.java:authorizeConnection(2161)) - Connection from 10.0.0.210:48665 for protocol org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol is unauthorized for user dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:52:08,597 INFO ipc.Server (Server.java:doRead(949)) - Socket Reader #1 for port 8020: readAndProcess from client 10.0.0.210 threw exception [org.apache.hadoop.security.authorize.AuthorizationException: User dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-212-145-161.us-west-2.compute.amazonaws.com@HDP.LOCAL] 2017-09-27 08:52:08,945 INFO ipc.Server (Server.java:saslProcess(1504)) - Auth successful for dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:52:08,946 WARN authorize.ServiceAuthorizationManager (ServiceAuthorizationManager.java:authorize(119)) - Authorization failed for dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) for protocol=interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-214-181-219.us-west-2.compute.amazonaws.com@HDP.LOCAL 2017-09-27 08:52:08,946 INFO ipc.Server (Server.java:authorizeConnection(2161)) - Connection from 10.0.0.212:52069 for protocol org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol is unauthorized for user dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:52:08,946 INFO ipc.Server (Server.java:doRead(949)) - Socket Reader #1 for port 8020: readAndProcess from client 10.0.0.212 threw exception [org.apache.hadoop.security.authorize.AuthorizationException: User dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-214-181-219.us-west-2.compute.amazonaws.com@HDP.LOCAL] 2017-09-27 08:52:11,126 WARN namenode.FSEditLog (JournalSet.java:selectInputStreams(280)) - Unable to determine input streams from QJM to [10.0.0.248:8485, 10.0.0.163:8485, 10.0.0.66:8485]. Skipping. org.apache.hadoop.hdfs.qjournal.client.QuorumException: Got too many exceptions to achieve quorum size 2/3. 1 successful responses: 10.0.0.163:8485: [[1,1533], [1534,2688], [2689,2732], [2733,2782], [2783,2826], [2827,2870], [2871,2920], [2921,2961], [2962,3005], [3006,3055], [3056,3099], [3100,3143], [3144,3193], [3194,3237], [3238,3281], [3282,3331], [3332,3375], [3376,3419], [3420,3469], [3470,3513], [3514,3557], [3558,3607], [3608,3651], [3652,3695], [3696,3745], [3746,3789], [3790,3833], [3834,3883], [3884,3927], [3928,3971], [3972,4021], [4022,4065], [4066,4109], [4110,4159], [4160,4203], [4204,4247], [4248,4297], [4298,4341], [4342,4379], [4380,4429], [4430,4473], [4474,4518], [4519,4529]] 2 exceptions thrown: 10.0.0.66:8485: User nn/standbynamenode-t5liwl46t1.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.qjournal.protocol.QJournalProtocol, expected client Kerberos principal is nn/ec2-34-208-160-33.us-west-2.compute.amazonaws.com@HDP.LOCAL 10.0.0.248:8485: User nn/standbynamenode-t5liwl46t1.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.qjournal.protocol.QJournalProtocol, expected client Kerberos principal is nn/ec2-34-208-160-33.us-west-2.compute.amazonaws.com@HDP.LOCAL at org.apache.hadoop.hdfs.qjournal.client.QuorumException.create(QuorumException.java:81) at org.apache.hadoop.hdfs.qjournal.client.QuorumCall.rethrowException(QuorumCall.java:223) at org.apache.hadoop.hdfs.qjournal.client.AsyncLoggerSet.waitForWriteQuorum(AsyncLoggerSet.java:142) at org.apache.hadoop.hdfs.qjournal.client.QuorumJournalManager.selectInputStreams(QuorumJournalManager.java:471) at org.apache.hadoop.hdfs.server.namenode.JournalSet.selectInputStreams(JournalSet.java:278) at org.apache.hadoop.hdfs.server.namenode.FSEditLog.selectInputStreams(FSEditLog.java:1520) at org.apache.hadoop.hdfs.server.namenode.FSEditLog.selectInputStreams(FSEditLog.java:1544) at org.apache.hadoop.hdfs.server.namenode.ha.EditLogTailer.doTailEdits(EditLogTailer.java:214) at org.apache.hadoop.hdfs.server.namenode.ha.EditLogTailer$EditLogTailerThread.doWork(EditLogTailer.java:331) at org.apache.hadoop.hdfs.server.namenode.ha.EditLogTailer$EditLogTailerThread.access$200(EditLogTailer.java:284) at org.apache.hadoop.hdfs.server.namenode.ha.EditLogTailer$EditLogTailerThread$1.run(EditLogTailer.java:301) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:360) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1704) at org.apache.hadoop.security.SecurityUtil.doAsLoginUserOrFatal(SecurityUtil.java:447) at org.apache.hadoop.hdfs.server.namenode.ha.EditLogTailer$EditLogTailerThread.run(EditLogTailer.java:297) 2017-09-27 08:52:13,601 INFO ipc.Server (Server.java:saslProcess(1504)) - Auth successful for dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:52:13,602 WARN authorize.ServiceAuthorizationManager (ServiceAuthorizationManager.java:authorize(119)) - Authorization failed for dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) for protocol=interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-212-145-161.us-west-2.compute.amazonaws.com@HDP.LOCAL 2017-09-27 08:52:13,602 INFO ipc.Server (Server.java:authorizeConnection(2161)) - Connection from 10.0.0.210:53225 for protocol org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol is unauthorized for user dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:52:13,603 INFO ipc.Server (Server.java:doRead(949)) - Socket Reader #1 for port 8020: readAndProcess from client 10.0.0.210 threw exception [org.apache.hadoop.security.authorize.AuthorizationException: User dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-212-145-161.us-west-2.compute.amazonaws.com@HDP.LOCAL] 2017-09-27 08:52:13,950 INFO ipc.Server (Server.java:saslProcess(1504)) - Auth successful for dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:52:13,951 WARN authorize.ServiceAuthorizationManager (ServiceAuthorizationManager.java:authorize(119)) - Authorization failed for dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) for protocol=interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-214-181-219.us-west-2.compute.amazonaws.com@HDP.LOCAL 2017-09-27 08:52:13,951 INFO ipc.Server (Server.java:authorizeConnection(2161)) - Connection from 10.0.0.212:47708 for protocol org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol is unauthorized for user dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:52:13,951 INFO ipc.Server (Server.java:doRead(949)) - Socket Reader #1 for port 8020: readAndProcess from client 10.0.0.212 threw exception [org.apache.hadoop.security.authorize.AuthorizationException: User dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-214-181-219.us-west-2.compute.amazonaws.com@HDP.LOCAL] 2017-09-27 08:52:18,606 INFO ipc.Server (Server.java:saslProcess(1504)) - Auth successful for dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:52:18,607 WARN authorize.ServiceAuthorizationManager (ServiceAuthorizationManager.java:authorize(119)) - Authorization failed for dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) for protocol=interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-212-145-161.us-west-2.compute.amazonaws.com@HDP.LOCAL 2017-09-27 08:52:18,607 INFO ipc.Server (Server.java:authorizeConnection(2161)) - Connection from 10.0.0.210:47832 for protocol org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol is unauthorized for user dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:52:18,607 INFO ipc.Server (Server.java:doRead(949)) - Socket Reader #1 for port 8020: readAndProcess from client 10.0.0.210 threw exception [org.apache.hadoop.security.authorize.AuthorizationException: User dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-212-145-161.us-west-2.compute.amazonaws.com@HDP.LOCAL] 2017-09-27 08:52:18,955 INFO ipc.Server (Server.java:saslProcess(1504)) - Auth successful for dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:52:18,956 WARN authorize.ServiceAuthorizationManager (ServiceAuthorizationManager.java:authorize(119)) - Authorization failed for dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) for protocol=interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-214-181-219.us-west-2.compute.amazonaws.com@HDP.LOCAL 2017-09-27 08:52:18,956 INFO ipc.Server (Server.java:authorizeConnection(2161)) - Connection from 10.0.0.212:39687 for protocol org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol is unauthorized for user dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:52:18,956 INFO ipc.Server (Server.java:doRead(949)) - Socket Reader #1 for port 8020: readAndProcess from client 10.0.0.212 threw exception [org.apache.hadoop.security.authorize.AuthorizationException: User dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-214-181-219.us-west-2.compute.amazonaws.com@HDP.LOCAL] 2017-09-27 08:52:23,611 INFO ipc.Server (Server.java:saslProcess(1504)) - Auth successful for dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:56:49,102 WARN authorize.ServiceAuthorizationManager (ServiceAuthorizationManager.java:authorize(119)) - Authorization failed for dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) for protocol=interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-212-145-161.us-west-2.compute.amazonaws.com@HDP.LOCAL 2017-09-27 08:56:49,102 INFO ipc.Server (Server.java:authorizeConnection(2161)) - Connection from 10.0.0.210:47228 for protocol org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol is unauthorized for user dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:56:49,102 INFO ipc.Server (Server.java:doRead(949)) - Socket Reader #1 for port 8020: readAndProcess from client 10.0.0.210 threw exception [org.apache.hadoop.security.authorize.AuthorizationException: User dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-212-145-161.us-west-2.compute.amazonaws.com@HDP.LOCAL] 2017-09-27 08:56:49,404 INFO ipc.Server (Server.java:saslProcess(1504)) - Auth successful for dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:56:49,416 WARN authorize.ServiceAuthorizationManager (ServiceAuthorizationManager.java:authorize(119)) - Authorization failed for dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) for protocol=interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-214-181-219.us-west-2.compute.amazonaws.com@HDP.LOCAL 2017-09-27 08:56:49,416 INFO ipc.Server (Server.java:authorizeConnection(2161)) - Connection from 10.0.0.212:35057 for protocol org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol is unauthorized for user dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:56:49,416 INFO ipc.Server (Server.java:doRead(949)) - Socket Reader #1 for port 8020: readAndProcess from client 10.0.0.212 threw exception [org.apache.hadoop.security.authorize.AuthorizationException: User dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-214-181-219.us-west-2.compute.amazonaws.com@HDP.LOCAL] 2017-09-27 08:56:54,130 INFO ipc.Server (Server.java:saslProcess(1504)) - Auth successful for dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:56:54,141 WARN authorize.ServiceAuthorizationManager (ServiceAuthorizationManager.java:authorize(119)) - Authorization failed for dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) for protocol=interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-212-145-161.us-west-2.compute.amazonaws.com@HDP.LOCAL 2017-09-27 08:56:54,141 INFO ipc.Server (Server.java:authorizeConnection(2161)) - Connection from 10.0.0.210:53081 for protocol org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol is unauthorized for user dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:56:54,141 INFO ipc.Server (Server.java:doRead(949)) - Socket Reader #1 for port 8020: readAndProcess from client 10.0.0.210 threw exception [org.apache.hadoop.security.authorize.AuthorizationException: User dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-212-145-161.us-west-2.compute.amazonaws.com@HDP.LOCAL] 2017-09-27 08:56:54,452 INFO ipc.Server (Server.java:saslProcess(1504)) - Auth successful for dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:56:54,453 WARN authorize.ServiceAuthorizationManager (ServiceAuthorizationManager.java:authorize(119)) - Authorization failed for dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) for protocol=interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-214-181-219.us-west-2.compute.amazonaws.com@HDP.LOCAL 2017-09-27 08:56:54,454 INFO ipc.Server (Server.java:authorizeConnection(2161)) - Connection from 10.0.0.212:54154 for protocol org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol is unauthorized for user dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:56:54,454 INFO ipc.Server (Server.java:doRead(949)) - Socket Reader #1 for port 8020: readAndProcess from client 10.0.0.212 threw exception [org.apache.hadoop.security.authorize.AuthorizationException: User dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-214-181-219.us-west-2.compute.amazonaws.com@HDP.LOCAL] 2017-09-27 08:56:59,146 INFO ipc.Server (Server.java:saslProcess(1504)) - Auth successful for dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:56:59,148 WARN authorize.ServiceAuthorizationManager (ServiceAuthorizationManager.java:authorize(119)) - Authorization failed for dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) for protocol=interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-212-145-161.us-west-2.compute.amazonaws.com@HDP.LOCAL 2017-09-27 08:56:59,148 INFO ipc.Server (Server.java:authorizeConnection(2161)) - Connection from 10.0.0.210:47146 for protocol org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol is unauthorized for user dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:56:59,148 INFO ipc.Server (Server.java:doRead(949)) - Socket Reader #1 for port 8020: readAndProcess from client 10.0.0.210 threw exception [org.apache.hadoop.security.authorize.AuthorizationException: User dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-212-145-161.us-west-2.compute.amazonaws.com@HDP.LOCAL] 2017-09-27 08:56:59,458 INFO ipc.Server (Server.java:saslProcess(1504)) - Auth successful for dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:56:59,459 WARN authorize.ServiceAuthorizationManager (ServiceAuthorizationManager.java:authorize(119)) - Authorization failed for dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) for protocol=interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-214-181-219.us-west-2.compute.amazonaws.com@HDP.LOCAL 2017-09-27 08:56:59,459 INFO ipc.Server (Server.java:authorizeConnection(2161)) - Connection from 10.0.0.212:38262 for protocol org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol is unauthorized for user dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:56:59,459 INFO ipc.Server (Server.java:doRead(949)) - Socket Reader #1 for port 8020: readAndProcess from client 10.0.0.212 threw exception [org.apache.hadoop.security.authorize.AuthorizationException: User dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-214-181-219.us-west-2.compute.amazonaws.com@HDP.LOCAL] 2017-09-27 08:57:04,154 INFO ipc.Server (Server.java:saslProcess(1504)) - Auth successful for dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:57:04,156 WARN authorize.ServiceAuthorizationManager (ServiceAuthorizationManager.java:authorize(119)) - Authorization failed for dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) for protocol=interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-212-145-161.us-west-2.compute.amazonaws.com@HDP.LOCAL 2017-09-27 08:57:04,156 INFO ipc.Server (Server.java:authorizeConnection(2161)) - Connection from 10.0.0.210:38912 for protocol org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol is unauthorized for user dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:57:04,156 INFO ipc.Server (Server.java:doRead(949)) - Socket Reader #1 for port 8020: readAndProcess from client 10.0.0.210 threw exception [org.apache.hadoop.security.authorize.AuthorizationException: User dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-212-145-161.us-west-2.compute.amazonaws.com@HDP.LOCAL] 2017-09-27 08:57:04,463 INFO ipc.Server (Server.java:saslProcess(1504)) - Auth successful for dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:57:04,464 WARN authorize.ServiceAuthorizationManager (ServiceAuthorizationManager.java:authorize(119)) - Authorization failed for dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) for protocol=interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-214-181-219.us-west-2.compute.amazonaws.com@HDP.LOCAL 2017-09-27 08:57:04,464 INFO ipc.Server (Server.java:authorizeConnection(2161)) - Connection from 10.0.0.212:55444 for protocol org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol is unauthorized for user dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:57:04,464 INFO ipc.Server (Server.java:doRead(949)) - Socket Reader #1 for port 8020: readAndProcess from client 10.0.0.212 threw exception [org.apache.hadoop.security.authorize.AuthorizationException: User dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-214-181-219.us-west-2.compute.amazonaws.com@HDP.LOCAL] 2017-09-27 08:57:09,161 INFO ipc.Server (Server.java:saslProcess(1504)) - Auth successful for dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:57:09,162 WARN authorize.ServiceAuthorizationManager (ServiceAuthorizationManager.java:authorize(119)) - Authorization failed for dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) for protocol=interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-212-145-161.us-west-2.compute.amazonaws.com@HDP.LOCAL 2017-09-27 08:57:09,162 INFO ipc.Server (Server.java:authorizeConnection(2161)) - Connection from 10.0.0.210:49661 for protocol org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol is unauthorized for user dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:57:09,162 INFO ipc.Server (Server.java:doRead(949)) - Socket Reader #1 for port 8020: readAndProcess from client 10.0.0.210 threw exception [org.apache.hadoop.security.authorize.AuthorizationException: User dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-212-145-161.us-west-2.compute.amazonaws.com@HDP.LOCAL] 2017-09-27 08:57:09,469 INFO ipc.Server (Server.java:saslProcess(1504)) - Auth successful for dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:57:09,471 WARN authorize.ServiceAuthorizationManager (ServiceAuthorizationManager.java:authorize(119)) - Authorization failed for dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) for protocol=interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-214-181-219.us-west-2.compute.amazonaws.com@HDP.LOCAL 2017-09-27 08:57:09,471 INFO ipc.Server (Server.java:authorizeConnection(2161)) - Connection from 10.0.0.212:43938 for protocol org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol is unauthorized for user dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:57:09,471 INFO ipc.Server (Server.java:doRead(949)) - Socket Reader #1 for port 8020: readAndProcess from client 10.0.0.212 threw exception [org.apache.hadoop.security.authorize.AuthorizationException: User dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-214-181-219.us-west-2.compute.amazonaws.com@HDP.LOCAL] 2017-09-27 08:57:11,256 WARN namenode.FSEditLog (JournalSet.java:selectInputStreams(280)) - Unable to determine input streams from QJM to [10.0.0.248:8485, 10.0.0.163:8485, 10.0.0.66:8485]. Skipping. org.apache.hadoop.hdfs.qjournal.client.QuorumException: Got too many exceptions to achieve quorum size 2/3. 1 successful responses: 10.0.0.163:8485: [[1,1533], [1534,2688], [2689,2732], [2733,2782], [2783,2826], [2827,2870], [2871,2920], [2921,2961], [2962,3005], [3006,3055], [3056,3099], [3100,3143], [3144,3193], [3194,3237], [3238,3281], [3282,3331], [3332,3375], [3376,3419], [3420,3469], [3470,3513], [3514,3557], [3558,3607], [3608,3651], [3652,3695], [3696,3745], [3746,3789], [3790,3833], [3834,3883], [3884,3927], [3928,3971], [3972,4021], [4022,4065], [4066,4109], [4110,4159], [4160,4203], [4204,4247], [4248,4297], [4298,4341], [4342,4379], [4380,4429], [4430,4473], [4474,4518], [4519,4529]] 2 exceptions thrown: 10.0.0.66:8485: User nn/standbynamenode-t5liwl46t1.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.qjournal.protocol.QJournalProtocol, expected client Kerberos principal is nn/ec2-34-208-160-33.us-west-2.compute.amazonaws.com@HDP.LOCAL 10.0.0.248:8485: User nn/standbynamenode-t5liwl46t1.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.qjournal.protocol.QJournalProtocol, expected client Kerberos principal is nn/ec2-34-208-160-33.us-west-2.compute.amazonaws.com@HDP.LOCAL at org.apache.hadoop.hdfs.qjournal.client.QuorumException.create(QuorumException.java:81) at org.apache.hadoop.hdfs.qjournal.client.QuorumCall.rethrowException(QuorumCall.java:223) at org.apache.hadoop.hdfs.qjournal.client.AsyncLoggerSet.waitForWriteQuorum(AsyncLoggerSet.java:142) at org.apache.hadoop.hdfs.qjournal.client.QuorumJournalManager.selectInputStreams(QuorumJournalManager.java:471) at org.apache.hadoop.hdfs.server.namenode.JournalSet.selectInputStreams(JournalSet.java:278) at org.apache.hadoop.hdfs.server.namenode.FSEditLog.selectInputStreams(FSEditLog.java:1520) at org.apache.hadoop.hdfs.server.namenode.FSEditLog.selectInputStreams(FSEditLog.java:1544) at org.apache.hadoop.hdfs.server.namenode.ha.EditLogTailer.doTailEdits(EditLogTailer.java:214) at org.apache.hadoop.hdfs.server.namenode.ha.EditLogTailer$EditLogTailerThread.doWork(EditLogTailer.java:331) at org.apache.hadoop.hdfs.server.namenode.ha.EditLogTailer$EditLogTailerThread.access$200(EditLogTailer.java:284) at org.apache.hadoop.hdfs.server.namenode.ha.EditLogTailer$EditLogTailerThread$1.run(EditLogTailer.java:301) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:360) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1704) at org.apache.hadoop.security.SecurityUtil.doAsLoginUserOrFatal(SecurityUtil.java:447) at org.apache.hadoop.hdfs.server.namenode.ha.EditLogTailer$EditLogTailerThread.run(EditLogTailer.java:297) 2017-09-27 08:57:14,166 INFO ipc.Server (Server.java:saslProcess(1504)) - Auth successful for dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:57:14,167 WARN authorize.ServiceAuthorizationManager (ServiceAuthorizationManager.java:authorize(119)) - Authorization failed for dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) for protocol=interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-212-145-161.us-west-2.compute.amazonaws.com@HDP.LOCAL 2017-09-27 08:57:14,167 INFO ipc.Server (Server.java:authorizeConnection(2161)) - Connection from 10.0.0.210:50185 for protocol org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol is unauthorized for user dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:57:14,167 INFO ipc.Server (Server.java:doRead(949)) - Socket Reader #1 for port 8020: readAndProcess from client 10.0.0.210 threw exception [org.apache.hadoop.security.authorize.AuthorizationException: User dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-212-145-161.us-west-2.compute.amazonaws.com@HDP.LOCAL] 2017-09-27 08:57:14,474 INFO ipc.Server (Server.java:saslProcess(1504)) - Auth successful for dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:57:14,476 WARN authorize.ServiceAuthorizationManager (ServiceAuthorizationManager.java:authorize(119)) - Authorization failed for dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) for protocol=interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-214-181-219.us-west-2.compute.amazonaws.com@HDP.LOCAL 2017-09-27 08:57:14,476 INFO ipc.Server (Server.java:authorizeConnection(2161)) - Connection from 10.0.0.212:37577 for protocol org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol is unauthorized for user dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:57:14,476 INFO ipc.Server (Server.java:doRead(949)) - Socket Reader #1 for port 8020: readAndProcess from client 10.0.0.212 threw exception [org.apache.hadoop.security.authorize.AuthorizationException: User dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-214-181-219.us-west-2.compute.amazonaws.com@HDP.LOCAL] 2017-09-27 08:57:19,173 INFO ipc.Server (Server.java:saslProcess(1504)) - Auth successful for dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:57:19,174 WARN authorize.ServiceAuthorizationManager (ServiceAuthorizationManager.java:authorize(119)) - Authorization failed for dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) for protocol=interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-212-145-161.us-west-2.compute.amazonaws.com@HDP.LOCAL 2017-09-27 08:57:19,174 INFO ipc.Server (Server.java:authorizeConnection(2161)) - Connection from 10.0.0.210:56970 for protocol org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol is unauthorized for user dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:57:19,174 INFO ipc.Server (Server.java:doRead(949)) - Socket Reader #1 for port 8020: readAndProcess from client 10.0.0.210 threw exception [org.apache.hadoop.security.authorize.AuthorizationException: User dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-212-145-161.us-west-2.compute.amazonaws.com@HDP.LOCAL] 2017-09-27 08:57:19,483 INFO ipc.Server (Server.java:saslProcess(1504)) - Auth successful for dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:57:19,486 WARN authorize.ServiceAuthorizationManager (ServiceAuthorizationManager.java:authorize(119)) - Authorization failed for dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) for protocol=interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-214-181-219.us-west-2.compute.amazonaws.com@HDP.LOCAL 2017-09-27 08:58:39,302 WARN authorize.ServiceAuthorizationManager (ServiceAuthorizationManager.java:authorize(119)) - Authorization failed for dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) for protocol=interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-212-145-161.us-west-2.compute.amazonaws.com@HDP.LOCAL 2017-09-27 08:58:39,302 INFO ipc.Server (Server.java:authorizeConnection(2161)) - Connection from 10.0.0.210:59872 for protocol org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol is unauthorized for user dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:58:39,302 INFO ipc.Server (Server.java:doRead(949)) - Socket Reader #1 for port 8020: readAndProcess from client 10.0.0.210 threw exception [org.apache.hadoop.security.authorize.AuthorizationException: User dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-212-145-161.us-west-2.compute.amazonaws.com@HDP.LOCAL] 2017-09-27 08:58:39,577 INFO ipc.Server (Server.java:saslProcess(1504)) - Auth successful for dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:58:39,578 WARN authorize.ServiceAuthorizationManager (ServiceAuthorizationManager.java:authorize(119)) - Authorization failed for dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) for protocol=interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-214-181-219.us-west-2.compute.amazonaws.com@HDP.LOCAL 2017-09-27 08:58:39,578 INFO ipc.Server (Server.java:authorizeConnection(2161)) - Connection from 10.0.0.212:51746 for protocol org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol is unauthorized for user dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:58:39,578 INFO ipc.Server (Server.java:doRead(949)) - Socket Reader #1 for port 8020: readAndProcess from client 10.0.0.212 threw exception [org.apache.hadoop.security.authorize.AuthorizationException: User dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-214-181-219.us-west-2.compute.amazonaws.com@HDP.LOCAL] 2017-09-27 08:58:44,306 INFO ipc.Server (Server.java:saslProcess(1504)) - Auth successful for dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:58:44,307 WARN authorize.ServiceAuthorizationManager (ServiceAuthorizationManager.java:authorize(119)) - Authorization failed for dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) for protocol=interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-212-145-161.us-west-2.compute.amazonaws.com@HDP.LOCAL 2017-09-27 08:58:44,307 INFO ipc.Server (Server.java:authorizeConnection(2161)) - Connection from 10.0.0.210:51796 for protocol org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol is unauthorized for user dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:58:44,307 INFO ipc.Server (Server.java:doRead(949)) - Socket Reader #1 for port 8020: readAndProcess from client 10.0.0.210 threw exception [org.apache.hadoop.security.authorize.AuthorizationException: User dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-212-145-161.us-west-2.compute.amazonaws.com@HDP.LOCAL] 2017-09-27 08:58:44,581 INFO ipc.Server (Server.java:saslProcess(1504)) - Auth successful for dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:58:44,583 WARN authorize.ServiceAuthorizationManager (ServiceAuthorizationManager.java:authorize(119)) - Authorization failed for dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) for protocol=interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-214-181-219.us-west-2.compute.amazonaws.com@HDP.LOCAL 2017-09-27 08:58:44,583 INFO ipc.Server (Server.java:authorizeConnection(2161)) - Connection from 10.0.0.212:40313 for protocol org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol is unauthorized for user dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:58:44,583 INFO ipc.Server (Server.java:doRead(949)) - Socket Reader #1 for port 8020: readAndProcess from client 10.0.0.212 threw exception [org.apache.hadoop.security.authorize.AuthorizationException: User dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-214-181-219.us-west-2.compute.amazonaws.com@HDP.LOCAL] 2017-09-27 08:58:47,400 INFO timeline.HadoopTimelineMetricsSink (AbstractTimelineMetricsSink.java:emitMetrics(127)) - Unable to connect to collector, http://bdaap-ce6dol7nyx.hdp.local:6188/ws/v1/timeline/metrics 2017-09-27 08:58:47,400 WARN timeline.HadoopTimelineMetricsSink (HadoopTimelineMetricsSink.java:putMetrics(262)) - Unable to send metrics to collector by address:http://bdaap-ce6dol7nyx.hdp.local:6188/ws/v1/timeline/metrics 2017-09-27 08:58:47,401 INFO timeline.HadoopTimelineMetricsSink (AbstractTimelineMetricsSink.java:emitMetrics(127)) - Unable to connect to collector, http://bdaap-ce6dol7nyx.hdp.local:6188/ws/v1/timeline/metrics 2017-09-27 08:58:47,401 WARN timeline.HadoopTimelineMetricsSink (HadoopTimelineMetricsSink.java:putMetrics(262)) - Unable to send metrics to collector by address:http://bdaap-ce6dol7nyx.hdp.local:6188/ws/v1/timeline/metrics 2017-09-27 08:58:47,402 INFO timeline.HadoopTimelineMetricsSink (AbstractTimelineMetricsSink.java:emitMetrics(127)) - Unable to connect to collector, http://bdaap-ce6dol7nyx.hdp.local:6188/ws/v1/timeline/metrics 2017-09-27 08:58:47,402 WARN timeline.HadoopTimelineMetricsSink (HadoopTimelineMetricsSink.java:putMetrics(262)) - Unable to send metrics to collector by address:http://bdaap-ce6dol7nyx.hdp.local:6188/ws/v1/timeline/metrics 2017-09-27 08:58:47,403 INFO timeline.HadoopTimelineMetricsSink (AbstractTimelineMetricsSink.java:emitMetrics(127)) - Unable to connect to collector, http://bdaap-ce6dol7nyx.hdp.local:6188/ws/v1/timeline/metrics 2017-09-27 08:58:47,403 WARN timeline.HadoopTimelineMetricsSink (HadoopTimelineMetricsSink.java:putMetrics(262)) - Unable to send metrics to collector by address:http://bdaap-ce6dol7nyx.hdp.local:6188/ws/v1/timeline/metrics 2017-09-27 08:58:49,311 INFO ipc.Server (Server.java:saslProcess(1504)) - Auth successful for dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:58:49,312 WARN authorize.ServiceAuthorizationManager (ServiceAuthorizationManager.java:authorize(119)) - Authorization failed for dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) for protocol=interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-212-145-161.us-west-2.compute.amazonaws.com@HDP.LOCAL 2017-09-27 08:58:49,312 INFO ipc.Server (Server.java:authorizeConnection(2161)) - Connection from 10.0.0.210:58062 for protocol org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol is unauthorized for user dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:58:49,312 INFO ipc.Server (Server.java:doRead(949)) - Socket Reader #1 for port 8020: readAndProcess from client 10.0.0.210 threw exception [org.apache.hadoop.security.authorize.AuthorizationException: User dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-212-145-161.us-west-2.compute.amazonaws.com@HDP.LOCAL] 2017-09-27 08:58:49,587 INFO ipc.Server (Server.java:saslProcess(1504)) - Auth successful for dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:58:49,588 WARN authorize.ServiceAuthorizationManager (ServiceAuthorizationManager.java:authorize(119)) - Authorization failed for dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) for protocol=interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-214-181-219.us-west-2.compute.amazonaws.com@HDP.LOCAL 2017-09-27 08:58:49,588 INFO ipc.Server (Server.java:authorizeConnection(2161)) - Connection from 10.0.0.212:35403 for protocol org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol is unauthorized for user dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:58:49,588 INFO ipc.Server (Server.java:doRead(949)) - Socket Reader #1 for port 8020: readAndProcess from client 10.0.0.212 threw exception [org.apache.hadoop.security.authorize.AuthorizationException: User dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-214-181-219.us-west-2.compute.amazonaws.com@HDP.LOCAL] 2017-09-27 08:58:54,316 INFO ipc.Server (Server.java:saslProcess(1504)) - Auth successful for dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:58:54,317 WARN authorize.ServiceAuthorizationManager (ServiceAuthorizationManager.java:authorize(119)) - Authorization failed for dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) for protocol=interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-212-145-161.us-west-2.compute.amazonaws.com@HDP.LOCAL 2017-09-27 08:58:54,317 INFO ipc.Server (Server.java:authorizeConnection(2161)) - Connection from 10.0.0.210:33997 for protocol org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol is unauthorized for user dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:58:54,317 INFO ipc.Server (Server.java:doRead(949)) - Socket Reader #1 for port 8020: readAndProcess from client 10.0.0.210 threw exception [org.apache.hadoop.security.authorize.AuthorizationException: User dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-212-145-161.us-west-2.compute.amazonaws.com@HDP.LOCAL] 2017-09-27 08:58:54,592 INFO ipc.Server (Server.java:saslProcess(1504)) - Auth successful for dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:58:54,593 WARN authorize.ServiceAuthorizationManager (ServiceAuthorizationManager.java:authorize(119)) - Authorization failed for dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) for protocol=interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-214-181-219.us-west-2.compute.amazonaws.com@HDP.LOCAL 2017-09-27 08:58:54,594 INFO ipc.Server (Server.java:authorizeConnection(2161)) - Connection from 10.0.0.212:34171 for protocol org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol is unauthorized for user dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:58:54,594 INFO ipc.Server (Server.java:doRead(949)) - Socket Reader #1 for port 8020: readAndProcess from client 10.0.0.212 threw exception [org.apache.hadoop.security.authorize.AuthorizationException: User dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-214-181-219.us-west-2.compute.amazonaws.com@HDP.LOCAL] 2017-09-27 08:58:59,321 INFO ipc.Server (Server.java:saslProcess(1504)) - Auth successful for dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:58:59,322 WARN authorize.ServiceAuthorizationManager (ServiceAuthorizationManager.java:authorize(119)) - Authorization failed for dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) for protocol=interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-212-145-161.us-west-2.compute.amazonaws.com@HDP.LOCAL 2017-09-27 08:58:59,322 INFO ipc.Server (Server.java:authorizeConnection(2161)) - Connection from 10.0.0.210:35254 for protocol org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol is unauthorized for user dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:58:59,323 INFO ipc.Server (Server.java:doRead(949)) - Socket Reader #1 for port 8020: readAndProcess from client 10.0.0.210 threw exception [org.apache.hadoop.security.authorize.AuthorizationException: User dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-212-145-161.us-west-2.compute.amazonaws.com@HDP.LOCAL] 2017-09-27 08:58:59,597 INFO ipc.Server (Server.java:saslProcess(1504)) - Auth successful for dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:58:59,598 WARN authorize.ServiceAuthorizationManager (ServiceAuthorizationManager.java:authorize(119)) - Authorization failed for dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) for protocol=interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-214-181-219.us-west-2.compute.amazonaws.com@HDP.LOCAL 2017-09-27 08:58:59,598 INFO ipc.Server (Server.java:authorizeConnection(2161)) - Connection from 10.0.0.212:46230 for protocol org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol is unauthorized for user dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:58:59,598 INFO ipc.Server (Server.java:doRead(949)) - Socket Reader #1 for port 8020: readAndProcess from client 10.0.0.212 threw exception [org.apache.hadoop.security.authorize.AuthorizationException: User dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-214-181-219.us-west-2.compute.amazonaws.com@HDP.LOCAL] 2017-09-27 08:59:04,326 INFO ipc.Server (Server.java:saslProcess(1504)) - Auth successful for dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:59:04,327 WARN authorize.ServiceAuthorizationManager (ServiceAuthorizationManager.java:authorize(119)) - Authorization failed for dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) for protocol=interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-212-145-161.us-west-2.compute.amazonaws.com@HDP.LOCAL 2017-09-27 08:59:04,327 INFO ipc.Server (Server.java:authorizeConnection(2161)) - Connection from 10.0.0.210:48925 for protocol org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol is unauthorized for user dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:59:04,327 INFO ipc.Server (Server.java:doRead(949)) - Socket Reader #1 for port 8020: readAndProcess from client 10.0.0.210 threw exception [org.apache.hadoop.security.authorize.AuthorizationException: User dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-212-145-161.us-west-2.compute.amazonaws.com@HDP.LOCAL] 2017-09-27 08:59:04,602 INFO ipc.Server (Server.java:saslProcess(1504)) - Auth successful for dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:59:04,603 WARN authorize.ServiceAuthorizationManager (ServiceAuthorizationManager.java:authorize(119)) - Authorization failed for dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) for protocol=interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-214-181-219.us-west-2.compute.amazonaws.com@HDP.LOCAL 2017-09-27 08:59:04,603 INFO ipc.Server (Server.java:authorizeConnection(2161)) - Connection from 10.0.0.212:59189 for protocol org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol is unauthorized for user dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:59:04,603 INFO ipc.Server (Server.java:doRead(949)) - Socket Reader #1 for port 8020: readAndProcess from client 10.0.0.212 threw exception [org.apache.hadoop.security.authorize.AuthorizationException: User dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-214-181-219.us-west-2.compute.amazonaws.com@HDP.LOCAL] 2017-09-27 08:59:09,333 INFO ipc.Server (Server.java:saslProcess(1504)) - Auth successful for dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:59:09,333 WARN authorize.ServiceAuthorizationManager (ServiceAuthorizationManager.java:authorize(119)) - Authorization failed for dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) for protocol=interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-212-145-161.us-west-2.compute.amazonaws.com@HDP.LOCAL 2017-09-27 08:59:09,333 INFO ipc.Server (Server.java:authorizeConnection(2161)) - Connection from 10.0.0.210:55361 for protocol org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol is unauthorized for user dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:59:09,333 INFO ipc.Server (Server.java:doRead(949)) - Socket Reader #1 for port 8020: readAndProcess from client 10.0.0.210 threw exception [org.apache.hadoop.security.authorize.AuthorizationException: User dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-212-145-161.us-west-2.compute.amazonaws.com@HDP.LOCAL] 2017-09-27 08:59:09,607 INFO ipc.Server (Server.java:saslProcess(1504)) - Auth successful for dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:59:09,608 WARN authorize.ServiceAuthorizationManager (ServiceAuthorizationManager.java:authorize(119)) - Authorization failed for dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) for protocol=interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-214-181-219.us-west-2.compute.amazonaws.com@HDP.LOCAL 2017-09-27 08:59:09,608 INFO ipc.Server (Server.java:authorizeConnection(2161)) - Connection from 10.0.0.212:57370 for protocol org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol is unauthorized for user dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:59:09,608 INFO ipc.Server (Server.java:doRead(949)) - Socket Reader #1 for port 8020: readAndProcess from client 10.0.0.212 threw exception [org.apache.hadoop.security.authorize.AuthorizationException: User dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-214-181-219.us-west-2.compute.amazonaws.com@HDP.LOCAL] 2017-09-27 08:59:11,318 WARN namenode.FSEditLog (JournalSet.java:selectInputStreams(280)) - Unable to determine input streams from QJM to [10.0.0.248:8485, 10.0.0.163:8485, 10.0.0.66:8485]. Skipping. org.apache.hadoop.hdfs.qjournal.client.QuorumException: Got too many exceptions to achieve quorum size 2/3. 1 successful responses: 10.0.0.163:8485: [[1,1533], [1534,2688], [2689,2732], [2733,2782], [2783,2826], [2827,2870], [2871,2920], [2921,2961], [2962,3005], [3006,3055], [3056,3099], [3100,3143], [3144,3193], [3194,3237], [3238,3281], [3282,3331], [3332,3375], [3376,3419], [3420,3469], [3470,3513], [3514,3557], [3558,3607], [3608,3651], [3652,3695], [3696,3745], [3746,3789], [3790,3833], [3834,3883], [3884,3927], [3928,3971], [3972,4021], [4022,4065], [4066,4109], [4110,4159], [4160,4203], [4204,4247], [4248,4297], [4298,4341], [4342,4379], [4380,4429], [4430,4473], [4474,4518], [4519,4529]] 2 exceptions thrown: 10.0.0.66:8485: User nn/standbynamenode-t5liwl46t1.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.qjournal.protocol.QJournalProtocol, expected client Kerberos principal is nn/ec2-34-208-160-33.us-west-2.compute.amazonaws.com@HDP.LOCAL 10.0.0.248:8485: User nn/standbynamenode-t5liwl46t1.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.qjournal.protocol.QJournalProtocol, expected client Kerberos principal is nn/ec2-34-208-160-33.us-west-2.compute.amazonaws.com@HDP.LOCAL at org.apache.hadoop.hdfs.qjournal.client.QuorumException.create(QuorumException.java:81) at org.apache.hadoop.hdfs.qjournal.client.QuorumCall.rethrowException(QuorumCall.java:223) at org.apache.hadoop.hdfs.qjournal.client.AsyncLoggerSet.waitForWriteQuorum(AsyncLoggerSet.java:142) at org.apache.hadoop.hdfs.qjournal.client.QuorumJournalManager.selectInputStreams(QuorumJournalManager.java:471) at org.apache.hadoop.hdfs.server.namenode.JournalSet.selectInputStreams(JournalSet.java:278) at org.apache.hadoop.hdfs.server.namenode.FSEditLog.selectInputStreams(FSEditLog.java:1520) at org.apache.hadoop.hdfs.server.namenode.FSEditLog.selectInputStreams(FSEditLog.java:1544) at org.apache.hadoop.hdfs.server.namenode.ha.EditLogTailer.doTailEdits(EditLogTailer.java:214) at org.apache.hadoop.hdfs.server.namenode.ha.EditLogTailer$EditLogTailerThread.doWork(EditLogTailer.java:331) at org.apache.hadoop.hdfs.server.namenode.ha.EditLogTailer$EditLogTailerThread.access$200(EditLogTailer.java:284) at org.apache.hadoop.hdfs.server.namenode.ha.EditLogTailer$EditLogTailerThread$1.run(EditLogTailer.java:301) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:360) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1704) at org.apache.hadoop.security.SecurityUtil.doAsLoginUserOrFatal(SecurityUtil.java:447) at org.apache.hadoop.hdfs.server.namenode.ha.EditLogTailer$EditLogTailerThread.run(EditLogTailer.java:297) 2017-09-27 08:59:14,337 INFO ipc.Server (Server.java:saslProcess(1504)) - Auth successful for dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:59:14,338 WARN authorize.ServiceAuthorizationManager (ServiceAuthorizationManager.java:authorize(119)) - Authorization failed for dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) for protocol=interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-212-145-161.us-west-2.compute.amazonaws.com@HDP.LOCAL 2017-09-27 08:59:14,338 INFO ipc.Server (Server.java:authorizeConnection(2161)) - Connection from 10.0.0.210:40530 for protocol org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol is unauthorized for user dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:59:14,338 INFO ipc.Server (Server.java:doRead(949)) - Socket Reader #1 for port 8020: readAndProcess from client 10.0.0.210 threw exception [org.apache.hadoop.security.authorize.AuthorizationException: User dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-212-145-161.us-west-2.compute.amazonaws.com@HDP.LOCAL] 2017-09-27 08:59:14,612 INFO ipc.Server (Server.java:saslProcess(1504)) - Auth successful for dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:59:14,614 WARN authorize.ServiceAuthorizationManager (ServiceAuthorizationManager.java:authorize(119)) - Authorization failed for dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) for protocol=interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-214-181-219.us-west-2.compute.amazonaws.com@HDP.LOCAL 2017-09-27 08:59:14,614 INFO ipc.Server (Server.java:authorizeConnection(2161)) - Connection from 10.0.0.212:59181 for protocol org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol is unauthorized for user dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:59:14,614 INFO ipc.Server (Server.java:doRead(949)) - Socket Reader #1 for port 8020: readAndProcess from client 10.0.0.212 threw exception [org.apache.hadoop.security.authorize.AuthorizationException: User dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-214-181-219.us-west-2.compute.amazonaws.com@HDP.LOCAL] 2017-09-27 08:59:19,344 INFO ipc.Server (Server.java:saslProcess(1504)) - Auth successful for dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:59:19,345 WARN authorize.ServiceAuthorizationManager (ServiceAuthorizationManager.java:authorize(119)) - Authorization failed for dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) for protocol=interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-212-145-161.us-west-2.compute.amazonaws.com@HDP.LOCAL 2017-09-27 08:59:19,345 INFO ipc.Server (Server.java:authorizeConnection(2161)) - Connection from 10.0.0.210:53815 for protocol org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol is unauthorized for user dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 08:59:19,345 INFO ipc.Server (Server.java:doRead(949)) - Socket Reader #1 for port 8020: readAndProcess from client 10.0.0.210 threw exception [org.apache.hadoop.security.authorize.AuthorizationException: User dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-212-145-161.us-west-2.compute.amazonaws.com@HDP.LOCAL] 2017-09-27 09:00:04,417 WARN authorize.ServiceAuthorizationManager (ServiceAuthorizationManager.java:authorize(119)) - Authorization failed for dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) for protocol=interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-212-145-161.us-west-2.compute.amazonaws.com@HDP.LOCAL 2017-09-27 09:00:04,417 INFO ipc.Server (Server.java:authorizeConnection(2161)) - Connection from 10.0.0.210:47699 for protocol org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol is unauthorized for user dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 09:00:04,417 INFO ipc.Server (Server.java:doRead(949)) - Socket Reader #1 for port 8020: readAndProcess from client 10.0.0.210 threw exception [org.apache.hadoop.security.authorize.AuthorizationException: User dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-212-145-161.us-west-2.compute.amazonaws.com@HDP.LOCAL] 2017-09-27 09:00:04,734 INFO ipc.Server (Server.java:saslProcess(1504)) - Auth successful for dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 09:00:04,735 WARN authorize.ServiceAuthorizationManager (ServiceAuthorizationManager.java:authorize(119)) - Authorization failed for dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) for protocol=interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-214-181-219.us-west-2.compute.amazonaws.com@HDP.LOCAL 2017-09-27 09:00:04,735 INFO ipc.Server (Server.java:authorizeConnection(2161)) - Connection from 10.0.0.212:33978 for protocol org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol is unauthorized for user dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 09:00:04,735 INFO ipc.Server (Server.java:doRead(949)) - Socket Reader #1 for port 8020: readAndProcess from client 10.0.0.212 threw exception [org.apache.hadoop.security.authorize.AuthorizationException: User dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-214-181-219.us-west-2.compute.amazonaws.com@HDP.LOCAL] 2017-09-27 09:00:09,421 INFO ipc.Server (Server.java:saslProcess(1504)) - Auth successful for dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 09:00:09,422 WARN authorize.ServiceAuthorizationManager (ServiceAuthorizationManager.java:authorize(119)) - Authorization failed for dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) for protocol=interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-212-145-161.us-west-2.compute.amazonaws.com@HDP.LOCAL 2017-09-27 09:00:09,422 INFO ipc.Server (Server.java:authorizeConnection(2161)) - Connection from 10.0.0.210:33282 for protocol org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol is unauthorized for user dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 09:00:09,422 INFO ipc.Server (Server.java:doRead(949)) - Socket Reader #1 for port 8020: readAndProcess from client 10.0.0.210 threw exception [org.apache.hadoop.security.authorize.AuthorizationException: User dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-212-145-161.us-west-2.compute.amazonaws.com@HDP.LOCAL] 2017-09-27 09:00:09,740 INFO ipc.Server (Server.java:saslProcess(1504)) - Auth successful for dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 09:00:09,741 WARN authorize.ServiceAuthorizationManager (ServiceAuthorizationManager.java:authorize(119)) - Authorization failed for dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) for protocol=interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-214-181-219.us-west-2.compute.amazonaws.com@HDP.LOCAL 2017-09-27 09:00:09,741 INFO ipc.Server (Server.java:authorizeConnection(2161)) - Connection from 10.0.0.212:34973 for protocol org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol is unauthorized for user dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 09:00:09,741 INFO ipc.Server (Server.java:doRead(949)) - Socket Reader #1 for port 8020: readAndProcess from client 10.0.0.212 threw exception [org.apache.hadoop.security.authorize.AuthorizationException: User dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-214-181-219.us-west-2.compute.amazonaws.com@HDP.LOCAL] 2017-09-27 09:00:11,350 WARN namenode.FSEditLog (JournalSet.java:selectInputStreams(280)) - Unable to determine input streams from QJM to [10.0.0.248:8485, 10.0.0.163:8485, 10.0.0.66:8485]. Skipping. org.apache.hadoop.hdfs.qjournal.client.QuorumException: Got too many exceptions to achieve quorum size 2/3. 1 successful responses: 10.0.0.163:8485: [[1,1533], [1534,2688], [2689,2732], [2733,2782], [2783,2826], [2827,2870], [2871,2920], [2921,2961], [2962,3005], [3006,3055], [3056,3099], [3100,3143], [3144,3193], [3194,3237], [3238,3281], [3282,3331], [3332,3375], [3376,3419], [3420,3469], [3470,3513], [3514,3557], [3558,3607], [3608,3651], [3652,3695], [3696,3745], [3746,3789], [3790,3833], [3834,3883], [3884,3927], [3928,3971], [3972,4021], [4022,4065], [4066,4109], [4110,4159], [4160,4203], [4204,4247], [4248,4297], [4298,4341], [4342,4379], [4380,4429], [4430,4473], [4474,4518], [4519,4529]] 2 exceptions thrown: 10.0.0.66:8485: User nn/standbynamenode-t5liwl46t1.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.qjournal.protocol.QJournalProtocol, expected client Kerberos principal is nn/ec2-34-208-160-33.us-west-2.compute.amazonaws.com@HDP.LOCAL 10.0.0.248:8485: User nn/standbynamenode-t5liwl46t1.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.qjournal.protocol.QJournalProtocol, expected client Kerberos principal is nn/ec2-34-208-160-33.us-west-2.compute.amazonaws.com@HDP.LOCAL at org.apache.hadoop.hdfs.qjournal.client.QuorumException.create(QuorumException.java:81) at org.apache.hadoop.hdfs.qjournal.client.QuorumCall.rethrowException(QuorumCall.java:223) at org.apache.hadoop.hdfs.qjournal.client.AsyncLoggerSet.waitForWriteQuorum(AsyncLoggerSet.java:142) at org.apache.hadoop.hdfs.qjournal.client.QuorumJournalManager.selectInputStreams(QuorumJournalManager.java:471) at org.apache.hadoop.hdfs.server.namenode.JournalSet.selectInputStreams(JournalSet.java:278) at org.apache.hadoop.hdfs.server.namenode.FSEditLog.selectInputStreams(FSEditLog.java:1520) at org.apache.hadoop.hdfs.server.namenode.FSEditLog.selectInputStreams(FSEditLog.java:1544) at org.apache.hadoop.hdfs.server.namenode.ha.EditLogTailer.doTailEdits(EditLogTailer.java:214) at org.apache.hadoop.hdfs.server.namenode.ha.EditLogTailer$EditLogTailerThread.doWork(EditLogTailer.java:331) at org.apache.hadoop.hdfs.server.namenode.ha.EditLogTailer$EditLogTailerThread.access$200(EditLogTailer.java:284) at org.apache.hadoop.hdfs.server.namenode.ha.EditLogTailer$EditLogTailerThread$1.run(EditLogTailer.java:301) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:360) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1704) at org.apache.hadoop.security.SecurityUtil.doAsLoginUserOrFatal(SecurityUtil.java:447) at org.apache.hadoop.hdfs.server.namenode.ha.EditLogTailer$EditLogTailerThread.run(EditLogTailer.java:297) 2017-09-27 09:00:14,427 INFO ipc.Server (Server.java:saslProcess(1504)) - Auth successful for dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 09:00:14,428 WARN authorize.ServiceAuthorizationManager (ServiceAuthorizationManager.java:authorize(119)) - Authorization failed for dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) for protocol=interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-212-145-161.us-west-2.compute.amazonaws.com@HDP.LOCAL 2017-09-27 09:00:14,428 INFO ipc.Server (Server.java:authorizeConnection(2161)) - Connection from 10.0.0.210:54842 for protocol org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol is unauthorized for user dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 09:00:14,428 INFO ipc.Server (Server.java:doRead(949)) - Socket Reader #1 for port 8020: readAndProcess from client 10.0.0.210 threw exception [org.apache.hadoop.security.authorize.AuthorizationException: User dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-212-145-161.us-west-2.compute.amazonaws.com@HDP.LOCAL] 2017-09-27 09:00:14,744 INFO ipc.Server (Server.java:saslProcess(1504)) - Auth successful for dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 09:00:14,746 WARN authorize.ServiceAuthorizationManager (ServiceAuthorizationManager.java:authorize(119)) - Authorization failed for dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) for protocol=interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-214-181-219.us-west-2.compute.amazonaws.com@HDP.LOCAL 2017-09-27 09:00:14,746 INFO ipc.Server (Server.java:authorizeConnection(2161)) - Connection from 10.0.0.212:37611 for protocol org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol is unauthorized for user dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 09:00:14,746 INFO ipc.Server (Server.java:doRead(949)) - Socket Reader #1 for port 8020: readAndProcess from client 10.0.0.212 threw exception [org.apache.hadoop.security.authorize.AuthorizationException: User dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-214-181-219.us-west-2.compute.amazonaws.com@HDP.LOCAL] 2017-09-27 09:00:19,434 INFO ipc.Server (Server.java:saslProcess(1504)) - Auth successful for dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 09:00:19,435 WARN authorize.ServiceAuthorizationManager (ServiceAuthorizationManager.java:authorize(119)) - Authorization failed for dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) for protocol=interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-212-145-161.us-west-2.compute.amazonaws.com@HDP.LOCAL 2017-09-27 09:00:19,435 INFO ipc.Server (Server.java:authorizeConnection(2161)) - Connection from 10.0.0.210:33714 for protocol org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol is unauthorized for user dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 09:00:19,435 INFO ipc.Server (Server.java:doRead(949)) - Socket Reader #1 for port 8020: readAndProcess from client 10.0.0.210 threw exception [org.apache.hadoop.security.authorize.AuthorizationException: User dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-212-145-161.us-west-2.compute.amazonaws.com@HDP.LOCAL] 2017-09-27 09:00:19,749 INFO ipc.Server (Server.java:saslProcess(1504)) - Auth successful for dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 09:00:19,750 WARN authorize.ServiceAuthorizationManager (ServiceAuthorizationManager.java:authorize(119)) - Authorization failed for dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) for protocol=interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-214-181-219.us-west-2.compute.amazonaws.com@HDP.LOCAL 2017-09-27 09:00:19,750 INFO ipc.Server (Server.java:authorizeConnection(2161)) - Connection from 10.0.0.212:49875 for protocol org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol is unauthorized for user dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 09:00:19,750 INFO ipc.Server (Server.java:doRead(949)) - Socket Reader #1 for port 8020: readAndProcess from client 10.0.0.212 threw exception [org.apache.hadoop.security.authorize.AuthorizationException: User dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-214-181-219.us-west-2.compute.amazonaws.com@HDP.LOCAL] 2017-09-27 09:00:24,440 INFO ipc.Server (Server.java:saslProcess(1504)) - Auth successful for dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 09:00:24,441 WARN authorize.ServiceAuthorizationManager (ServiceAuthorizationManager.java:authorize(119)) - Authorization failed for dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) for protocol=interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-212-145-161.us-west-2.compute.amazonaws.com@HDP.LOCAL 2017-09-27 09:00:24,441 INFO ipc.Server (Server.java:authorizeConnection(2161)) - Connection from 10.0.0.210:44507 for protocol org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol is unauthorized for user dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 09:00:24,441 INFO ipc.Server (Server.java:doRead(949)) - Socket Reader #1 for port 8020: readAndProcess from client 10.0.0.210 threw exception [org.apache.hadoop.security.authorize.AuthorizationException: User dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-212-145-161.us-west-2.compute.amazonaws.com@HDP.LOCAL] 2017-09-27 09:00:24,754 INFO ipc.Server (Server.java:saslProcess(1504)) - Auth successful for dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 09:00:24,755 WARN authorize.ServiceAuthorizationManager (ServiceAuthorizationManager.java:authorize(119)) - Authorization failed for dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) for protocol=interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-214-181-219.us-west-2.compute.amazonaws.com@HDP.LOCAL 2017-09-27 09:00:24,755 INFO ipc.Server (Server.java:authorizeConnection(2161)) - Connection from 10.0.0.212:36625 for protocol org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol is unauthorized for user dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 09:00:24,755 INFO ipc.Server (Server.java:doRead(949)) - Socket Reader #1 for port 8020: readAndProcess from client 10.0.0.212 threw exception [org.apache.hadoop.security.authorize.AuthorizationException: User dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-214-181-219.us-west-2.compute.amazonaws.com@HDP.LOCAL] 2017-09-27 09:00:29,444 INFO ipc.Server (Server.java:saslProcess(1504)) - Auth successful for dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 09:00:29,445 WARN authorize.ServiceAuthorizationManager (ServiceAuthorizationManager.java:authorize(119)) - Authorization failed for dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) for protocol=interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-212-145-161.us-west-2.compute.amazonaws.com@HDP.LOCAL 2017-09-27 09:00:29,445 INFO ipc.Server (Server.java:authorizeConnection(2161)) - Connection from 10.0.0.210:35641 for protocol org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol is unauthorized for user dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 09:00:29,445 INFO ipc.Server (Server.java:doRead(949)) - Socket Reader #1 for port 8020: readAndProcess from client 10.0.0.210 threw exception [org.apache.hadoop.security.authorize.AuthorizationException: User dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-212-145-161.us-west-2.compute.amazonaws.com@HDP.LOCAL] 2017-09-27 09:01:04,500 WARN authorize.ServiceAuthorizationManager (ServiceAuthorizationManager.java:authorize(119)) - Authorization failed for dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) for protocol=interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-212-145-161.us-west-2.compute.amazonaws.com@HDP.LOCAL 2017-09-27 09:01:04,500 INFO ipc.Server (Server.java:authorizeConnection(2161)) - Connection from 10.0.0.210:46558 for protocol org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol is unauthorized for user dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 09:01:04,500 INFO ipc.Server (Server.java:doRead(949)) - Socket Reader #1 for port 8020: readAndProcess from client 10.0.0.210 threw exception [org.apache.hadoop.security.authorize.AuthorizationException: User dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-212-145-161.us-west-2.compute.amazonaws.com@HDP.LOCAL] 2017-09-27 09:01:04,797 INFO ipc.Server (Server.java:saslProcess(1504)) - Auth successful for dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 09:01:04,798 WARN authorize.ServiceAuthorizationManager (ServiceAuthorizationManager.java:authorize(119)) - Authorization failed for dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) for protocol=interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-214-181-219.us-west-2.compute.amazonaws.com@HDP.LOCAL 2017-09-27 09:01:04,798 INFO ipc.Server (Server.java:authorizeConnection(2161)) - Connection from 10.0.0.212:46204 for protocol org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol is unauthorized for user dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 09:01:04,798 INFO ipc.Server (Server.java:doRead(949)) - Socket Reader #1 for port 8020: readAndProcess from client 10.0.0.212 threw exception [org.apache.hadoop.security.authorize.AuthorizationException: User dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-214-181-219.us-west-2.compute.amazonaws.com@HDP.LOCAL] 2017-09-27 09:01:09,505 INFO ipc.Server (Server.java:saslProcess(1504)) - Auth successful for dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 09:01:09,506 WARN authorize.ServiceAuthorizationManager (ServiceAuthorizationManager.java:authorize(119)) - Authorization failed for dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) for protocol=interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-212-145-161.us-west-2.compute.amazonaws.com@HDP.LOCAL 2017-09-27 09:01:09,506 INFO ipc.Server (Server.java:authorizeConnection(2161)) - Connection from 10.0.0.210:58522 for protocol org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol is unauthorized for user dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 09:01:09,506 INFO ipc.Server (Server.java:doRead(949)) - Socket Reader #1 for port 8020: readAndProcess from client 10.0.0.210 threw exception [org.apache.hadoop.security.authorize.AuthorizationException: User dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-212-145-161.us-west-2.compute.amazonaws.com@HDP.LOCAL] 2017-09-27 09:01:09,801 INFO ipc.Server (Server.java:saslProcess(1504)) - Auth successful for dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 09:01:09,802 WARN authorize.ServiceAuthorizationManager (ServiceAuthorizationManager.java:authorize(119)) - Authorization failed for dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) for protocol=interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-214-181-219.us-west-2.compute.amazonaws.com@HDP.LOCAL 2017-09-27 09:01:09,802 INFO ipc.Server (Server.java:authorizeConnection(2161)) - Connection from 10.0.0.212:47231 for protocol org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol is unauthorized for user dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 09:01:09,802 INFO ipc.Server (Server.java:doRead(949)) - Socket Reader #1 for port 8020: readAndProcess from client 10.0.0.212 threw exception [org.apache.hadoop.security.authorize.AuthorizationException: User dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-214-181-219.us-west-2.compute.amazonaws.com@HDP.LOCAL] 2017-09-27 09:01:11,404 WARN namenode.FSEditLog (JournalSet.java:selectInputStreams(280)) - Unable to determine input streams from QJM to [10.0.0.248:8485, 10.0.0.163:8485, 10.0.0.66:8485]. Skipping. org.apache.hadoop.hdfs.qjournal.client.QuorumException: Got too many exceptions to achieve quorum size 2/3. 1 successful responses: 10.0.0.163:8485: [[1,1533], [1534,2688], [2689,2732], [2733,2782], [2783,2826], [2827,2870], [2871,2920], [2921,2961], [2962,3005], [3006,3055], [3056,3099], [3100,3143], [3144,3193], [3194,3237], [3238,3281], [3282,3331], [3332,3375], [3376,3419], [3420,3469], [3470,3513], [3514,3557], [3558,3607], [3608,3651], [3652,3695], [3696,3745], [3746,3789], [3790,3833], [3834,3883], [3884,3927], [3928,3971], [3972,4021], [4022,4065], [4066,4109], [4110,4159], [4160,4203], [4204,4247], [4248,4297], [4298,4341], [4342,4379], [4380,4429], [4430,4473], [4474,4518], [4519,4529]] 2 exceptions thrown: 10.0.0.66:8485: User nn/standbynamenode-t5liwl46t1.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.qjournal.protocol.QJournalProtocol, expected client Kerberos principal is nn/ec2-34-208-160-33.us-west-2.compute.amazonaws.com@HDP.LOCAL 10.0.0.248:8485: User nn/standbynamenode-t5liwl46t1.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.qjournal.protocol.QJournalProtocol, expected client Kerberos principal is nn/ec2-34-208-160-33.us-west-2.compute.amazonaws.com@HDP.LOCAL at org.apache.hadoop.hdfs.qjournal.client.QuorumException.create(QuorumException.java:81) at org.apache.hadoop.hdfs.qjournal.client.QuorumCall.rethrowException(QuorumCall.java:223) at org.apache.hadoop.hdfs.qjournal.client.AsyncLoggerSet.waitForWriteQuorum(AsyncLoggerSet.java:142) at org.apache.hadoop.hdfs.qjournal.client.QuorumJournalManager.selectInputStreams(QuorumJournalManager.java:471) at org.apache.hadoop.hdfs.server.namenode.JournalSet.selectInputStreams(JournalSet.java:278) at org.apache.hadoop.hdfs.server.namenode.FSEditLog.selectInputStreams(FSEditLog.java:1520) at org.apache.hadoop.hdfs.server.namenode.FSEditLog.selectInputStreams(FSEditLog.java:1544) at org.apache.hadoop.hdfs.server.namenode.ha.EditLogTailer.doTailEdits(EditLogTailer.java:214) at org.apache.hadoop.hdfs.server.namenode.ha.EditLogTailer$EditLogTailerThread.doWork(EditLogTailer.java:331) at org.apache.hadoop.hdfs.server.namenode.ha.EditLogTailer$EditLogTailerThread.access$200(EditLogTailer.java:284) at org.apache.hadoop.hdfs.server.namenode.ha.EditLogTailer$EditLogTailerThread$1.run(EditLogTailer.java:301) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:360) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1704) at org.apache.hadoop.security.SecurityUtil.doAsLoginUserOrFatal(SecurityUtil.java:447) at org.apache.hadoop.hdfs.server.namenode.ha.EditLogTailer$EditLogTailerThread.run(EditLogTailer.java:297) 2017-09-27 09:01:14,510 INFO ipc.Server (Server.java:saslProcess(1504)) - Auth successful for dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 09:01:14,511 WARN authorize.ServiceAuthorizationManager (ServiceAuthorizationManager.java:authorize(119)) - Authorization failed for dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) for protocol=interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-212-145-161.us-west-2.compute.amazonaws.com@HDP.LOCAL 2017-09-27 09:01:14,511 INFO ipc.Server (Server.java:authorizeConnection(2161)) - Connection from 10.0.0.210:39048 for protocol org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol is unauthorized for user dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 09:01:14,511 INFO ipc.Server (Server.java:doRead(949)) - Socket Reader #1 for port 8020: readAndProcess from client 10.0.0.210 threw exception [org.apache.hadoop.security.authorize.AuthorizationException: User dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-212-145-161.us-west-2.compute.amazonaws.com@HDP.LOCAL] 2017-09-27 09:01:14,806 INFO ipc.Server (Server.java:saslProcess(1504)) - Auth successful for dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 09:01:14,807 WARN authorize.ServiceAuthorizationManager (ServiceAuthorizationManager.java:authorize(119)) - Authorization failed for dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) for protocol=interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-214-181-219.us-west-2.compute.amazonaws.com@HDP.LOCAL 2017-09-27 09:01:14,807 INFO ipc.Server (Server.java:authorizeConnection(2161)) - Connection from 10.0.0.212:54779 for protocol org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol is unauthorized for user dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 09:01:14,807 INFO ipc.Server (Server.java:doRead(949)) - Socket Reader #1 for port 8020: readAndProcess from client 10.0.0.212 threw exception [org.apache.hadoop.security.authorize.AuthorizationException: User dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-214-181-219.us-west-2.compute.amazonaws.com@HDP.LOCAL] 2017-09-27 09:01:19,531 INFO ipc.Server (Server.java:saslProcess(1504)) - Auth successful for dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 09:01:19,532 WARN authorize.ServiceAuthorizationManager (ServiceAuthorizationManager.java:authorize(119)) - Authorization failed for dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) for protocol=interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-212-145-161.us-west-2.compute.amazonaws.com@HDP.LOCAL 2017-09-27 09:01:19,532 INFO ipc.Server (Server.java:authorizeConnection(2161)) - Connection from 10.0.0.210:52958 for protocol org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol is unauthorized for user dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 09:01:19,532 INFO ipc.Server (Server.java:doRead(949)) - Socket Reader #1 for port 8020: readAndProcess from client 10.0.0.210 threw exception [org.apache.hadoop.security.authorize.AuthorizationException: User dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-212-145-161.us-west-2.compute.amazonaws.com@HDP.LOCAL] 2017-09-27 09:01:19,811 INFO ipc.Server (Server.java:saslProcess(1504)) - Auth successful for dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 09:01:19,811 WARN authorize.ServiceAuthorizationManager (ServiceAuthorizationManager.java:authorize(119)) - Authorization failed for dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) for protocol=interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-214-181-219.us-west-2.compute.amazonaws.com@HDP.LOCAL 2017-09-27 09:01:19,811 INFO ipc.Server (Server.java:authorizeConnection(2161)) - Connection from 10.0.0.212:57047 for protocol org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol is unauthorized for user dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 09:01:19,812 INFO ipc.Server (Server.java:doRead(949)) - Socket Reader #1 for port 8020: readAndProcess from client 10.0.0.212 threw exception [org.apache.hadoop.security.authorize.AuthorizationException: User dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-214-181-219.us-west-2.compute.amazonaws.com@HDP.LOCAL] 2017-09-27 09:01:24,538 INFO ipc.Server (Server.java:saslProcess(1504)) - Auth successful for dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 09:01:24,539 WARN authorize.ServiceAuthorizationManager (ServiceAuthorizationManager.java:authorize(119)) - Authorization failed for dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) for protocol=interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-212-145-161.us-west-2.compute.amazonaws.com@HDP.LOCAL 2017-09-27 09:01:24,539 INFO ipc.Server (Server.java:authorizeConnection(2161)) - Connection from 10.0.0.210:43895 for protocol org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol is unauthorized for user dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 09:01:24,539 INFO ipc.Server (Server.java:doRead(949)) - Socket Reader #1 for port 8020: readAndProcess from client 10.0.0.210 threw exception [org.apache.hadoop.security.authorize.AuthorizationException: User dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-212-145-161.us-west-2.compute.amazonaws.com@HDP.LOCAL] 2017-09-27 09:01:24,815 INFO ipc.Server (Server.java:saslProcess(1504)) - Auth successful for dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 09:01:24,817 WARN authorize.ServiceAuthorizationManager (ServiceAuthorizationManager.java:authorize(119)) - Authorization failed for dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) for protocol=interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-214-181-219.us-west-2.compute.amazonaws.com@HDP.LOCAL 2017-09-27 09:01:24,817 INFO ipc.Server (Server.java:authorizeConnection(2161)) - Connection from 10.0.0.212:37029 for protocol org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol is unauthorized for user dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 09:01:24,817 INFO ipc.Server (Server.java:doRead(949)) - Socket Reader #1 for port 8020: readAndProcess from client 10.0.0.212 threw exception [org.apache.hadoop.security.authorize.AuthorizationException: User dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-214-181-219.us-west-2.compute.amazonaws.com@HDP.LOCAL] 2017-09-27 09:01:29,543 INFO ipc.Server (Server.java:saslProcess(1504)) - Auth successful for dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 09:01:29,544 WARN authorize.ServiceAuthorizationManager (ServiceAuthorizationManager.java:authorize(119)) - Authorization failed for dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) for protocol=interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-212-145-161.us-west-2.compute.amazonaws.com@HDP.LOCAL 2017-09-27 09:01:29,544 INFO ipc.Server (Server.java:authorizeConnection(2161)) - Connection from 10.0.0.210:33943 for protocol org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol is unauthorized for user dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 09:01:29,544 INFO ipc.Server (Server.java:doRead(949)) - Socket Reader #1 for port 8020: readAndProcess from client 10.0.0.210 threw exception [org.apache.hadoop.security.authorize.AuthorizationException: User dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-212-145-161.us-west-2.compute.amazonaws.com@HDP.LOCAL] 2017-09-27 09:01:29,822 INFO ipc.Server (Server.java:saslProcess(1504)) - Auth successful for dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 09:01:29,822 WARN authorize.ServiceAuthorizationManager (ServiceAuthorizationManager.java:authorize(119)) - Authorization failed for dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) for protocol=interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-214-181-219.us-west-2.compute.amazonaws.com@HDP.LOCAL 2017-09-27 09:01:29,823 INFO ipc.Server (Server.java:authorizeConnection(2161)) - Connection from 10.0.0.212:56868 for protocol org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol is unauthorized for user dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 09:01:29,823 INFO ipc.Server (Server.java:doRead(949)) - Socket Reader #1 for port 8020: readAndProcess from client 10.0.0.212 threw exception [org.apache.hadoop.security.authorize.AuthorizationException: User dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-214-181-219.us-west-2.compute.amazonaws.com@HDP.LOCAL] 2017-09-27 09:01:34,548 INFO ipc.Server (Server.java:saslProcess(1504)) - Auth successful for dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 09:01:34,549 WARN authorize.ServiceAuthorizationManager (ServiceAuthorizationManager.java:authorize(119)) - Authorization failed for dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) for protocol=interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-212-145-161.us-west-2.compute.amazonaws.com@HDP.LOCAL 2017-09-27 09:01:34,549 INFO ipc.Server (Server.java:authorizeConnection(2161)) - Connection from 10.0.0.210:42924 for protocol org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol is unauthorized for user dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 09:01:34,549 INFO ipc.Server (Server.java:doRead(949)) - Socket Reader #1 for port 8020: readAndProcess from client 10.0.0.210 threw exception [org.apache.hadoop.security.authorize.AuthorizationException: User dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-212-145-161.us-west-2.compute.amazonaws.com@HDP.LOCAL] 2017-09-27 09:01:34,827 INFO ipc.Server (Server.java:saslProcess(1504)) - Auth successful for dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 09:01:34,827 WARN authorize.ServiceAuthorizationManager (ServiceAuthorizationManager.java:authorize(119)) - Authorization failed for dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) for protocol=interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-214-181-219.us-west-2.compute.amazonaws.com@HDP.LOCAL 2017-09-27 09:01:34,828 INFO ipc.Server (Server.java:authorizeConnection(2161)) - Connection from 10.0.0.212:47264 for protocol org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol is unauthorized for user dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 09:01:34,828 INFO ipc.Server (Server.java:doRead(949)) - Socket Reader #1 for port 8020: readAndProcess from client 10.0.0.212 threw exception [org.apache.hadoop.security.authorize.AuthorizationException: User dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-214-181-219.us-west-2.compute.amazonaws.com@HDP.LOCAL] 2017-09-27 09:01:39,553 INFO ipc.Server (Server.java:saslProcess(1504)) - Auth successful for dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 09:01:39,554 WARN authorize.ServiceAuthorizationManager (ServiceAuthorizationManager.java:authorize(119)) - Authorization failed for dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) for protocol=interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-212-145-161.us-west-2.compute.amazonaws.com@HDP.LOCAL 2017-09-27 09:01:39,554 INFO ipc.Server (Server.java:authorizeConnection(2161)) - Connection from 10.0.0.210:55483 for protocol org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol is unauthorized for user dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 09:01:39,554 INFO ipc.Server (Server.java:doRead(949)) - Socket Reader #1 for port 8020: readAndProcess from client 10.0.0.210 threw exception [org.apache.hadoop.security.authorize.AuthorizationException: User dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-212-145-161.us-west-2.compute.amazonaws.com@HDP.LOCAL] 2017-09-27 09:01:39,832 INFO ipc.Server (Server.java:saslProcess(1504)) - Auth successful for dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 09:01:39,833 WARN authorize.ServiceAuthorizationManager (ServiceAuthorizationManager.java:authorize(119)) - Authorization failed for dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) for protocol=interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-214-181-219.us-west-2.compute.amazonaws.com@HDP.LOCAL 2017-09-27 09:01:39,833 INFO ipc.Server (Server.java:authorizeConnection(2161)) - Connection from 10.0.0.212:34622 for protocol org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol is unauthorized for user dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 09:01:39,833 INFO ipc.Server (Server.java:doRead(949)) - Socket Reader #1 for port 8020: readAndProcess from client 10.0.0.212 threw exception [org.apache.hadoop.security.authorize.AuthorizationException: User dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-214-181-219.us-west-2.compute.amazonaws.com@HDP.LOCAL] 2017-09-27 09:01:44,558 INFO ipc.Server (Server.java:saslProcess(1504)) - Auth successful for dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 09:01:44,558 WARN authorize.ServiceAuthorizationManager (ServiceAuthorizationManager.java:authorize(119)) - Authorization failed for dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) for protocol=interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-212-145-161.us-west-2.compute.amazonaws.com@HDP.LOCAL 2017-09-27 09:01:44,558 INFO ipc.Server (Server.java:authorizeConnection(2161)) - Connection from 10.0.0.210:52146 for protocol org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol is unauthorized for user dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 09:01:44,559 INFO ipc.Server (Server.java:doRead(949)) - Socket Reader #1 for port 8020: readAndProcess from client 10.0.0.210 threw exception [org.apache.hadoop.security.authorize.AuthorizationException: User dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-212-145-161.us-west-2.compute.amazonaws.com@HDP.LOCAL] 2017-09-27 09:01:44,837 INFO ipc.Server (Server.java:saslProcess(1504)) - Auth successful for dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 09:01:44,838 WARN authorize.ServiceAuthorizationManager (ServiceAuthorizationManager.java:authorize(119)) - Authorization failed for dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) for protocol=interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-214-181-219.us-west-2.compute.amazonaws.com@HDP.LOCAL 2017-09-27 09:01:44,838 INFO ipc.Server (Server.java:authorizeConnection(2161)) - Connection from 10.0.0.212:55255 for protocol org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol is unauthorized for user dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 09:01:44,838 INFO ipc.Server (Server.java:doRead(949)) - Socket Reader #1 for port 8020: readAndProcess from client 10.0.0.212 threw exception [org.apache.hadoop.security.authorize.AuthorizationException: User dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-214-181-219.us-west-2.compute.amazonaws.com@HDP.LOCAL] 2017-09-27 09:01:49,571 INFO ipc.Server (Server.java:saslProcess(1504)) - Auth successful for dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 09:01:49,578 WARN authorize.ServiceAuthorizationManager (ServiceAuthorizationManager.java:authorize(119)) - Authorization failed for dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) for protocol=interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-212-145-161.us-west-2.compute.amazonaws.com@HDP.LOCAL 2017-09-27 09:01:49,578 INFO ipc.Server (Server.java:authorizeConnection(2161)) - Connection from 10.0.0.210:54365 for protocol org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol is unauthorized for user dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 09:01:49,578 INFO ipc.Server (Server.java:doRead(949)) - Socket Reader #1 for port 8020: readAndProcess from client 10.0.0.210 threw exception [org.apache.hadoop.security.authorize.AuthorizationException: User dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-212-145-161.us-west-2.compute.amazonaws.com@HDP.LOCAL] 2017-09-27 09:01:49,842 INFO ipc.Server (Server.java:saslProcess(1504)) - Auth successful for dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 09:01:49,843 WARN authorize.ServiceAuthorizationManager (ServiceAuthorizationManager.java:authorize(119)) - Authorization failed for dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) for protocol=interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-214-181-219.us-west-2.compute.amazonaws.com@HDP.LOCAL 2017-09-27 09:01:49,843 INFO ipc.Server (Server.java:authorizeConnection(2161)) - Connection from 10.0.0.212:48229 for protocol org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol is unauthorized for user dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 09:01:49,843 INFO ipc.Server (Server.java:doRead(949)) - Socket Reader #1 for port 8020: readAndProcess from client 10.0.0.212 threw exception [org.apache.hadoop.security.authorize.AuthorizationException: User dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-214-181-219.us-west-2.compute.amazonaws.com@HDP.LOCAL] 2017-09-27 09:01:54,582 INFO ipc.Server (Server.java:saslProcess(1504)) - Auth successful for dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 09:01:54,584 WARN authorize.ServiceAuthorizationManager (ServiceAuthorizationManager.java:authorize(119)) - Authorization failed for dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) for protocol=interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-212-145-161.us-west-2.compute.amazonaws.com@HDP.LOCAL 2017-09-27 09:01:54,584 INFO ipc.Server (Server.java:authorizeConnection(2161)) - Connection from 10.0.0.210:59489 for protocol org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol is unauthorized for user dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 09:01:54,585 INFO ipc.Server (Server.java:doRead(949)) - Socket Reader #1 for port 8020: readAndProcess from client 10.0.0.210 threw exception [org.apache.hadoop.security.authorize.AuthorizationException: User dn/scalabledatanode-jgs7uio7eq.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-212-145-161.us-west-2.compute.amazonaws.com@HDP.LOCAL] 2017-09-27 09:01:54,858 INFO ipc.Server (Server.java:saslProcess(1504)) - Auth successful for dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 09:01:54,867 WARN authorize.ServiceAuthorizationManager (ServiceAuthorizationManager.java:authorize(119)) - Authorization failed for dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) for protocol=interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-214-181-219.us-west-2.compute.amazonaws.com@HDP.LOCAL 2017-09-27 09:01:54,867 INFO ipc.Server (Server.java:authorizeConnection(2161)) - Connection from 10.0.0.212:42566 for protocol org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol is unauthorized for user dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) 2017-09-27 09:01:54,868 INFO ipc.Server (Server.java:doRead(949)) - Socket Reader #1 for port 8020: readAndProcess from client 10.0.0.212 threw exception [org.apache.hadoop.security.authorize.AuthorizationException: User dn/scalabledatanode-cp5dqotv0y.hdp.local@HDP.LOCAL (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol, expected client Kerberos principal is dn/ec2-34-214-181-219.us-west-2.compute.amazonaws.com@HDP.LOCAL] 2017-09-27 09:02:02,269 ERROR namenode.NameNode (LogAdapter.java:error(71)) - RECEIVED SIGNAL 15: SIGTERM 2017-09-27 09:02:02,271 INFO namenode.NameNode (LogAdapter.java:info(47)) - SHUTDOWN_MSG: /************************************************************ SHUTDOWN_MSG: Shutting down NameNode at standbynamenode-t5liwl46t1.hdp.local/10.0.0.163 ************************************************************/