Reply
Expert Contributor
Posts: 263
Registered: ‎01-25-2017

Unable to Start DataNode in kerberos cluster

Hi Guys,

 

I'm unable to start DataNode after enabling the kerberos in my cluster.

 

I tried all the suggested solutions in the community and Internet and without any success to solve it.

 

All other servers started and my cluster and node able to authinticate against the active directory.

 

Here the important confige in the HDFS:

 

dfs.datanode.http.address 1006
dfs.datanode.address 1004
hadoop.security.authentication kerberos
hadoop.security.authorization true
hadoop.rpc.protection authentication
Enable Kerberos Authentication for HTTP Web-Consoles true

 

and here is the log:

 

STARTUP_MSG:   java = 1.8.0_101
************************************************************/
2017-10-23 06:56:02,698 INFO org.apache.hadoop.hdfs.server.datanode.DataNode: registered UNIX signal handlers for [TERM, HUP, INT]
2017-10-23 06:56:03,449 INFO org.apache.hadoop.security.UserGroupInformation: Login successful for user hdfs/aopr-dhc001.lpdomain.com@LPDOMAIN.COM using keytab file hdfs.keytab
2017-10-23 06:56:03,812 INFO org.apache.hadoop.metrics2.impl.MetricsConfig: loaded properties from hadoop-metrics2.properties
2017-10-23 06:56:03,891 INFO org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Scheduled snapshot period at 10 second(s).
2017-10-23 06:56:03,891 INFO org.apache.hadoop.metrics2.impl.MetricsSystemImpl: DataNode metrics system started
2017-10-23 06:56:03,899 INFO org.apache.hadoop.hdfs.server.datanode.BlockScanner: Initialized block scanner with targetBytesPerSec 1048576
2017-10-23 06:56:03,900 INFO org.apache.hadoop.hdfs.server.datanode.DataNode: File descriptor passing is enabled.
2017-10-23 06:56:03,903 INFO org.apache.hadoop.hdfs.server.datanode.DataNode: Configured hostname is aopr-dhc001.lpdomain.com
2017-10-23 06:56:03,908 FATAL org.apache.hadoop.hdfs.server.datanode.DataNode: Exception in secureMain
java.lang.RuntimeException: Cannot start secure DataNode without configuring either privileged resources or SASL RPC data transfer protection and SSL for HTTP.  Using privileged resources in combination with SASL RPC data transfer protection is not supported.
at org.apache.hadoop.hdfs.server.datanode.DataNode.checkSecureConfig(DataNode.java:1371)
at org.apache.hadoop.hdfs.server.datanode.DataNode.startDataNode(DataNode.java:1271)
at org.apache.hadoop.hdfs.server.datanode.DataNode.<init>(DataNode.java:464)
at org.apache.hadoop.hdfs.server.datanode.DataNode.makeInstance(DataNode.java:2583)
at org.apache.hadoop.hdfs.server.datanode.DataNode.instantiateDataNode(DataNode.java:2470)
at org.apache.hadoop.hdfs.server.datanode.DataNode.createDataNode(DataNode.java:2517)
at org.apache.hadoop.hdfs.server.datanode.DataNode.secureMain(DataNode.java:2699)
at org.apache.hadoop.hdfs.server.datanode.DataNode.main(DataNode.java:2723)
2017-10-23 06:56:03,919 INFO org.apache.hadoop.util.ExitUtil: Exiting with status 1
2017-10-23 06:56:03,921 INFO org.apache.hadoop.hdfs.server.datanode.DataNode: SHUTDOWN_MSG:
/************************************************************
SHUTDOWN_MSG: Shutting down DataNode at aopr-dhc001.lpdomain.com/10.16.144.131
************************************************************/
2017-10-23 06:56:08,422 INFO org.apache.hadoop.hdfs.server.datanode.DataNode: STARTUP_MSG:
/************************************************************
STARTUP_MSG: Starting DataNode
STARTUP_MSG:   user = cloudera-scm
STARTUP_MSG:   args = []
STARTUP_MSG:   version = 2.6.0-cdh5.13.0=======================
Expert Contributor
Posts: 263
Registered: ‎01-25-2017

Re: Unable to Start DataNode in kerberos cluster

Any isight guys?

Highlighted
Expert Contributor
Posts: 263
Registered: ‎01-25-2017

Re: Unable to Start DataNode in kerberos cluster

Pleeeeeeeeeeeeeeeeeeeeeeeeeeeease help !!!!!!

Announcements