Support Questions

Find answers, ask questions, and share your expertise

failed to format namenode dir: timed out

Explorer

ubuntu14.04

ClouderManager 5.12

I deployed the cluster and got error at this step: cluster settings.

start HDFS  ------->  format namenode dir failed :

Command aborted because of exception: Command timed-out after 90 seconds

$> hdfs/hdfs.sh ["format-namenode","cluster16"]

 

stdout :

 

Wed Aug 23 17:27:19 CST 2017
Current working directory: /run/cloudera-scm-agent/process/20-hdfs-NAMENODE-format
Launching one-off process: /usr/lib/cmf/service/hdfs/hdfs.sh format-namenode cluster16
Wed Aug 23 17:27:21 CST 2017
JAVA_HOME=/usr/lib/jvm/java-7-oracle-cloudera
using /usr/lib/jvm/java-7-oracle-cloudera as JAVA_HOME
using 5 as CDH_VERSION
using /run/cloudera-scm-agent/process/20-hdfs-NAMENODE-format as CONF_DIR
using as SECURE_USER
using as SECURE_GROUP
CONF_DIR=/run/cloudera-scm-agent/process/20-hdfs-NAMENODE-format
CMF_CONF_DIR=/etc/cloudera-scm-agent
unlimited

 

really really thank you ,if you could help 

I'm really really hopeless

5 REPLIES 5

Champion

Could you let me know if you are trying to perform single or multinode cluster ? 

Would you consider sharing the logs of  namenode 

/var/log/hadoop-hdfs/ 

looks like a permission error to me , it is not able to create directory . 

 

Explorer
no log output. multinode cluster. just the stdout I've given above
I use apt-get to install the ClouderManager,It would create the user: cloudera-scm automaticly .

Explorer

....oh god 

New Contributor
+ echo CONF_DIR=/var/run/cloudera-scm-agent/process/21-hdfs-NAMENODE-format
+ echo CMF_CONF_DIR=/etc/cloudera-scm-agent
+ EXCLUDE_CMF_FILES=('cloudera-config.sh' 'hue.sh' 'impala.sh' 'sqoop.sh' 'supervisor.conf' 'config.zip' 'proc.json' '*.log' '*.keytab' '*jceks')
++ printf '! -name %s ' cloudera-config.sh hue.sh impala.sh sqoop.sh supervisor.conf config.zip proc.json '*.log' hdfs.keytab '*jceks'
+ find /var/run/cloudera-scm-agent/process/21-hdfs-NAMENODE-format -type f '!' -path '/var/run/cloudera-scm-agent/process/21-hdfs-NAMENODE-format/logs/*' '!' -name cloudera-config.sh '!' -name hue.sh '!' -name impala.sh '!' -name sqoop.sh '!' -name supervisor.conf '!' -name config.zip '!' -name proc.json '!' -name '*.log' '!' -name hdfs.keytab '!' -name '*jceks' -exec perl -pi -e 's#{{CMF_CONF_DIR}}#/var/run/cloudera-scm-agent/process/21-hdfs-NAMENODE-format#g' '{}' ';'
+ make_scripts_executable
+ find /var/run/cloudera-scm-agent/process/21-hdfs-NAMENODE-format -regex '.*\.\(py\|sh\)$' -exec chmod u+x '{}' ';'
+ '[' DATANODE_MAX_LOCKED_MEMORY '!=' '' ']'
+ ulimit -l
+ export HADOOP_IDENT_STRING=hdfs
+ HADOOP_IDENT_STRING=hdfs
+ '[' -n '' ']'
+ '[' mkdir '!=' format-namenode ']'
+ acquire_kerberos_tgt hdfs.keytab
+ '[' -z hdfs.keytab ']'
+ '[' -n '' ']'
+ '[' validate-writable-empty-dirs = format-namenode ']'
+ '[' file-operation = format-namenode ']'
+ '[' bootstrap = format-namenode ']'
+ '[' failover = format-namenode ']'
+ '[' transition-to-active = format-namenode ']'
+ '[' initializeSharedEdits = format-namenode ']'
+ '[' initialize-znode = format-namenode ']'
+ '[' format-namenode = format-namenode ']'
+ '[' -z /dfs/nn ']'
+ for dfsdir in '$DFS_STORAGE_DIRS'
+ '[' -e /dfs/nn ']'
+ '[' '!' -d /dfs/nn ']'
+ CLUSTER_ARGS=
+ '[' 2 -eq 2 ']'
+ CLUSTER_ARGS='-clusterId cluster16'
+ '[' 3 = 5 ']'
+ '[' -3 = 5 ']'
+ exec /opt/cloudera/parcels/CDH-5.14.2-1.cdh5.14.2.p0.3/lib/hadoop-hdfs/bin/hdfs --config /var/run/cloudera-scm-agent/process/21-hdfs-NAMENODE-format namenode -format -clusterId cluster16 -nonInteractive

New Contributor

I am facing the same issue, I am installing on single node cluster