Support Questions

Find answers, ask questions, and share your expertise

Hadoop Namenode hdfs.distro file referring to old version of hadoop, (HDP 2.5.3)

New Contributor

am getting an issue where the namenode does not start. While reviewing the log, I am finding that the hdfs.distro file is searching for an older install of hadoop (I had earlier installed the sas deployment of hadoop and wanted to move from the SAS version to HDP). This is the message I am getting: 2017-04-12 15:25:48,741 - Retrying after 10 seconds. Reason: Execution of '/usr/hdp/current/hadoop-hdfs-namenode/bin/hdfs dfsadmin -fs hdfs://hparhel01.hpa.essanalysis.com:8020 -safemode get | grep 'Safe mode is OFF'' returned 1. /usr/hdp/2.5.3.0-37//hadoop-hdfs/bin/hdfs.distro: line 39: /opt/sas/hadoop/hadoop-2.4.0/libexec/hdfs-config.sh: No such file or directory

where the hdfs.distro file is looking for /opt/sas/hadoop/hadoop-2.4.0/libexec/hdfs-config.sh.

I have deleted the /opt/sas/hadoop and reinstalled Ambari and Hadoop but I am still getting the same issue. Any suggestions on how the reference to the old hadoop version can be removed?

5 REPLIES 5

Master Collaborator

Can you search your HDFS configs from Ambari UI?

New Contributor

Deepesh thanks for your message. I looked at the HDFS configs from Ambari UI - I don't see any reference to /opt/sas/hadoop in the Settings or the Advanced section.

Guru

Your softlinks might be pointing to an old location: See this from your ambari server and check if the binaries are pointing to the correct location

ls -lrth /usr/hdp/current

Guru

Can you check the softlinks under /usr/hdp from your ambari server, see if you have a current folder and what its pointing to..

[centos@xlnode-standalone hdp]$ ls -lrth /usr/hdp/current | head
total 0
lrwxrwxrwx 1 root root 27 Apr 13 04:46 falcon-client -> /usr/hdp/2.4.3.0-227/falcon
lrwxrwxrwx 1 root root 26 Apr 13 04:46 atlas-server -> /usr/hdp/2.4.3.0-227/atlas
lrwxrwxrwx 1 root root 29 Apr 13 04:46 accumulo-tracer -> /usr/hdp/2.4.3.0-227/accumulo
lrwxrwxrwx 1 root root 29 Apr 13 04:46 accumulo-tablet -> /usr/hdp/2.4.3.0-227/accumulo
lrwxrwxrwx 1 root root 29 Apr 13 04:46 accumulo-monitor -> /usr/hdp/2.4.3.0-227/accumulo
lrwxrwxrwx 1 root root 29 Apr 13 04:46 accumulo-master -> /usr/hdp/2.4.3.0-227/accumulo
lrwxrwxrwx 1 root root 29 Apr 13 04:46 accumulo-gc -> /usr/hdp/2.4.3.0-227/accumulo
lrwxrwxrwx 1 root root 29 Apr 13 04:46 accumulo-client -> /usr/hdp/2.4.3.0-227/accumulo
lrwxrwxrwx 1 root root 24 Apr 13 04:46 tez-client -> /usr/hdp/2.4.3.0-227/tez

If its pointing to a old version, then we should fix it.

New Contributor

Checked the softlinks under /usr/hdp. They appear to be pointing to the correct folders:

[root@HPARHEL01 ~]# ls -lrth /usr/hdp/current |head
total 0
lrwxrwxrwx. 1 root root 25 Apr 12 17:08 atlas-client -> /usr/hdp/2.5.3.0-37/atlas
lrwxrwxrwx. 1 root root 28 Apr 12 17:08 accumulo-tracer -> /usr/hdp/2.5.3.0-37/accumulo
lrwxrwxrwx. 1 root root 28 Apr 12 17:08 accumulo-tablet -> /usr/hdp/2.5.3.0-37/accumulo
lrwxrwxrwx. 1 root root 28 Apr 12 17:08 accumulo-monitor -> /usr/hdp/2.5.3.0-37/accumulo
lrwxrwxrwx. 1 root root 28 Apr 12 17:08 accumulo-master -> /usr/hdp/2.5.3.0-37/accumulo
lrwxrwxrwx. 1 root root 28 Apr 12 17:08 accumulo-gc -> /usr/hdp/2.5.3.0-37/accumulo
lrwxrwxrwx. 1 root root 28 Apr 12 17:08 accumulo-client -> /usr/hdp/2.5.3.0-37/accumulo
lrwxrwxrwx. 1 root root 31 Apr 12 17:08 hadoop-yarn-client -> /usr/hdp/2.5.3.0-37/hadoop-yarn
lrwxrwxrwx. 1 root root 31 Apr 12 17:08 hadoop-hdfs-client -> /usr/hdp/2.5.3.0-37/hadoop-hdfs