@Matthias Tewordt Are you using private and public IP's in the /etc/hosts? For inter-cluster communication you need to use private, Whats the value of empty-zones-enable in /etc/named.conf ... View more

@Matthias Tewordt I still don't see the gpl repo, run this on the Ambari server and repeat the yum repolist to validate wget -nv http://public-repo-1.hortonworks.com/HDP-GPL/centos6/2.x/updates/2.6.4.0/hdp.gpl.repo -O /etc/yum.repos.d/hdp.gpl.repo Forward lookup TEST # nslookup mtvm6.eastus.cloudapp.azure.com Reverse lookup TEST error # nslookup 40.117.251.23 Can you check your /etc/named.conf file disable by setting it to no empty-zones-enable no; Please revert ... View more

@Mike Wong The entries look correct 🙂 Can you try to start YARN manually? su -l yarn -c "/usr/hdp/current/hadoop-yarn-resourcemanager/sbin/yarn-daemon.sh start resourcemanager" ... View more

@Matthias Tewordt I don't see the hdp.gpl.repo in the output? It's used for LZO compression libraries. See this HCC article In my previous example I used as an example downloading to /tmp/hdp.repo you should replace it with /etc/yum.repos.d/ $ wget -nv http://public-repo-1.hortonworks.com/HDP/centos6/2.x/updates/2.6.4.0/hdp.repo -O /etc/yum.repos.d//hdp.repo I also saw in the logs the below entries any ideas? Else mv them to some directory like /tmp public-repo-1.hortonworks.com_HDP_centos7_2.x_updates_2.6.4.0_HDP-2.6.4.0-91.xml.repo public-repo-1.hortonworks.com_HDP-UTILS-1.1.0.22_repos_centos7.repo Then run in sequence # yum clean all # yum repolist You should see the repos, and from here you can proceed. Have you resolved the ssh from the ambari server to the other 2 nodes? Please correct your DNS before attempting Example for mtvm6.eastus.cloudapp.azure.com # nslookup 40.117.251.23 I assume you have the 3 nodes in all the /etc/hosts ... View more

@Matthias Tewordt Yes definitely that's why I wanted you to match my output to your OS version! The was also this error what is your processor? "cannot resolve OS centos7-ppc to the supported ones: suse12,suse11,redhat7,debian7,redhat6,ubuntu14,ubuntu12. Family: null" Please revert ... View more

@Mike Wong Can you past the whole /etc/hosts entry? I am interested in the first 4 lines ! You should have some lines like 127.0.0.1 localhost localhost.localdomain localhost4 localhost4.localdomain4 ::1 localhost localhost.localdomain localhost6 localhost6.localdomain6 Please confirm ... View more

@Matthias Tewordt That's quite bizarre in the logs you attached I see that Ambari is trying to load 2 different repos see below can you explain why? Centos6 Could not load version definition for HDP-2.6 identified by http://public-repo-1.hortonworks.com/HDP/centos6/2.x/updates/2.6.4.0/HDP-2.6.4.0-91.xml. null Centos7 Could not load version definition for HDP-2.6 identified by http://public-repo-1.hortonworks.com/HDP/centos7/2.x/updates/2.6.5.0/HDP-2.6.5.0-292.xml. null Check the current repos, you should see ambari,hdp and hdp-utils repos $ ll /etc/yum.repos.d/ Validate the contents and share their contents cat /etc/yum.repos.d/HDP.repo cat /etc/yum.repos.d/ambari.repo cat /etc/yum.repos.d/HDP-UTILS.repo Check the OS version in my case its a Centos6 so you can grab the correct repo cat /etc/redhat-release CentOS release 6.9 (Final) Delete the HDP and HDP-Utils repos in /etc/yum.repos.d rm -rf HDP* Clean the repos # yum clean all Validate, you shouldn't see HDP and HDP-Utils except for ambari.repo and some Centos stuff # yum repolist For Ambari version 2.5 and above see the choice(attached ambari-hdp-matrix.jpg) Download the correct HDP repos See OS version above in my case Centos 6, the hdp in HDP 2.6 delivers both HDP and HDP-Utils $ wget -nv http://public-repo-1.hortonworks.com/HDP/centos6/2.x/updates/2.6.4.0/hdp.repo -O /tmp/hdp.repo GPL repo $ wget -nv http://public-repo-1.hortonworks.com/HDP-GPL/centos6/2.x/updates/2.6.4.0/hdp.gpl.repo -O /tmp/hdp.gpl.repo After the above revalidate, you should be able to see new HDP*/ repos # yum repolist Now restart the cluster deployment ... View more

@Mike Wong Ping is not enough. I recommend checking the below settings on all the nodes in the cluster Disable and stop firewalld systemctl disable firewalld systemctl stop firewalld Status of Firewalld systemctl status firewalld Check DNS This should have the correct GW # route -n Disable SELinux sed -ie 's/enforcing/disabled/g' /etc/selinux/config Then retry ... View more

@Mike Wong Can you describe your cluster OS & node number? Is passwordless connect working? Your "data nodes have failed and are not registered with the name node", this is network problem. Is your DNS working can you validate? Your hostname in /etc/hosts shouldn't be mixed cases!!! Lowercase and FQDN ... View more

@Mike Wong Yes, your major source of the problem seems to be connectivity. Again just to validate can you walk through the steps you executed or documentation you used. Members tend to ignore basic steps that are vital. Could you also share or dig into the logs for most of the components in /var/log/{component}/*.log ... View more