After the hdp cluster was shut down because of maintenance now the metrics widgets are no longer displaying correctly. The Metrics Collector and the Metrics Monitors are running with no issues and the time seems to be in sync. So I have no real idea what could be the problem. Any help is very much appreciated. ... View more

@Rohit Sureka @Predrag Minovic I'm trying to install a 5 node hadoop cluster with HDP 2.3.4.7 on Ubuntu 14.04 using Ambari 2.2.0.0. During the 10th step of the Ambari "Cluster Install Wizard" the installation of the ZooKeeper client fails on one of the five nodes with the following stderr: "resource_management.core.exceptions.Fail: Applying Directory['/usr/hdp/current/zookeeper-client/conf'] failed, looped symbolic links found while resolving /usr/hdp/current/zookeeper-client/conf" During the earlier steps of the "Cluster Install Wizard" and prior to this error, I removed the packages "zlibc" and "xclip" from two hosts, one of them now failing the ZooKeeper installation, in oder to comply with warnings telling me to do so. But "apt-get remove zlibc" and "apt-get remove xclip" also removed the Ambari agents on these hosts. Therefore the installation process didn't finish the first time because the heartbeat of these to hosts got lost during the installation. So I reinstalled the Ambari agents on these hosts but ever since I get the error mentioned above. I hope someone can give me a hint or a solution. Thanks a lot. The full stderr reads like this: Traceback (most recent call last): File "/var/lib/ambari-agent/cache/common-services/ZOOKEEPER/3.4.5.2.0/package/scripts/zookeeper_client.py", line 81, in <module> ZookeeperClient().execute() File "/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py", line 219, in execute method(env) File "/var/lib/ambari-agent/cache/common-services/ZOOKEEPER/3.4.5.2.0/package/scripts/zookeeper_client.py", line 61, in install self.configure(env) File "/var/lib/ambari-agent/cache/common-services/ZOOKEEPER/3.4.5.2.0/package/scripts/zookeeper_client.py", line 37, in configure zookeeper(type='client') File "/usr/lib/python2.6/site-packages/ambari_commons/os_family_impl.py", line 89, in thunk return fn(*args, **kwargs) File "/var/lib/ambari-agent/cache/common-services/ZOOKEEPER/3.4.5.2.0/package/scripts/zookeeper.py", line 46, in zookeeper group=params.user_group File "/usr/lib/python2.6/site-packages/resource_management/core/base.py", line 154, in __init__ self.env.run() File "/usr/lib/python2.6/site-packages/resource_management/core/environment.py", line 158, in run self.run_action(resource, action) File "/usr/lib/python2.6/site-packages/resource_management/core/environment.py", line 121, in run_action provider_action() File "/usr/lib/python2.6/site-packages/resource_management/core/providers/system.py", line 144, in action_create raise Fail("Applying %s failed, looped symbolic links found while resolving %s" % (self.resource, path)) resource_management.core.exceptions.Fail: Applying Directory['/usr/hdp/current/zookeeper-client/conf'] failed, looped symbolic links found while resolving /usr/hdp/current/zookeeper-client/conf ... View more

@Rohit Sureka @Predrag Minovic I'm trying to install a 5 node hadoop cluster with HDP 2.3.4.7 on Ubuntu 14.04 using Ambari 2.2.0.0. In the "Ambari - Cluster Install Wizard" I left the default settings for the repository options during "Select Stack" unchanged (HDP-2.3: http://public-repo-1.hortonworks.com/HDP/ubuntu14/2.x/updates/2.3.4.7 and HDP-UTILS-1.1.0.20: http://public-repo-1.hortonworks.com/HDP-UTILS-1.1.0.20/repos/ubuntu12). But then I get the following warning during the "Confirm Hosts" Step: "W: Duplicate sources.list entry http://public-repo-1.hortonworks.com/ambari/ubuntu14/2.x/updates/2.2.0.0/ Ambari/main amd64 Packages (/var/lib/apt/lists/public-repo-1.hortonworks.com_ambari_ubuntu14_2.x_updates_2.2.0.0_dists_Ambari_main_binary-amd64_Packages) W: You may want to run apt-get update to correct these problems" Running apt-get update makes no difference. I can't see the duplicates in "sources.list" This results in a failure of the "Confirm Hosts" step for 4 out of the 5 nodes. The only node that doesn't fail during this step is the node with the Ambari Server itself. Any help would be really appreciated. _________________________ Here is the full Registration log: ========================== Creating target directory... ========================== Command start time 2016-05-03 10:55:04 Connection to sgscaiu0376.in623.corpintra.net closed. SSH command execution finished host=sgscaiu0376.in623.corpintra.net, exitcode=0 Command end time 2016-05-03 10:55:04 ========================== Copying common functions script... ========================== Command start time 2016-05-03 10:55:04 scp /usr/lib/python2.6/site-packages/ambari_commons host=sgscaiu0376.in623.corpintra.net, exitcode=0 Command end time 2016-05-03 10:55:05 ========================== Copying OS type check script... ========================== Command start time 2016-05-03 10:55:05 scp /usr/lib/python2.6/site-packages/ambari_server/os_check_type.py host=sgscaiu0376.in623.corpintra.net, exitcode=0 Command end time 2016-05-03 10:55:05 ========================== Running OS type check... ========================== Command start time 2016-05-03 10:55:05 Cluster primary/cluster OS family is ubuntu14 and local/current OS family is ubuntu14 Connection to sgscaiu0376.in623.corpintra.net closed. SSH command execution finished host=sgscaiu0376.in623.corpintra.net, exitcode=0 Command end time 2016-05-03 10:55:06 ========================== Checking 'sudo' package on remote host... ========================== Command start time 2016-05-03 10:55:06 sudo install Connection to sgscaiu0376.in623.corpintra.net closed. SSH command execution finished host=sgscaiu0376.in623.corpintra.net, exitcode=0 Command end time 2016-05-03 10:55:07 ========================== Copying repo file to 'tmp' folder... ========================== Command start time 2016-05-03 10:55:07 scp /etc/apt/sources.list.d/ambari.list host=sgscaiu0376.in623.corpintra.net, exitcode=0 Command end time 2016-05-03 10:55:07 ========================== Moving file to repo dir... ========================== Command start time 2016-05-03 10:55:07 Connection to sgscaiu0376.in623.corpintra.net closed. SSH command execution finished host=sgscaiu0376.in623.corpintra.net, exitcode=0 Command end time 2016-05-03 10:55:08 ========================== Changing permissions for ambari.repo... ========================== Command start time 2016-05-03 10:55:08 Connection to sgscaiu0376.in623.corpintra.net closed. SSH command execution finished host=sgscaiu0376.in623.corpintra.net, exitcode=0 Command end time 2016-05-03 10:55:08 ========================== Update apt cache of repository... ========================== Command start time 2016-05-03 10:55:08 0% [Working] 0% [Waiting for headers] Hit http://public-repo-1.hortonworks.com Ambari InRelease 0% [Working] 0% [InRelease gpgv 3,187 B] 33% [Working] Hit http://public-repo-1.hortonworks.com Ambari/main amd64 Packages 33% [Working] 100% [Waiting for headers] 100% [Waiting for headers] 100% [Waiting for headers] 100% [Waiting for headers] Ign http://public-repo-1.hortonworks.com Ambari/main Translation-en_IN 100% [Working] Ign http://public-repo-1.hortonworks.com Ambari/main Translation-en 100% [Working] Reading package lists... 0% Reading package lists... 0% Reading package lists... 0% Reading package lists... 0% Reading package lists... 14% Reading package lists... Done W: Duplicate sources.list entry http://public-repo-1.hortonworks.com/ambari/ubuntu14/2.x/updates/2.2.0.0/ Ambari/main amd64 Packages (/var/lib/apt/lists/public-repo-1.hortonworks.com_ambari_ubuntu14_2.x_updates_2.2.0.0_dists_Ambari_main_binary-amd64_Packages) W: You may want to run apt-get update to correct these problems Connection to sgscaiu0376.in623.corpintra.net closed. SSH command execution finished host=sgscaiu0376.in623.corpintra.net, exitcode=0 Command end time 2016-05-03 10:55:11 ========================== Copying setup script file... ========================== Command start time 2016-05-03 10:55:11 scp /usr/lib/python2.6/site-packages/ambari_server/setupAgent.py host=sgscaiu0376.in623.corpintra.net, exitcode=0 Command end time 2016-05-03 10:55:12 ========================== Running setup agent script... ========================== Command start time 2016-05-03 10:55:12 E: There are problems and -y was used without --force-yes E: There are problems and -y was used without --force-yes E: There are problems and -y was used without --force-yes ('Reading package lists... Building dependency tree... Reading state information... The following packages will be DOWNGRADED: ambari-agent 0 upgraded, 0 newly installed, 1 downgraded, 0 to remove and 49 not upgraded. Need to get 21.2 MB of archives. After this operation, 367 kB disk space will be freed. ', None) Connection to sgscaiu0376.in623.corpintra.net closed. SSH command execution finished host=sgscaiu0376.in623.corpintra.net, exitcode=100 Command end time 2016-05-03 10:55:37 ERROR: Bootstrap of host sgscaiu0376.in623.corpintra.net fails because previous action finished with non-zero exit code (100) ERROR MESSAGE: Connection to sgscaiu0376.in623.corpintra.net closed. STDOUT: E: There are problems and -y was used without --force-yes E: There are problems and -y was used without --force-yes E: There are problems and -y was used without --force-yes ('Reading package lists... Building dependency tree... Reading state information... The following packages will be DOWNGRADED: ambari-agent 0 upgraded, 0 newly installed, 1 downgraded, 0 to remove and 49 not upgraded. Need to get 21.2 MB of archives. After this operation, 367 kB disk space will be freed. ', None) Connection to sgscaiu0376.in623.corpintra.net closed. ... View more