hi All, I would like share that this has been fixed by changing yarn-site.xml file. OLD Parameters - <code><property> <name>yarn.nodemanager.aux-services</name> <value>mapreduce_shuffle,spark_shuffle,spark2_shuffle</value> </property> New Parameters <property> <name>yarn.nodemanager.aux-services</name> <value>mapreduce_shuffle</value> </property> Please Note - this is for those users who has install Yarn+MRV2 and not for spark & spark 2. Thanks Pawan Giri ... View more

hi Team, This is pawan gir new to the hadoop world, m trying to install zookeeper on ambari server and its throwing below error. Hi Sir, I'm trying to install ambari agent on VMs but it has some issue, please help me to close this issue, PFB the error. stderr: /var/lib/ambari-agent/data/errors-35.txt Traceback (most recent call last): File "/var/lib/ambari-agent/cache/common-services/ZOOKEEPER/3.4.5.2.0/package/scripts/zookeeper_client.py", line 81, in <module> ZookeeperClient().execute() File "/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py", line 219, in execute method(env) File "/var/lib/ambari-agent/cache/common-services/ZOOKEEPER/3.4.5.2.0/package/scripts/zookeeper_client.py", line 60, in install self.install_packages(env) File "/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py", line 410, in install_packages retry_count=agent_stack_retry_count) File "/usr/lib/python2.6/site-packages/resource_management/core/base.py", line 154, in __init__ self.env.run() File "/usr/lib/python2.6/site-packages/resource_management/core/environment.py", line 160, in run self.run_action(resource, action) File "/usr/lib/python2.6/site-packages/resource_management/core/environment.py", line 124, in run_action provider_action() File "/usr/lib/python2.6/site-packages/resource_management/core/providers/package/__init__.py", line 54, in action_install self.install_package(package_name, self.resource.use_repos, self.resource.skip_repos) File "/usr/lib/python2.6/site-packages/resource_management/core/providers/package/yumrpm.py", line 49, in install_package self.checked_call_with_retries(cmd, sudo=True, logoutput=self.get_logoutput()) File "/usr/lib/python2.6/site-packages/resource_management/core/providers/package/__init__.py", line 83, in checked_call_with_retries return self._call_with_retries(cmd, is_checked=True, **kwargs) File "/usr/lib/python2.6/site-packages/resource_management/core/providers/package/__init__.py", line 91, in _call_with_retries code, out = func(cmd, **kwargs) File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", line 70, in inner result = function(command, **kwargs) File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", line 92, in checked_call tries=tries, try_sleep=try_sleep) File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", line 140, in _call_wrapper result = _call(command, **kwargs_copy) File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", line 291, in _call raise Fail(err_msg) resource_management.core.exceptions.Fail: Execution of '/usr/bin/yum -d 0 -e 0 -y install 'zookeeper_2_4_*'' returned 1. Error: Nothing to do stdout: /var/lib/ambari-agent/data/output-35.txt 2017-04-20 12:58:28,531 - Group['hadoop'] {} 2017-04-20 12:58:28,533 - User['zookeeper'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': ['hadoop']} 2017-04-20 12:58:28,535 - User['ams'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': ['hadoop']} 2017-04-20 12:58:28,536 - User['ambari-qa'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': ['users']} 2017-04-20 12:58:28,537 - File['/var/lib/ambari-agent/tmp/changeUid.sh'] {'content': StaticFile('changeToSecureUid.sh'), 'mode': 0555} 2017-04-20 12:58:28,540 - Execute['/var/lib/ambari-agent/tmp/changeUid.sh ambari-qa /tmp/hadoop-ambari-qa,/tmp/hsperfdata_ambari-qa,/home/ambari-qa,/tmp/ambari-qa,/tmp/sqoop-ambari-qa'] {'not_if': '(test $(id -u ambari-qa) -gt 1000) || (false)'} 2017-04-20 12:58:28,549 - Skipping Execute['/var/lib/ambari-agent/tmp/changeUid.sh ambari-qa /tmp/hadoop-ambari-qa,/tmp/hsperfdata_ambari-qa,/home/ambari-qa,/tmp/ambari-qa,/tmp/sqoop-ambari-qa'] due to not_if 2017-04-20 12:58:28,575 - Repository['HDP-2.4'] {'base_url': 'http://hdpserver.techmahindra.com/yum/HDP/centos6/2.x/updates/2.3.4.0', 'action': ['create'], 'components': ['HDP', 'main'], 'repo_template': '[{{repo_id}}]\nname={{repo_id}}\n{% if mirror_list %}mirrorlist={{mirror_list}}{% else %}baseurl={{base_url}}{% endif %}\n\npath=/\nenabled=1\ngpgcheck=0', 'repo_file_name': 'HDP', 'mirror_list': None} 2017-04-20 12:58:28,585 - File['/etc/yum.repos.d/HDP.repo'] {'content': '[HDP-2.4]\nname=HDP-2.4\nbaseurl=http://hdpserver.techmahindra.com/yum/HDP/centos6/2.x/updates/2.3.4.0\n\npath=/\nenabled=1\ngpgcheck=0'} 2017-04-20 12:58:28,588 - Repository['HDP-UTILS-1.1.0.20'] {'base_url': 'http://hdpserver.techmahindra.com/yum/HDP-UTILS-1.1.0.20/repos/centos6', 'action': ['create'], 'components': ['HDP-UTILS', 'main'], 'repo_template': '[{{repo_id}}]\nname={{repo_id}}\n{% if mirror_list %}mirrorlist={{mirror_list}}{% else %}baseurl={{base_url}}{% endif %}\n\npath=/\nenabled=1\ngpgcheck=0', 'repo_file_name': 'HDP-UTILS', 'mirror_list': None} 2017-04-20 12:58:28,594 - File['/etc/yum.repos.d/HDP-UTILS.repo'] {'content': '[HDP-UTILS-1.1.0.20]\nname=HDP-UTILS-1.1.0.20\nbaseurl=http://hdpserver.techmahindra.com/yum/HDP-UTILS-1.1.0.20/repos/centos6\n\npath=/\nenabled=1\ngpgcheck=0'} 2017-04-20 12:58:28,595 - Package['unzip'] {'retry_on_repo_unavailability': False, 'retry_count': 5} 2017-04-20 12:58:28,735 - Skipping installation of existing package unzip 2017-04-20 12:58:28,736 - Package['curl'] {'retry_on_repo_unavailability': False, 'retry_count': 5} 2017-04-20 12:58:28,755 - Skipping installation of existing package curl 2017-04-20 12:58:28,756 - Package['hdp-select'] {'retry_on_repo_unavailability': False, 'retry_count': 5} 2017-04-20 12:58:28,765 - Skipping installation of existing package hdp-select 2017-04-20 12:58:28,983 - Package['zookeeper_2_4_*'] {'retry_on_repo_unavailability': False, 'retry_count': 5} 2017-04-20 12:58:29,126 - Installing package zookeeper_2_4_* ('/usr/bin/yum -d 0 -e 0 -y install 'zookeeper_2_4_*'') please help me to debug this issue. Thanks Pawan Giri ... View more