Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

NiFi installation through ambari failing

NiFi installation through ambari failing

Rising Star

I am trying to install 2 node NiFi cluster using Ambari. I was following this doc.

At the time of deployement of the HDF components, its failing. More specifically following tasks are failing

Infra Solr Instance Install

Traceback (most recent call last):
  File "/var/lib/ambari-agent/cache/common-services/AMBARI_INFRA/0.1.0/package/scripts/infra_solr.py", line 110, in <module>
    InfraSolr().execute()
  File "/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py", line 280, in execute
    method(env)
  File "/var/lib/ambari-agent/cache/common-services/AMBARI_INFRA/0.1.0/package/scripts/infra_solr.py", line 34, in install
    self.install_packages(env)
  File "/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py", line 567, in install_packages
    retry_count=agent_stack_retry_count)
  File "/usr/lib/python2.6/site-packages/resource_management/core/base.py", line 155, in __init__
    self.env.run()
  File "/usr/lib/python2.6/site-packages/resource_management/core/environment.py", line 160, in run
    self.run_action(resource, action)
  File "/usr/lib/python2.6/site-packages/resource_management/core/environment.py", line 124, in run_action
    provider_action()
  File "/usr/lib/python2.6/site-packages/resource_management/core/providers/package/__init__.py", line 54, in action_install
    self.install_package(package_name, self.resource.use_repos, self.resource.skip_repos)
  File "/usr/lib/python2.6/site-packages/resource_management/core/providers/package/yumrpm.py", line 49, in install_package
    self.checked_call_with_retries(cmd, sudo=True, logoutput=self.get_logoutput())
  File "/usr/lib/python2.6/site-packages/resource_management/core/providers/package/__init__.py", line 83, in checked_call_with_retries
    return self._call_with_retries(cmd, is_checked=True, **kwargs)
  File "/usr/lib/python2.6/site-packages/resource_management/core/providers/package/__init__.py", line 91, in _call_with_retries
    code, out = func(cmd, **kwargs)
  File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", line 71, in inner
    result = function(command, **kwargs)
  File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", line 93, in checked_call
    tries=tries, try_sleep=try_sleep)
  File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", line 141, in _call_wrapper
    result = _call(command, **kwargs_copy)
  File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", line 294, in _call
    raise Fail(err_msg)
resource_management.core.exceptions.Fail: Execution of '/usr/bin/yum -d 0 -e 0 -y install ambari-infra-solr-client' returned 1. Error: Nothing to dostdout:   /var/lib/ambari-agent/data/output-202.txt
2016-11-18 18:38:52,578 - Group['hadoop'] {}
2016-11-18 18:38:52,580 - Group['nifi'] {}
2016-11-18 18:38:52,580 - User['logsearch'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': [u'hadoop']}
2016-11-18 18:38:52,581 - User['infra-solr'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': [u'hadoop']}
2016-11-18 18:38:52,581 - User['zookeeper'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': [u'hadoop']}
2016-11-18 18:38:52,582 - User['ams'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': [u'hadoop']}
2016-11-18 18:38:52,582 - User['ambari-qa'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': ['users']}
2016-11-18 18:38:52,583 - User['nifi'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': [u'nifi']}
2016-11-18 18:38:52,583 - File['/var/lib/ambari-agent/tmp/changeUid.sh'] {'content': StaticFile('changeToSecureUid.sh'), 'mode': 0555}
2016-11-18 18:38:52,585 - Execute['/var/lib/ambari-agent/tmp/changeUid.sh ambari-qa /tmp/hadoop-ambari-qa,/tmp/hsperfdata_ambari-qa,/home/ambari-qa,/tmp/ambari-qa,/tmp/sqoop-ambari-qa'] {'not_if': '(test $(id -u ambari-qa) -gt 1000) || (false)'}
2016-11-18 18:38:52,589 - Skipping Execute['/var/lib/ambari-agent/tmp/changeUid.sh ambari-qa /tmp/hadoop-ambari-qa,/tmp/hsperfdata_ambari-qa,/home/ambari-qa,/tmp/ambari-qa,/tmp/sqoop-ambari-qa'] due to not_if
2016-11-18 18:38:52,598 - Initializing 2 repositories
2016-11-18 18:38:52,600 - Repository['HDF-2.0'] {'base_url': 'http://public-repo-1.hortonworks.com/HDF/centos7/2.x/updates/2.0.1.0', 'action': ['create'], 'components': [u'HDF', 'main'], 'repo_template': '[{{repo_id}}]\nname={{repo_id}}\n{% if mirror_list %}mirrorlist={{mirror_list}}{% else %}baseurl={{base_url}}{% endif %}\n\npath=/\nenabled=1\ngpgcheck=0', 'repo_file_name': 'HDF', 'mirror_list': None}
2016-11-18 18:38:52,607 - File['/etc/yum.repos.d/HDF.repo'] {'content': '[HDF-2.0]\nname=HDF-2.0\nbaseurl=http://public-repo-1.hortonworks.com/HDF/centos7/2.x/updates/2.0.1.0\n\npath=/\nenabled=1\ngpgcheck=0'}
2016-11-18 18:38:52,608 - Repository['HDP-UTILS-1.1.0.21'] {'base_url': 'http://public-repo-1.hortonworks.com/HDP-UTILS-1.1.0.21/repos/centos7', 'action': ['create'], 'components': [u'HDP-UTILS', 'main'], 'repo_template': '[{{repo_id}}]\nname={{repo_id}}\n{% if mirror_list %}mirrorlist={{mirror_list}}{% else %}baseurl={{base_url}}{% endif %}\n\npath=/\nenabled=1\ngpgcheck=0', 'repo_file_name': 'HDP-UTILS', 'mirror_list': None}
2016-11-18 18:38:52,610 - File['/etc/yum.repos.d/HDP-UTILS.repo'] {'content': '[HDP-UTILS-1.1.0.21]\nname=HDP-UTILS-1.1.0.21\nbaseurl=http://public-repo-1.hortonworks.com/HDP-UTILS-1.1.0.21/repos/centos7\n\npath=/\nenabled=1\ngpgcheck=0'}
2016-11-18 18:38:52,610 - Package['unzip'] {'retry_on_repo_unavailability': False, 'retry_count': 5}
2016-11-18 18:38:53,347 - Skipping installation of existing package unzip
2016-11-18 18:38:53,347 - Package['curl'] {'retry_on_repo_unavailability': False, 'retry_count': 5}
2016-11-18 18:38:53,356 - Skipping installation of existing package curl
2016-11-18 18:38:53,357 - Package['hdf-select'] {'retry_on_repo_unavailability': False, 'retry_count': 5}
2016-11-18 18:38:53,365 - Skipping installation of existing package hdf-select
2016-11-18 18:38:53,499 - Package['ambari-infra-solr-client'] {'retry_on_repo_unavailability': False, 'retry_count': 5}
2016-11-18 18:38:53,562 - Installing package ambari-infra-solr-client ('/usr/bin/yum -d 0 -e 0 -y install ambari-infra-solr-client')

Command failed after 1 tries

Infra Solr Client Install

Traceback (most recent call last):
  File "/var/lib/ambari-agent/cache/common-services/AMBARI_INFRA/0.1.0/package/scripts/infra_solr_client.py", line 51, in <module>
    InfraSolrClient().execute()
  File "/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py", line 280, in execute
    method(env)
  File "/var/lib/ambari-agent/cache/common-services/AMBARI_INFRA/0.1.0/package/scripts/infra_solr_client.py", line 29, in install
    self.install_packages(env)
  File "/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py", line 567, in install_packages
    retry_count=agent_stack_retry_count)
  File "/usr/lib/python2.6/site-packages/resource_management/core/base.py", line 155, in __init__
    self.env.run()
  File "/usr/lib/python2.6/site-packages/resource_management/core/environment.py", line 160, in run
    self.run_action(resource, action)
  File "/usr/lib/python2.6/site-packages/resource_management/core/environment.py", line 124, in run_action
    provider_action()
  File "/usr/lib/python2.6/site-packages/resource_management/core/providers/package/__init__.py", line 54, in action_install
    self.install_package(package_name, self.resource.use_repos, self.resource.skip_repos)
  File "/usr/lib/python2.6/site-packages/resource_management/core/providers/package/yumrpm.py", line 49, in install_package
    self.checked_call_with_retries(cmd, sudo=True, logoutput=self.get_logoutput())
  File "/usr/lib/python2.6/site-packages/resource_management/core/providers/package/__init__.py", line 83, in checked_call_with_retries
    return self._call_with_retries(cmd, is_checked=True, **kwargs)
  File "/usr/lib/python2.6/site-packages/resource_management/core/providers/package/__init__.py", line 91, in _call_with_retries
    code, out = func(cmd, **kwargs)
  File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", line 71, in inner
    result = function(command, **kwargs)
  File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", line 93, in checked_call
    tries=tries, try_sleep=try_sleep)
  File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", line 141, in _call_wrapper
    result = _call(command, **kwargs_copy)
  File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", line 294, in _call
    raise Fail(err_msg)
resource_management.core.exceptions.Fail: Execution of '/usr/bin/yum -d 0 -e 0 -y install ambari-infra-solr-client' returned 1. Error: Nothing to dostdout:   /var/lib/ambari-agent/data/output-203.txt
2016-11-18 18:38:55,368 - Group['hadoop'] {}
2016-11-18 18:38:55,369 - Group['nifi'] {}
2016-11-18 18:38:55,369 - User['logsearch'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': [u'hadoop']}
2016-11-18 18:38:55,369 - User['infra-solr'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': [u'hadoop']}
2016-11-18 18:38:55,370 - User['zookeeper'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': [u'hadoop']}
2016-11-18 18:38:55,370 - User['ams'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': [u'hadoop']}
2016-11-18 18:38:55,371 - User['ambari-qa'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': ['users']}
2016-11-18 18:38:55,371 - User['nifi'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': [u'nifi']}
2016-11-18 18:38:55,372 - File['/var/lib/ambari-agent/tmp/changeUid.sh'] {'content': StaticFile('changeToSecureUid.sh'), 'mode': 0555}
2016-11-18 18:38:55,373 - Execute['/var/lib/ambari-agent/tmp/changeUid.sh ambari-qa /tmp/hadoop-ambari-qa,/tmp/hsperfdata_ambari-qa,/home/ambari-qa,/tmp/ambari-qa,/tmp/sqoop-ambari-qa'] {'not_if': '(test $(id -u ambari-qa) -gt 1000) || (false)'}
2016-11-18 18:38:55,376 - Skipping Execute['/var/lib/ambari-agent/tmp/changeUid.sh ambari-qa /tmp/hadoop-ambari-qa,/tmp/hsperfdata_ambari-qa,/home/ambari-qa,/tmp/ambari-qa,/tmp/sqoop-ambari-qa'] due to not_if
2016-11-18 18:38:55,387 - Initializing 2 repositories
2016-11-18 18:38:55,389 - Repository['HDF-2.0'] {'base_url': 'http://public-repo-1.hortonworks.com/HDF/centos7/2.x/updates/2.0.1.0', 'action': ['create'], 'components': [u'HDF', 'main'], 'repo_template': '[{{repo_id}}]\nname={{repo_id}}\n{% if mirror_list %}mirrorlist={{mirror_list}}{% else %}baseurl={{base_url}}{% endif %}\n\npath=/\nenabled=1\ngpgcheck=0', 'repo_file_name': 'HDF', 'mirror_list': None}
2016-11-18 18:38:55,394 - File['/etc/yum.repos.d/HDF.repo'] {'content': '[HDF-2.0]\nname=HDF-2.0\nbaseurl=http://public-repo-1.hortonworks.com/HDF/centos7/2.x/updates/2.0.1.0\n\npath=/\nenabled=1\ngpgcheck=0'}
2016-11-18 18:38:55,395 - Repository['HDP-UTILS-1.1.0.21'] {'base_url': 'http://public-repo-1.hortonworks.com/HDP-UTILS-1.1.0.21/repos/centos7', 'action': ['create'], 'components': [u'HDP-UTILS', 'main'], 'repo_template': '[{{repo_id}}]\nname={{repo_id}}\n{% if mirror_list %}mirrorlist={{mirror_list}}{% else %}baseurl={{base_url}}{% endif %}\n\npath=/\nenabled=1\ngpgcheck=0', 'repo_file_name': 'HDP-UTILS', 'mirror_list': None}
2016-11-18 18:38:55,397 - File['/etc/yum.repos.d/HDP-UTILS.repo'] {'content': '[HDP-UTILS-1.1.0.21]\nname=HDP-UTILS-1.1.0.21\nbaseurl=http://public-repo-1.hortonworks.com/HDP-UTILS-1.1.0.21/repos/centos7\n\npath=/\nenabled=1\ngpgcheck=0'}
2016-11-18 18:38:55,397 - Package['unzip'] {'retry_on_repo_unavailability': False, 'retry_count': 5}
2016-11-18 18:38:55,457 - Skipping installation of existing package unzip
2016-11-18 18:38:55,457 - Package['curl'] {'retry_on_repo_unavailability': False, 'retry_count': 5}
2016-11-18 18:38:55,465 - Skipping installation of existing package curl
2016-11-18 18:38:55,465 - Package['hdf-select'] {'retry_on_repo_unavailability': False, 'retry_count': 5}
2016-11-18 18:38:55,473 - Skipping installation of existing package hdf-select
2016-11-18 18:38:55,625 - Package['ambari-infra-solr-client'] {'retry_on_repo_unavailability': False, 'retry_count': 5}
2016-11-18 18:38:55,688 - Installing package ambari-infra-solr-client ('/usr/bin/yum -d 0 -e 0 -y install ambari-infra-solr-client')

Command failed after 1 tries

I also tried to install these packages manually, but got

[root@hdf1 ~]# yum -y install ambari-infra-solr-client
Loaded plugins: fastestmirror, langpacks
Loading mirror speeds from cached hostfile
No package ambari-infra-solr-client available.
Error: Nothing to do
[root@hdf1 ~]#

I do have following repos on all three VM's

/etc/yum.repos.d/HDP-UTILS.repo

[HDP-UTILS-1.1.0.21]
name=HDP-UTILS-1.1.0.21
baseurl=http://public-repo-1.hortonworks.com/HDP-UTILS-1.1.0.21/repos/centos7
path=/
enabled=1

/etc/yum.repos.d/HDF.repo

[HDF-2.0]
name=HDF-2.0
baseurl=http://public-repo-1.hortonworks.com/HDF/centos7/2.x/updates/2.0.1.0
path=/
enabled=1

Anyone know whats wrong here ?

1 REPLY 1

Re: NiFi installation through ambari failing

Guru

Do you have the ambari.repo defined on that host? That packages can be resolved in the Ambari 2.4.x repositories.