Skip to main content
ilia987
Silver ⭐️⭐️⭐️
July 27, 2022
Question

add hosts for old version

 

HDP-3.1.0.0​
2022-07-28 00:19:45,289 - Package Manager failed to install packages: No package found for hive-${stack_version}(expected name: hive-3-1-0-0-78)
Traceback (most recent call last):
File "/var/lib/ambari-agent/cache/custom_actions/scripts/install_packages.py", line 486, in <module>
InstallPackages().execute()
File "/usr/lib/ambari-agent/lib/resource_management/libraries/script/script.py", line 352, in execute
method(env)
File "/var/lib/ambari-agent/cache/custom_actions/scripts/install_packages.py", line 149, in actionexecute
raise Fail("Failed to distribute repositories/install packages")
resource_management.core.exceptions.Fail: Failed to distribute repositories/install packages
stdout: /var/lib/ambari-agent/data/output-6991.txt

2022-07-28 00:18:33,442 - Will install packages for repository version 3.1.0.0-78
2022-07-28 00:18:33,443 - Repository['HDP-UTILS-1.1.0.22-repo-1'] {'base_url': 'http://public-repo-1.hortonworks.com/HDP-UTILS-1.1.0.22/repos/ubuntu18', 'action': ['prepare'], 'components': [u'HDP-UTILS', 'main'], 'repo_template': '{{package_type}} {{base_url}} {{components}}', 'repo_file_name': 'ambari-hdp-1', 'mirror_list': None}
2022-07-28 00:18:33,450 - Repository['HDP-3.1-repo-1'] {'base_url': 'http://public-repo-1.hortonworks.com/HDP/ubuntu18/3.x/updates/3.1.0.0', 'action': ['prepare'], 'components': [u'HDP', 'main'], 'repo_template': '{{package_type}} {{base_url}} {{components}}', 'repo_file_name': 'ambari-hdp-1', 'mirror_list': None}
2022-07-28 00:18:33,452 - Repository['HDP-3.1-GPL-repo-1'] {'base_url': 'http://public-repo-1.hortonworks.com/HDP-GPL/ubuntu18/3.x/updates/3.1.0.0', 'action': ['prepare'], 'components': [u'HDP-GPL', 'main'], 'repo_template': '{{package_type}} {{base_url}} {{components}}', 'repo_file_name': 'ambari-hdp-1', 'mirror_list': None}
2022-07-28 00:18:33,454 - Repository[None] {'action': ['create']}
2022-07-28 00:18:33,456 - File['/tmp/tmprKy1g1'] {'content': 'deb http://public-repo-1.hortonworks.com/HDP-UTILS-1.1.0.22/repos/ubuntu18 HDP-UTILS main\ndeb http://public-repo-1.hortonworks.com/HDP/ubuntu18/3.x/updates/3.1.0.0 HDP main\ndeb http://public-repo-1.hortonworks.com/HDP-GPL/ubuntu18/3.x/updates/3.1.0.0 HDP-GPL main'}
2022-07-28 00:18:33,883 - Writing File['/tmp/tmprKy1g1'] because contents don't match
2022-07-28 00:18:33,988 - File['/tmp/tmp5bLc_I'] {'content': StaticFile('/etc/apt/sources.list.d/ambari-hdp-1.list')}
2022-07-28 00:18:34,650 - Writing File['/tmp/tmp5bLc_I'] because contents don't match
2022-07-28 00:18:34,767 - call[('ambari-python-wrap', u'/usr/bin/hdp-select', 'versions')] {}
2022-07-28 00:18:34,866 - call returned (0, '3.1.0.0-78')
2022-07-28 00:18:34,868 - Temporary sources directory was created: /tmp/tmpJmw3Rs-ambari-apt-sources-d
2022-07-28 00:18:34,868 - Temporary sources file will be copied: /tmp/tmpJmw3Rs-ambari-apt-sources-d/ambari-hdp-1.list
2022-07-28 00:18:35,043 - Installing package hdp-select ('/usr/bin/apt-get -o Dpkg::Options::=--force-confdef --allow-unauthenticated --assume-yes install -o Dir::Etc::SourceList=/dev/null -o Dir::Etc::SourceParts= hdp-select')
2022-07-28 00:18:35,416 - Removing temporary sources file: /tmp/tmpJmw3Rs-ambari-apt-sources-d/ambari-hdp-1.list
2022-07-28 00:18:35,417 - Removing temporary sources directory: /tmp/tmpJmw3Rs-ambari-apt-sources-d
2022-07-28 00:19:22,785 - Looking for matching packages in the following repositories: public-repo-1.hortonworks.com_HDP-UTILS-1.1.0.22_repos_ubuntu18, public-repo-1.hortonworks.com_HDP_ubuntu18_3.x_updates_3.1.0.0, public-repo-1.hortonworks.com_HDP-GPL_ubuntu18_3.x_updates_3.1.0.0
2022-07-28 00:19:22,788 - Command repositories: HDP-UTILS-1.1.0.22-repo-1, HDP-3.1-repo-1, HDP-3.1-GPL-repo-1
2022-07-28 00:19:22,788 - Applicable repositories: HDP-UTILS-1.1.0.22-repo-1, HDP-3.1-repo-1, HDP-3.1-GPL-repo-1
2022-07-28 00:19:45,280 - Looking for matching packages in the following repositories: public-repo-1.hortonworks.com_HDP-UTILS-1.1.0.22_repos_ubuntu18, public-repo-1.hortonworks.com_HDP_ubuntu18_3.x_updates_3.1.0.0, public-repo-1.hortonworks.com_HDP-GPL_ubuntu18_3.x_updates_3.1.0.0
2022-07-28 00:19:45,289 - Package Manager failed to install packages: No package found for hive-${stack_version}(expected name: hive-3-1-0-0-78)
2022-07-28 00:20:10,532 - Installation of packages failed. Checking if installation was partially complete
2022-07-28 00:20:10,533 - Old versions: ['3.1.0.0-78']
2022-07-28 00:20:10,534 - call[('ambari-python-wrap', u'/usr/bin/hdp-select', 'versions')] {}
2022-07-28 00:20:10,636 - call returned (0, '3.1.0.0-78')
2022-07-28 00:20:10,637 - New versions: ['3.1.0.0-78']
2022-07-28 00:20:10,637 - Deltas: set([])

Command failed after 1 tries

 

i have an old stable version of amabri with 16 hosts,
mostly used for spark over yarn.

 

i want to add few more hosts to the cluster but i cannot install the packages:



5 replies

rki_
Gold ⭐️
Gold ⭐️
July 28, 2022

Hi, Can you check if you have the same repo file on the new host which in there in the old hosts. Check if you are able to install the package from commandline.

 

# yum clean all

# yum repolist

# yum install -y hive-3-1-0-0-78

 

Translate
ilia987
ilia987Author
Silver ⭐️⭐️⭐️
July 28, 2022
I have exactly the same files installed on all hosts .

Usually when we buy new server we clone the entire host, and initiate
install from ambari ui, because everything is already installed all it does
in reconfigure files.

but the repository is no longer accessible from any host
Translate
rki_
Gold ⭐️
Gold ⭐️
July 28, 2022

Hi, can you check in the Ambari server log and see what error are you getting there.

Translate
ilia987
ilia987Author
Silver ⭐️⭐️⭐️
July 28, 2022

apt-get update
Hit:1 https://repo.pbis.beyondtrust.com/apt pbiso InRelease
Hit:2 http://archive.ubuntu.com/ubuntu bionic InRelease
Get:3 http://archive.ubuntu.com/ubuntu bionic-updates InRelease [88.7 kB]
Hit:4 http://apt.postgresql.org/pub/repos/apt bionic-pgdg InRelease
Hit:5 http://packages.microsoft.com/repos/code stable InRelease
Get:6 http://archive.ubuntu.com/ubuntu bionic-security InRelease [88.7 kB]
Hit:7 https://packages.microsoft.com/repos/vscode stable InRelease
Err:8 http://public-repo-1.hortonworks.com/HDP-UTILS-1.1.0.22/repos/ubuntu18 HDP-UTILS InRelease
403 Forbidden [IP: 65.9.112.104 80]
Err:9 http://public-repo-1.hortonworks.com/HDP/ubuntu18/3.x/updates/3.1.0.0 HDP InRelease
403 Forbidden [IP: 65.9.112.104 80]
Get:10 http://archive.ubuntu.com/ubuntu bionic-security/main amd64 Packages [2,339 kB]
Err:11 http://public-repo-1.hortonworks.com/HDP-GPL/ubuntu18/3.x/updates/3.1.0.0 HDP-GPL InRelease
403 Forbidden [IP: 65.9.112.104 80]
Get:12 http://archive.ubuntu.com/ubuntu bionic-security/main Translation-en [407 kB]
Get:13 http://archive.ubuntu.com/ubuntu bionic-security/restricted amd64 Packages [832 kB]
Get:14 http://archive.ubuntu.com/ubuntu bionic-security/restricted Translation-en [114 kB]
Reading package lists... Done
N: See apt-secure(8) manpage for repository creation and user configuration details.
N: Updating from such a repository can't be done securely, and is therefore disabled by default.
E: The repository 'http://public-repo-1.hortonworks.com/HDP-UTILS-1.1.0.22/repos/ubuntu18 HDP-UTILS InRelease' is not signed.
E: Failed to fetch http://public-repo-1.hortonworks.com/HDP-UTILS-1.1.0.22/repos/ubuntu18/dists/HDP-UTILS/InRelease 403 Forbidden [IP: 65.9.112.104 80]
E: Failed to fetch http://public-repo-1.hortonworks.com/HDP/ubuntu18/3.x/updates/3.1.0.0/dists/HDP/InRelease 403 Forbidden [IP: 65.9.112.104 80]
E: The repository 'http://public-repo-1.hortonworks.com/HDP/ubuntu18/3.x/updates/3.1.0.0 HDP InRelease' is not signed.
N: Updating from such a repository can't be done securely, and is therefore disabled by default.
N: See apt-secure(8) manpage for repository creation and user configuration details.
E: Failed to fetch http://public-repo-1.hortonworks.com/HDP-GPL/ubuntu18/3.x/updates/3.1.0.0/dists/HDP-GPL/InRelease 403 Forbidden [IP: 65.9.112.104 80]
E: The repository 'http://public-repo-1.hortonworks.com/HDP-GPL/ubuntu18/3.x/updates/3.1.0.0 HDP-GPL InRelease' is not signed.
N: Updating from such a repository can't be done securely, and is therefore disabled by default.
N: See apt-secure(8) manpage for repository creation and user configuration details.

Translate
rki_
Gold ⭐️
Gold ⭐️
July 28, 2022

Hi,

 

If this is not working from any of the hosts, I believe you need to try the below URLs for 3.1.0

 

https://docs.cloudera.com/HDPDocuments/Ambari-2.7.3.0/bk_ambari-installation/content/hdp_31_repositories.html

 

Just please bear in mind that the repositories are now behind a paywall, for which you'll have to provide credentials.

https://www.cloudera.com/downloads/paywall-expansion.html

Translate