question Re: add hosts for old version in Support Questions

add hosts for old version

ilia987 — Wed, 27 Jul 2022 21:25:35 GMT

HDP-3.1.0.0

2022-07-28 00:19:45,289 - Package Manager failed to install packages: No package found for hive-${stack_version}(expected name: hive-3-1-0-0-78) Traceback (most recent call last): File "/var/lib/ambari-agent/cache/custom_actions/scripts/install_packages.py", line 486, in <module> InstallPackages().execute() File "/usr/lib/ambari-agent/lib/resource_management/libraries/script/script.py", line 352, in execute method(env) File "/var/lib/ambari-agent/cache/custom_actions/scripts/install_packages.py", line 149, in actionexecute raise Fail("Failed to distribute repositories/install packages") resource_management.core.exceptions.Fail: Failed to distribute repositories/install packages stdout: /var/lib/ambari-agent/data/output-6991.txt 2022-07-28 00:18:33,442 - Will install packages for repository version 3.1.0.0-78 2022-07-28 00:18:33,443 - Repository['HDP-UTILS-1.1.0.22-repo-1'] {'base_url': 'http://public-repo-1.hortonworks.com/HDP-UTILS-1.1.0.22/repos/ubuntu18', 'action': ['prepare'], 'components': [u'HDP-UTILS', 'main'], 'repo_template': '{{package_type}} {{base_url}} {{components}}', 'repo_file_name': 'ambari-hdp-1', 'mirror_list': None} 2022-07-28 00:18:33,450 - Repository['HDP-3.1-repo-1'] {'base_url': 'http://public-repo-1.hortonworks.com/HDP/ubuntu18/3.x/updates/3.1.0.0', 'action': ['prepare'], 'components': [u'HDP', 'main'], 'repo_template': '{{package_type}} {{base_url}} {{components}}', 'repo_file_name': 'ambari-hdp-1', 'mirror_list': None} 2022-07-28 00:18:33,452 - Repository['HDP-3.1-GPL-repo-1'] {'base_url': 'http://public-repo-1.hortonworks.com/HDP-GPL/ubuntu18/3.x/updates/3.1.0.0', 'action': ['prepare'], 'components': [u'HDP-GPL', 'main'], 'repo_template': '{{package_type}} {{base_url}} {{components}}', 'repo_file_name': 'ambari-hdp-1', 'mirror_list': None} 2022-07-28 00:18:33,454 - Repository[None] {'action': ['create']} 2022-07-28 00:18:33,456 - File['/tmp/tmprKy1g1'] {'content': 'deb http://public-repo-1.hortonworks.com/HDP-UTILS-1.1.0.22/repos/ubuntu18 HDP-UTILS main\ndeb http://public-repo-1.hortonworks.com/HDP/ubuntu18/3.x/updates/3.1.0.0 HDP main\ndeb http://public-repo-1.hortonworks.com/HDP-GPL/ubuntu18/3.x/updates/3.1.0.0 HDP-GPL main'} 2022-07-28 00:18:33,883 - Writing File['/tmp/tmprKy1g1'] because contents don't match 2022-07-28 00:18:33,988 - File['/tmp/tmp5bLc_I'] {'content': StaticFile('/etc/apt/sources.list.d/ambari-hdp-1.list')} 2022-07-28 00:18:34,650 - Writing File['/tmp/tmp5bLc_I'] because contents don't match 2022-07-28 00:18:34,767 - call[('ambari-python-wrap', u'/usr/bin/hdp-select', 'versions')] {} 2022-07-28 00:18:34,866 - call returned (0, '3.1.0.0-78') 2022-07-28 00:18:34,868 - Temporary sources directory was created: /tmp/tmpJmw3Rs-ambari-apt-sources-d 2022-07-28 00:18:34,868 - Temporary sources file will be copied: /tmp/tmpJmw3Rs-ambari-apt-sources-d/ambari-hdp-1.list 2022-07-28 00:18:35,043 - Installing package hdp-select ('/usr/bin/apt-get -o Dpkg::Options::=--force-confdef --allow-unauthenticated --assume-yes install -o Dir::Etc::SourceList=/dev/null -o Dir::Etc::SourceParts= hdp-select') 2022-07-28 00:18:35,416 - Removing temporary sources file: /tmp/tmpJmw3Rs-ambari-apt-sources-d/ambari-hdp-1.list 2022-07-28 00:18:35,417 - Removing temporary sources directory: /tmp/tmpJmw3Rs-ambari-apt-sources-d 2022-07-28 00:19:22,785 - Looking for matching packages in the following repositories: public-repo-1.hortonworks.com_HDP-UTILS-1.1.0.22_repos_ubuntu18, public-repo-1.hortonworks.com_HDP_ubuntu18_3.x_updates_3.1.0.0, public-repo-1.hortonworks.com_HDP-GPL_ubuntu18_3.x_updates_3.1.0.0 2022-07-28 00:19:22,788 - Command repositories: HDP-UTILS-1.1.0.22-repo-1, HDP-3.1-repo-1, HDP-3.1-GPL-repo-1 2022-07-28 00:19:22,788 - Applicable repositories: HDP-UTILS-1.1.0.22-repo-1, HDP-3.1-repo-1, HDP-3.1-GPL-repo-1 2022-07-28 00:19:45,280 - Looking for matching packages in the following repositories: public-repo-1.hortonworks.com_HDP-UTILS-1.1.0.22_repos_ubuntu18, public-repo-1.hortonworks.com_HDP_ubuntu18_3.x_updates_3.1.0.0, public-repo-1.hortonworks.com_HDP-GPL_ubuntu18_3.x_updates_3.1.0.0 2022-07-28 00:19:45,289 - Package Manager failed to install packages: No package found for hive-${stack_version}(expected name: hive-3-1-0-0-78) 2022-07-28 00:20:10,532 - Installation of packages failed. Checking if installation was partially complete 2022-07-28 00:20:10,533 - Old versions: ['3.1.0.0-78'] 2022-07-28 00:20:10,534 - call[('ambari-python-wrap', u'/usr/bin/hdp-select', 'versions')] {} 2022-07-28 00:20:10,636 - call returned (0, '3.1.0.0-78') 2022-07-28 00:20:10,637 - New versions: ['3.1.0.0-78'] 2022-07-28 00:20:10,637 - Deltas: set([]) Command failed after 1 tries

i have an old stable version of amabri with 16 hosts,
mostly used for spark over yarn.

i want to add few more hosts to the cluster but i cannot install the packages:

Re: add hosts for old version

rki_ — Thu, 28 Jul 2022 08:18:22 GMT

Hi, Can you check if you have the same repo file on the new host which in there in the old hosts. Check if you are able to install the package from commandline.

# yum clean all

# yum repolist

# yum install -y hive-3-1-0-0-78

Re: add hosts for old version

ilia987 — Thu, 28 Jul 2022 08:22:24 GMT

I have exactly the same files installed on all hosts .

Usually when we buy new server we clone the entire host, and initiate
install from ambari ui, because everything is already installed all it does
in reconfigure files.

but the repository is no longer accessible from any host

Re: add hosts for old version

rki_ — Thu, 28 Jul 2022 11:03:48 GMT

Hi, can you check in the Ambari server log and see what error are you getting there.

Re: add hosts for old version

ilia987 — Thu, 28 Jul 2022 12:00:37 GMT

apt-get update
Hit:1 https://repo.pbis.beyondtrust.com/apt pbiso InRelease
Hit:2 http://archive.ubuntu.com/ubuntu bionic InRelease
Get:3 http://archive.ubuntu.com/ubuntu bionic-updates InRelease [88.7 kB]
Hit:4 http://apt.postgresql.org/pub/repos/apt bionic-pgdg InRelease
Hit:5 http://packages.microsoft.com/repos/code stable InRelease
Get:6 http://archive.ubuntu.com/ubuntu bionic-security InRelease [88.7 kB]
Hit:7 https://packages.microsoft.com/repos/vscode stable InRelease
Err:8 http://public-repo-1.hortonworks.com/HDP-UTILS-1.1.0.22/repos/ubuntu18 HDP-UTILS InRelease
403 Forbidden [IP: 65.9.112.104 80]
Err:9 http://public-repo-1.hortonworks.com/HDP/ubuntu18/3.x/updates/3.1.0.0 HDP InRelease
403 Forbidden [IP: 65.9.112.104 80]
Get:10 http://archive.ubuntu.com/ubuntu bionic-security/main amd64 Packages [2,339 kB]
Err:11 http://public-repo-1.hortonworks.com/HDP-GPL/ubuntu18/3.x/updates/3.1.0.0 HDP-GPL InRelease
403 Forbidden [IP: 65.9.112.104 80]
Get:12 http://archive.ubuntu.com/ubuntu bionic-security/main Translation-en [407 kB]
Get:13 http://archive.ubuntu.com/ubuntu bionic-security/restricted amd64 Packages [832 kB]
Get:14 http://archive.ubuntu.com/ubuntu bionic-security/restricted Translation-en [114 kB]
Reading package lists... Done
N: See apt-secure(8) manpage for repository creation and user configuration details.
N: Updating from such a repository can't be done securely, and is therefore disabled by default.
E: The repository 'http://public-repo-1.hortonworks.com/HDP-UTILS-1.1.0.22/repos/ubuntu18 HDP-UTILS InRelease' is not signed.
E: Failed to fetch http://public-repo-1.hortonworks.com/HDP-UTILS-1.1.0.22/repos/ubuntu18/dists/HDP-UTILS/InRelease 403 Forbidden [IP: 65.9.112.104 80]
E: Failed to fetch http://public-repo-1.hortonworks.com/HDP/ubuntu18/3.x/updates/3.1.0.0/dists/HDP/InRelease 403 Forbidden [IP: 65.9.112.104 80]
E: The repository 'http://public-repo-1.hortonworks.com/HDP/ubuntu18/3.x/updates/3.1.0.0 HDP InRelease' is not signed.
N: Updating from such a repository can't be done securely, and is therefore disabled by default.
N: See apt-secure(8) manpage for repository creation and user configuration details.
E: Failed to fetch http://public-repo-1.hortonworks.com/HDP-GPL/ubuntu18/3.x/updates/3.1.0.0/dists/HDP-GPL/InRelease 403 Forbidden [IP: 65.9.112.104 80]
E: The repository 'http://public-repo-1.hortonworks.com/HDP-GPL/ubuntu18/3.x/updates/3.1.0.0 HDP-GPL InRelease' is not signed.
N: Updating from such a repository can't be done securely, and is therefore disabled by default.
N: See apt-secure(8) manpage for repository creation and user configuration details.

Re: add hosts for old version

rki_ — Thu, 28 Jul 2022 13:00:05 GMT

Hi,

If this is not working from any of the hosts, I believe you need to try the below URLs for 3.1.0

https://docs.cloudera.com/HDPDocuments/Ambari-2.7.3.0/bk_ambari-installation/content/hdp_31_repositories.html

Just please bear in mind that the repositories are now behind a paywall, for which you'll have to provide credentials.

https://www.cloudera.com/downloads/paywall-expansion.html