Member since
02-06-2017
3
Posts
0
Kudos Received
0
Solutions
02-07-2017
04:39 PM
Thanks for your answer. I don't run this is in a private network, It's plain azure with full internet access. I'm experimenting for a future project. It seems the vendor of the CentOs distribution on Azure is doing a poor job of maintaining its mirror. See this for example : http://serverfault.com/questions/617587/yum-updates-for-centos-by-openlogic-fails-on-microsoft-azure/617600 In my case, their mirror was working last week and now they have "lost" some packages. I have updated my mirror list on yum (/etc/yum.repos.d/CentOS-Base.repo) and it worked. from "baseurl=http://olcentgbl.trafficmanager.net/centos/$releasever/os/$basearch/" to " mirrorlist=http://mirrorlist.centos.org/?release=$releasever&arch=$basearch&repo=os then `yum clean` `yum repolist` I think I'm going to switch to RHEL. Any recommendation from Hortonworks on the linux distributon to use on Azure? Thanks for your help.
... View more
02-06-2017
10:10 PM
More details from yum if this could help: $sudo yum clean all
Loaded plugins: fastestmirror, langpacks
Cleaning repos: HDP-2.5 HDP-UTILS-1.1.0.21 Updates-ambari-2.4.1.0 base
: extras openlogic updates
Cleaning up everything
$sudo yum repolist
Loaded plugins: fastestmirror, langpacks
HDP-2.5 | 2.9 kB 00:00
HDP-UTILS-1.1.0.21 | 2.9 kB 00:00
Updates-ambari-2.4.1.0 | 2.9 kB 00:00
base | 3.6 kB 00:00
extras | 3.4 kB 00:00
openlogic | 1.3 kB 00:00
updates | 3.4 kB 00:00
(1/8): Updates-ambari-2.4.1.0/primary_db | 8.3 kB 00:00
(2/8): HDP-2.5/primary_db | 69 kB 00:00
(3/8): HDP-UTILS-1.1.0.21/primary_db | 34 kB 00:00
(4/8): base/7/x86_64/group_gz | 155 kB 00:00
(5/8): base/7/x86_64/primary_db | 5.6 MB 00:00
(6/8): extras/7/x86_64/primary_db | 121 kB 00:00
(7/8): openlogic/7/x86_64/primary | 12 kB 00:00
updates/7/x86_64/primary_db FAILED
http://olcentgbl.trafficmanager.net/centos/7/updates/x86_64/repodata/dd5dc3e826e60a49b66d3e8e2132e7a85b8af42cbcc6d5b959acdac91c248fa5-primary.sqlite.bz2: [Errno -1] Metadata file does not match checksum
Trying other mirror.
Determining fastest mirrors
updates/7/x86_64/primary_db | 2.2 MB 00:00
openlogic 60/60
repo id repo name status
HDP-2.5 HDP-2.5 200
HDP-UTILS-1.1.0.21 HDP-UTILS-1.1.0.21 52
Updates-ambari-2.4.1.0 ambari-2.4.1.0 - Updates 12
base/7/x86_64 CentOS-7 - Base 9,363
extras/7/x86_64 CentOS-7 - Extras 263
openlogic/7/x86_64 CentOS-7 - openlogic packages for x86_64 60
updates/7/x86_64 CentOS-7 - Updates 807
repolist: 10,757
The error on `updates/7/x86_64/primary_db FAILED` could be the reason? EDIT: yum upgrade * on a fresh install also fails: http://olcentgbl.trafficmanager.net/centos/7/os/x86_64/Packages/perl-5.16.3-291.el7.x86_64.rpm: [Errno -1] Package does not match intended download. Suggestion: run yum --enablerepo=base clean metadata
Trying other mirror.
(10/12): systemd-219-30.el7_3.6.x86_64.rpm | 5.2 MB 00:00
kernel-3.10.0-514.6.1.el7.x86_ FAILED
http://olcentgbl.trafficmanager.net/centos/7/updates/x86_64/Packages/kernel-3.10.0-514.6.1.el7.x86_64.rpm: [Errno -1] Package does not match intended download. Suggestion: run yum --enablerepo=updates clean metadata
Trying other mirror.
Error downloading packages:
kernel-3.10.0-514.6.1.el7.x86_64: [Errno 256] No more mirrors to try.
4:perl-5.16.3-291.el7.x86_64: [Errno 256] No more mirrors to try.
... View more
02-06-2017
10:01 PM
Hi, I'm trying to reinstall HDP, but it keeps failing at the deploy step because of missing yum packages. Not hadoop packages like in this post , but core packages (glibc-common, etc) wich are supposed to be in the distribution repository. The stacktrace in Ambari: Traceback (most recent call last):
File "/var/lib/ambari-agent/cache/common-services/HDFS/2.1.0.2.0/package/scripts/datanode.py", line 174, in <module>
DataNode().execute()
File "/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py", line 280, in execute
method(env)
File "/var/lib/ambari-agent/cache/common-services/HDFS/2.1.0.2.0/package/scripts/datanode.py", line 49, in install
self.install_packages(env)
File "/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py", line 567, in install_packages
retry_count=agent_stack_retry_count)
File "/usr/lib/python2.6/site-packages/resource_management/core/base.py", line 155, in __init__
self.env.run()
File "/usr/lib/python2.6/site-packages/resource_management/core/environment.py", line 160, in run
self.run_action(resource, action)
File "/usr/lib/python2.6/site-packages/resource_management/core/environment.py", line 124, in run_action
provider_action()
File "/usr/lib/python2.6/site-packages/resource_management/core/providers/package/__init__.py", line 54, in action_install
self.install_package(package_name, self.resource.use_repos, self.resource.skip_repos)
File "/usr/lib/python2.6/site-packages/resource_management/core/providers/package/yumrpm.py", line 49, in install_package
self.checked_call_with_retries(cmd, sudo=True, logoutput=self.get_logoutput())
File "/usr/lib/python2.6/site-packages/resource_management/core/providers/package/__init__.py", line 83, in checked_call_with_retries
return self._call_with_retries(cmd, is_checked=True, **kwargs)
File "/usr/lib/python2.6/site-packages/resource_management/core/providers/package/__init__.py", line 91, in _call_with_retries
code, out = func(cmd, **kwargs)
File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", line 71, in inner
result = function(command, **kwargs)
File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", line 93, in checked_call
tries=tries, try_sleep=try_sleep)
File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", line 141, in _call_wrapper
result = _call(command, **kwargs_copy)
File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", line 294, in _call
raise Fail(err_msg)
resource_management.core.exceptions.Fail: Execution of '/usr/bin/yum -d 0 -e 0 -y install hadoop_2_5_0_0_1245' returned 1. Delta RPMs disabled because /usr/bin/applydeltarpm not installed.
Error downloading packages:
pango-1.36.8-2.el7.x86_64: [Errno 256] No more mirrors to try.
glibc-2.17-157.el7_3.1.x86_64: [Errno 256] No more mirrors to try.
I've automated the cluster provisioning + Ambari installation with Ansible. A fresh setup was working last week. A fresh setup does not work anymore Same ansible script, HDP version (HDP-2.5, HDFS 2.7.1.2.5) If I recreate a new cluster from scratch, then another package is missing, for eg: ============================================================================
Installing:
ambari-metrics-monitor x86_64 2.4.1.0-22 Updates-ambari-2.4.1.0 176 k
Installing for dependencies:
cpp x86_64 4.8.5-11.el7 base 5.9 M
gcc x86_64 4.8.5-11.el7 base 16 M
libmpc x86_64 1.0.1-3.el7 base 51 k
mpfr x86_64 3.1.1-4.el7 base 203 k
python-devel x86_64 2.7.5-48.el7 base 393 k
Updating for dependencies:
libgcc x86_64 4.8.5-11.el7 base 97 k
libgomp x86_64 4.8.5-11.el7 base 152 k
python x86_64 2.7.5-48.el7 base 90 k
python-libs x86_64 2.7.5-48.el7 base 5.6 M
Transaction Summary
============================================================================
Install 1 Package (+5 Dependent packages)
Upgrade ( 4 Dependent packages)
Total size: 29 M
Total download size: 16 M
Downloading packages:
gcc-4.8.5-11.el7.x86_64.rpm FAILED
http://olcentgbl.trafficmanager.net/centos/7/os/x86_64/Packages/gcc-4.8.5-11.el7.x86_64.rpm: [Errno -1] Package does not match intended download. Suggestion: run yum --enablerepo=base clean metadata
Trying other mirror.
Error downloading packages:
gcc-4.8.5-11.el7.x86_64: [Errno 256] No more mirrors to try.
Any idea? Thanks
... View more
Labels:
- Labels:
-
Apache Ambari
