10-05-2017 07:43 AM - edited 10-05-2017 08:03 AM
I created a new VM in Azure using the marketplace CentOS 7.2 from Cloudera.
Installed the Cloudera manager on it, all good.
Now, if I want to update the VM, there are 2 problems:
1. LIS drivers go in dependency issue (this can be mitigated by removing the LIS drivers before updating)
V drivers [root@vmhostname ~] # rpm -qa |grep microsoft
[root@vmhostname ~] #rpm -e microsoft-hyper-v-4.2.0-20170421.x86_64 kmod-microsoft-hyper-v-4.2.0-20170421.x86_64 microsoft-hyper-v-debuginfo-4.2.0-20170421.x86_64
Stopping KVP Daemon....
Stopping FCOPY Daemon....
Stopping VSS Daemon....
Create and install initramfs without Hyper-Linux Integration Services for Hyper-V has been removed.
Please reboot your system.
[root@vmhostname ~] # reboot
After reboot, you can go ahead with the update:
[root@vmhostname ~] # yum update
Check if you have any other dependency issues. If none, you're OK and can continue with the yum update. So.. let's say this part is OK
2. The update skips a release, and goes directly to CentOS7.4, with the Kernel-3.10.0-693.* ... which, according to this page ( https://www.cloudera.com/documentation/enterprise/release-notes/topics/rn_consolidated_pcm.html#gate... ) is not supported..
$cat /etc/*release CentOS Linux release 7.2.1511 (Core) NAME="CentOS Linux" VERSION="7 (Core)" ID="centos" ID_LIKE="rhel fedora" VERSION_ID="7" PRETTY_NAME="CentOS Linux 7 (Core)" ANSI_COLOR="0;31" CPE_NAME="cpe:/o:centos:centos:7" HOME_URL="https://www.centos.org/" BUG_REPORT_URL="https://bugs.centos.org/" CENTOS_MANTISBT_PROJECT="CentOS-7" CENTOS_MANTISBT_PROJECT_VERSION="7" REDHAT_SUPPORT_PRODUCT="centos" REDHAT_SUPPORT_PRODUCT_VERSION="7" CentOS Linux release 7.2.1511 (Core) CentOS Linux release 7.2.1511 (Core)
The repository shows something unexpected; it uses RogueWave (former OpenLogic) repository to update the CentOS base:
$ cat /etc/yum.repos.d/CentOS-Base.repo [openlogic] name=CentOS-7 - openlogic packages for $basearch baseurl=http://olcentgbl.trafficmanager.net/openlogic/7/openlogic/$basearch/ enabled=1 gpgcheck=0 [base] name=CentOS-7 - Base baseurl=http://olcentgbl.trafficmanager.net/centos/7/os/$basearch/ gpgcheck=1 gpgkey=file:///etc/pki/rpm-gpg/RPM-GPG-KEY-CentOS-7 #released updates [updates] name=CentOS-7 - Updates baseurl=http://olcentgbl.trafficmanager.net/centos/7/updates/$basearch/ gpgcheck=1 gpgkey=file:///etc/pki/rpm-gpg/RPM-GPG-KEY-CentOS-7 #additional packages that may be useful [extras] name=CentOS-$releasever - Extras baseurl=http://olcentgbl.trafficmanager.net/centos/$releasever/extras/$basearch/ gpgcheck=1 gpgkey=file:///etc/pki/rpm-gpg/RPM-GPG-KEY-CentOS-7 #additional packages that extend functionality of existing packages [centosplus] name=CentOS-7 - Plus baseurl=http://olcentgbl.trafficmanager.net/centos/7/centosplus/$basearch/ gpgcheck=1 enabled=0 gpgkey=file:///etc/pki/rpm-gpg/RPM-GPG-KEY-CentOS-7 #contrib - packages by Centos Users [contrib] name=CentOS-$releasever - Contrib baseurl=http://olcentgbl.trafficmanager.net/centos/7/contrib/$basearch/ gpgcheck=1 enabled=0 gpgkey=file:///etc/pki/rpm-gpg/RPM-GPG-KEY-CentOS-7
I also added the cloudera repository for the manager.
Tried with "yum --releasever=7.3 update" but got an 404 error.
Checking the url http://olcentgbl.trafficmanager.net/centos/ in browser you will find the only CentOS7.3 related directory is one called 7.3.1611.
[root@vmhostname ~]# yum --releasever=7.3.1611 check-update | grep centos-release centos-release.x86_64 7-4.1708.el7.centos base
Checked with RogueWave, since is their repo, and they simply stated that 7.3 is deprecated and no longer supported.
So, how do I solve this?
- no longer update ?
- change the repository ?With what ?
- wait for Cloudera Manager to work in CentOS7.4 ?
- other options ?
10-12-2017 05:54 AM
While you are waiting for a more experienced person to chime in I thought I would provide a link to documentation on Upgrading Host Operating Systems in a CDH Cluster in hopes it may be of some assistance.
10-15-2017 11:53 PM
Thank you for the idea and for the response, but that doesn't help.
The issue is simply related to CentOS version and compatibility with Cloudera software.
In Azure, the offer from Cloudera is a CentOS 7.2 version, created from a Rogue Wave initial image, or that is simply using the repository of Rogue Wave for updates.
The latest CentOS compatible version with the Cloudera Manager 5.11.1 seems to be CentOS7.3, but Rogue Wave doesn't support CentOS 7.3 and has disabled the repository for it, forcing CentOS 7.4 as upgrade from CentOS 7.2.
But Cloudera Manager 5.11.1 isn't compatible with CentOS 7.4. So, no update is possible.
I suppose, at this point, the question is:
- Cloudera Manager will get some update to work with CentOS 7.4 soon ?
- Cloudera has some additional repository available, that can replace the base repository of Rogue Wave for the CentOS images Cloudera added in the Azure Marketplace?
10-16-2017 05:48 AM
I started to dig deeper into documentation and quickly determined I would be better off simply some of my contacts for assistance here. Let me see if I can find anything out get find someone to chime in. :)
10-16-2017 07:44 AM
I just found that Cloudera Manager 5.13.x is now supported on CentOS 7.4
So, I think the Cloudera team was silently listening and fixing things... :D
10-16-2017 07:50 AM - edited 10-16-2017 07:50 AM
New OS releases can be tested and certified only with new Cloudera Manager / CDH versions.
With the recent 5.13 release, RedHat / CentOS 7.4 is now supported for the 5.11, 5.12 and 5.13 releases, see CDH and Cloudera Manager Supported Operating Systems