Cloudera CentOS 7.2 on Azure - how to update to CentOS 7.3 ?

[#1]

I created a new VM in Azure using the marketplace CentOS 7.2 from Cloudera.
Installed the Cloudera manager on it, all good.
Now, if I want to update the VM, there are 2 problems:
1. LIS drivers go in dependency issue (this can be mitigated by removing the LIS drivers before updating)

V drivers [root@vmhostname ~] # rpm -qa |grep microsoft
microsoft-hyper-v-4.2.0-20170421.x86_64 
microsoft-hyper-v-debuginfo-4.2.0-20170421.x86_64 
kmod-microsoft-hyper-v-4.2.0-20170421.x86_64 

[root@vmhostname ~] #rpm -e microsoft-hyper-v-4.2.0-20170421.x86_64 kmod-microsoft-hyper-v-4.2.0-20170421.x86_64 microsoft-hyper-v-debuginfo-4.2.0-20170421.x86_64 
Removing Package.. 
Stopping KVP Daemon.... 
Stopping FCOPY Daemon.... 
Stopping VSS Daemon.... 
Create and install initramfs without Hyper-Linux Integration Services for Hyper-V has been removed. 
Please reboot your system.   

[root@vmhostname ~] # reboot  

 
 After reboot, you can go ahead with the update: 

 [root@vmhostname ~] # yum update 

 
 Check if you have any other dependency issues. If none, you're OK and can continue with the yum update. So.. let's say this part is OK
 
 2. The update skips a release, and goes directly to CentOS7.4, with the Kernel-3.10.0-693.* ... which, according to this page ( https://www.cloudera.com/documentation/enterprise/release-notes/topics/rn_consolidated_pcm.html#gate... ) is not supported..
 

$cat  /etc/*release
CentOS Linux release 7.2.1511 (Core)
NAME="CentOS Linux"
VERSION="7 (Core)"
ID="centos"
ID_LIKE="rhel fedora"
VERSION_ID="7"
PRETTY_NAME="CentOS Linux 7 (Core)"
ANSI_COLOR="0;31"
CPE_NAME="cpe:/o:centos:centos:7"
HOME_URL="https://www.centos.org/"
BUG_REPORT_URL="https://bugs.centos.org/"
 
CENTOS_MANTISBT_PROJECT="CentOS-7"
CENTOS_MANTISBT_PROJECT_VERSION="7"
REDHAT_SUPPORT_PRODUCT="centos"
REDHAT_SUPPORT_PRODUCT_VERSION="7"
 
CentOS Linux release 7.2.1511 (Core)
CentOS Linux release 7.2.1511 (Core)

 
The repository shows something unexpected; it uses RogueWave (former OpenLogic) repository to update the CentOS base:
 

$ cat /etc/yum.repos.d/CentOS-Base.repo
[openlogic]
name=CentOS-7 - openlogic packages for $basearch
baseurl=http://olcentgbl.trafficmanager.net/openlogic/7/openlogic/$basearch/
enabled=1
gpgcheck=0
 
[base]
name=CentOS-7 - Base
baseurl=http://olcentgbl.trafficmanager.net/centos/7/os/$basearch/
gpgcheck=1
gpgkey=file:///etc/pki/rpm-gpg/RPM-GPG-KEY-CentOS-7
 
#released updates
[updates]
name=CentOS-7 - Updates
baseurl=http://olcentgbl.trafficmanager.net/centos/7/updates/$basearch/
gpgcheck=1
gpgkey=file:///etc/pki/rpm-gpg/RPM-GPG-KEY-CentOS-7
 
#additional packages that may be useful
[extras]
name=CentOS-$releasever - Extras
baseurl=http://olcentgbl.trafficmanager.net/centos/$releasever/extras/$basearch/
gpgcheck=1
gpgkey=file:///etc/pki/rpm-gpg/RPM-GPG-KEY-CentOS-7
 
#additional packages that extend functionality of existing packages
[centosplus]
name=CentOS-7 - Plus
baseurl=http://olcentgbl.trafficmanager.net/centos/7/centosplus/$basearch/
gpgcheck=1
enabled=0
gpgkey=file:///etc/pki/rpm-gpg/RPM-GPG-KEY-CentOS-7
 
#contrib - packages by Centos Users
[contrib]
name=CentOS-$releasever - Contrib
baseurl=http://olcentgbl.trafficmanager.net/centos/7/contrib/$basearch/
gpgcheck=1
enabled=0
gpgkey=file:///etc/pki/rpm-gpg/RPM-GPG-KEY-CentOS-7

I also added the cloudera repository for the manager.

Tried with "yum --releasever=7.3 update" but got an 404 error.

Checking the url http://olcentgbl.trafficmanager.net/centos/ in browser you will find the only CentOS7.3 related directory is one called 7.3.1611.
 
However: 

[root@vmhostname ~]# yum --releasever=7.3.1611 check-update | grep centos-release 
centos-release.x86_64              7-4.1708.el7.centos               base 

Checked with RogueWave, since is their repo, and they simply stated that 7.3 is deprecated and no longer supported.

 
So, how do I solve this?
- no longer update ?
- change the repository ?With what ?
- wait for Cloudera Manager to work in CentOS7.4 ?
- other options ?

[#2]

Any updates on this?

Anyone?

[#3]

While you are waiting for a more experienced person to chime in I thought I would provide a link to documentation on Upgrading Host Operating Systems in a CDH Cluster in hopes it may be of some assistance. 

[#4]

Hi cjervis,

Thank you for the idea and for the response, but that doesn't help.

The issue is simply related to CentOS version and compatibility with Cloudera software.

In Azure, the offer from Cloudera is a CentOS 7.2 version, created from a Rogue Wave initial image, or that is simply using the repository of Rogue Wave for updates.

The latest CentOS compatible version with the Cloudera Manager 5.11.1 seems to be CentOS7.3, but Rogue Wave doesn't support CentOS 7.3 and has disabled the repository for it, forcing CentOS 7.4 as upgrade from CentOS 7.2.

But Cloudera Manager  5.11.1 isn't compatible with CentOS 7.4. So, no update is possible.

I suppose, at this point, the question is:

- Cloudera Manager will get some update to work with CentOS 7.4 soon ?

- Cloudera has some additional repository available, that can replace the base repository of Rogue Wave for the CentOS images Cloudera added in the Azure Marketplace?

[#5]

I started to dig deeper into documentation and quickly determined I would be better off simply some of my contacts for assistance here. Let me see if I can find anything out get find someone to chime in. 🙂

[#6]

Hi cjervis 

I just found that Cloudera Manager 5.13.x is now supported on CentOS 7.4

So, I think the Cloudera team was silently listening and fixing things... 😄 

https://www.cloudera.com/documentation/enterprise/release-notes/topics/rn_consolidated_pcm.html#conc...

[#7 · Accepted solution]

New OS releases can be tested and certified only with new Cloudera Manager / CDH versions.

With the recent 5.13 release, RedHat / CentOS 7.4 is now supported for the 5.11, 5.12 and 5.13 releases, see CDH and Cloudera Manager Supported Operating Systems