question Re: Cloudera CentOS 7.2 on Azure - how to update to CentOS 7.3 ? in Support Questions

Cloudera CentOS 7.2 on Azure - how to update to CentOS 7.3 ?

nedmar — Thu, 05 Oct 2017 15:03:36 GMT

I created a new VM in Azure using the marketplace CentOS 7.2 from Cloudera.
Installed the Cloudera manager on it, all good.
Now, if I want to update the VM, there are 2 problems:
1. LIS drivers go in dependency issue (this can be mitigated by removing the LIS drivers before updating)

V drivers [root@vmhostname ~] # rpm -qa |grep microsoft
microsoft-hyper-v-4.2.0-20170421.x86_64 
microsoft-hyper-v-debuginfo-4.2.0-20170421.x86_64 
kmod-microsoft-hyper-v-4.2.0-20170421.x86_64 

[root@vmhostname ~] #rpm -e microsoft-hyper-v-4.2.0-20170421.x86_64 kmod-microsoft-hyper-v-4.2.0-20170421.x86_64 microsoft-hyper-v-debuginfo-4.2.0-20170421.x86_64 
Removing Package.. 
Stopping KVP Daemon.... 
Stopping FCOPY Daemon.... 
Stopping VSS Daemon.... 
Create and install initramfs without Hyper-Linux Integration Services for Hyper-V has been removed. 
Please reboot your system.   

[root@vmhostname ~] # reboot

After reboot, you can go ahead with the update:

 [root@vmhostname ~] # yum update

Check if you have any other dependency issues. If none, you're OK and can continue with the yum update. So.. let's say this part is OK

2. The update skips a release, and goes directly to CentOS7.4, with the Kernel-3.10.0-693.* ... which, according to this page ( https://www.cloudera.com/documentation/enterprise/release-notes/topics/rn_consolidated_pcm.html#gateway-os ) is not supported..

$cat  /etc/*release
CentOS Linux release 7.2.1511 (Core)
NAME="CentOS Linux"
VERSION="7 (Core)"
ID="centos"
ID_LIKE="rhel fedora"
VERSION_ID="7"
PRETTY_NAME="CentOS Linux 7 (Core)"
ANSI_COLOR="0;31"
CPE_NAME="cpe:/o:centos:centos:7"
HOME_URL="https://www.centos.org/"
BUG_REPORT_URL="https://bugs.centos.org/"
 
CENTOS_MANTISBT_PROJECT="CentOS-7"
CENTOS_MANTISBT_PROJECT_VERSION="7"
REDHAT_SUPPORT_PRODUCT="centos"
REDHAT_SUPPORT_PRODUCT_VERSION="7"
 
CentOS Linux release 7.2.1511 (Core)
CentOS Linux release 7.2.1511 (Core)

The repository shows something unexpected; it uses RogueWave (former OpenLogic) repository to update the CentOS base:

$ cat /etc/yum.repos.d/CentOS-Base.repo
[openlogic]
name=CentOS-7 - openlogic packages for $basearch
baseurl=http://olcentgbl.trafficmanager.net/openlogic/7/openlogic/$basearch/
enabled=1
gpgcheck=0
 
[base]
name=CentOS-7 - Base
baseurl=http://olcentgbl.trafficmanager.net/centos/7/os/$basearch/
gpgcheck=1
gpgkey=file:///etc/pki/rpm-gpg/RPM-GPG-KEY-CentOS-7
 
#released updates
[updates]
name=CentOS-7 - Updates
baseurl=http://olcentgbl.trafficmanager.net/centos/7/updates/$basearch/
gpgcheck=1
gpgkey=file:///etc/pki/rpm-gpg/RPM-GPG-KEY-CentOS-7
 
#additional packages that may be useful
[extras]
name=CentOS-$releasever - Extras
baseurl=http://olcentgbl.trafficmanager.net/centos/$releasever/extras/$basearch/
gpgcheck=1
gpgkey=file:///etc/pki/rpm-gpg/RPM-GPG-KEY-CentOS-7
 
#additional packages that extend functionality of existing packages
[centosplus]
name=CentOS-7 - Plus
baseurl=http://olcentgbl.trafficmanager.net/centos/7/centosplus/$basearch/
gpgcheck=1
enabled=0
gpgkey=file:///etc/pki/rpm-gpg/RPM-GPG-KEY-CentOS-7
 
#contrib - packages by Centos Users
[contrib]
name=CentOS-$releasever - Contrib
baseurl=http://olcentgbl.trafficmanager.net/centos/7/contrib/$basearch/
gpgcheck=1
enabled=0
gpgkey=file:///etc/pki/rpm-gpg/RPM-GPG-KEY-CentOS-7

I also added the cloudera repository for the manager.

Tried with "yum --releasever=7.3 update" but got an 404 error.

Checking the url http://olcentgbl.trafficmanager.net/centos/ in browser you will find the only CentOS7.3 related directory is one called 7.3.1611.

However:

[root@vmhostname ~]# yum --releasever=7.3.1611 check-update | grep centos-release 
centos-release.x86_64              7-4.1708.el7.centos               base

Checked with RogueWave, since is their repo, and they simply stated that 7.3 is deprecated and no longer supported.

So, how do I solve this?
- no longer update ?
- change the repository ?With what ?
- wait for Cloudera Manager to work in CentOS7.4 ?
- other options ?

Re: Cloudera CentOS 7.2 on Azure - how to update to CentOS 7.3 ?

nedmar — Thu, 12 Oct 2017 11:58:00 GMT

Any updates on this?

Anyone?

Re: Cloudera CentOS 7.2 on Azure - how to update to CentOS 7.3 ?

cjervis — Thu, 12 Oct 2017 12:54:48 GMT

While you are waiting for a more experienced person to chime in I thought I would provide a link to documentation on Upgrading Host Operating Systems in a CDH Cluster in hopes it may be of some assistance.

Re: Cloudera CentOS 7.2 on Azure - how to update to CentOS 7.3 ?

nedmar — Mon, 16 Oct 2017 06:53:52 GMT

Hi cjervis,

Thank you for the idea and for the response, but that doesn't help.

The issue is simply related to CentOS version and compatibility with Cloudera software.

In Azure, the offer from Cloudera is a CentOS 7.2 version, created from a Rogue Wave initial image, or that is simply using the repository of Rogue Wave for updates.

The latest CentOS compatible version with the Cloudera Manager 5.11.1 seems to be CentOS7.3, but Rogue Wave doesn't support CentOS 7.3 and has disabled the repository for it, forcing CentOS 7.4 as upgrade from CentOS 7.2.

But Cloudera Manager 5.11.1 isn't compatible with CentOS 7.4. So, no update is possible.

I suppose, at this point, the question is:

- Cloudera Manager will get some update to work with CentOS 7.4 soon ?

- Cloudera has some additional repository available, that can replace the base repository of Rogue Wave for the CentOS images Cloudera added in the Azure Marketplace?

Re: Cloudera CentOS 7.2 on Azure - how to update to CentOS 7.3 ?

cjervis — Mon, 16 Oct 2017 12:48:43 GMT

I started to dig deeper into documentation and quickly determined I would be better off simply some of my contacts for assistance here. Let me see if I can find anything out get find someone to chime in. 🙂

Re: Cloudera CentOS 7.2 on Azure - how to update to CentOS 7.3 ?

nedmar — Mon, 16 Oct 2017 14:44:11 GMT

Hi cjervis

I just found that Cloudera Manager 5.13.x is now supported on CentOS 7.4

So, I think the Cloudera team was silently listening and fixing things... 😄

https://www.cloudera.com/documentation/enterprise/release-notes/topics/rn_consolidated_pcm.html#concept_dcw_m5v_jz

Re: Cloudera CentOS 7.2 on Azure - how to update to CentOS 7.3 ?

gzigldrum — Mon, 16 Oct 2017 14:50:44 GMT

New OS releases can be tested and certified only with new Cloudera Manager / CDH versions.

With the recent 5.13 release, RedHat / CentOS 7.4 is now supported for the 5.11, 5.12 and 5.13 releases, see CDH and Cloudera Manager Supported Operating Systems