Reply
New Contributor
Posts: 4
Registered: ‎10-05-2017
Accepted Solution

Cloudera CentOS 7.2 on Azure - how to update to CentOS 7.3 ?

[ Edited ]


I created a new VM in Azure using the marketplace CentOS 7.2 from Cloudera.
Installed the Cloudera manager on it, all good.
Now, if I want to update the VM, there are 2 problems:
1. LIS drivers go in dependency issue (this can be mitigated by removing the LIS drivers before updating)

V drivers [root@vmhostname ~] # rpm -qa |grep microsoft
microsoft-hyper-v-4.2.0-20170421.x86_64
microsoft-hyper-v-debuginfo-4.2.0-20170421.x86_64
kmod-microsoft-hyper-v-4.2.0-20170421.x86_64

[root@vmhostname ~] #rpm -e microsoft-hyper-v-4.2.0-20170421.x86_64 kmod-microsoft-hyper-v-4.2.0-20170421.x86_64 microsoft-hyper-v-debuginfo-4.2.0-20170421.x86_64
Removing Package..
Stopping KVP Daemon....
Stopping FCOPY Daemon....
Stopping VSS Daemon....
Create and install initramfs without Hyper-Linux Integration Services for Hyper-V has been removed.
Please reboot your system.  

[root@vmhostname ~] # reboot 

 
 After reboot, you can go ahead with the update: 

 

 [root@vmhostname ~] # yum update 

 
 Check if you have any other dependency issues. If none, you're OK and can continue with the yum update. So.. let's say this part is OK
 
 2. The update skips a release, and goes directly to CentOS7.4, with the Kernel-3.10.0-693.* ... which, according to this page ( https://www.cloudera.com/documentation/enterprise/release-notes/topics/rn_consolidated_pcm.html#gate... ) is not supported..
 

$cat  /etc/*release
CentOS Linux release 7.2.1511 (Core)
NAME="CentOS Linux"
VERSION="7 (Core)"
ID="centos"
ID_LIKE="rhel fedora"
VERSION_ID="7"
PRETTY_NAME="CentOS Linux 7 (Core)"
ANSI_COLOR="0;31"
CPE_NAME="cpe:/o:centos:centos:7"
HOME_URL="https://www.centos.org/"
BUG_REPORT_URL="https://bugs.centos.org/"
 
CENTOS_MANTISBT_PROJECT="CentOS-7"
CENTOS_MANTISBT_PROJECT_VERSION="7"
REDHAT_SUPPORT_PRODUCT="centos"
REDHAT_SUPPORT_PRODUCT_VERSION="7"
 
CentOS Linux release 7.2.1511 (Core)
CentOS Linux release 7.2.1511 (Core)

 
The repository shows something unexpected; it uses RogueWave (former OpenLogic) repository to update the CentOS base:
 

$ cat /etc/yum.repos.d/CentOS-Base.repo
[openlogic]
name=CentOS-7 - openlogic packages for $basearch
baseurl=http://olcentgbl.trafficmanager.net/openlogic/7/openlogic/$basearch/
enabled=1
gpgcheck=0
 
[base]
name=CentOS-7 - Base
baseurl=http://olcentgbl.trafficmanager.net/centos/7/os/$basearch/
gpgcheck=1
gpgkey=file:///etc/pki/rpm-gpg/RPM-GPG-KEY-CentOS-7
 
#released updates
[updates]
name=CentOS-7 - Updates
baseurl=http://olcentgbl.trafficmanager.net/centos/7/updates/$basearch/
gpgcheck=1
gpgkey=file:///etc/pki/rpm-gpg/RPM-GPG-KEY-CentOS-7
 
#additional packages that may be useful
[extras]
name=CentOS-$releasever - Extras
baseurl=http://olcentgbl.trafficmanager.net/centos/$releasever/extras/$basearch/
gpgcheck=1
gpgkey=file:///etc/pki/rpm-gpg/RPM-GPG-KEY-CentOS-7
 
#additional packages that extend functionality of existing packages
[centosplus]
name=CentOS-7 - Plus
baseurl=http://olcentgbl.trafficmanager.net/centos/7/centosplus/$basearch/
gpgcheck=1
enabled=0
gpgkey=file:///etc/pki/rpm-gpg/RPM-GPG-KEY-CentOS-7
 
#contrib - packages by Centos Users
[contrib]
name=CentOS-$releasever - Contrib
baseurl=http://olcentgbl.trafficmanager.net/centos/7/contrib/$basearch/
gpgcheck=1
enabled=0
gpgkey=file:///etc/pki/rpm-gpg/RPM-GPG-KEY-CentOS-7

I also added the cloudera repository for the manager.

 

Tried with "yum --releasever=7.3 update" but got an 404 error.

 

Checking the url http://olcentgbl.trafficmanager.net/centos/ in browser you will find the only CentOS7.3 related directory is one called 7.3.1611.
 
However: 

 

[root@vmhostname ~]# yum --releasever=7.3.1611 check-update | grep centos-release 
centos-release.x86_64              7-4.1708.el7.centos               base 

 

Checked with RogueWave, since is their repo, and they simply stated that 7.3 is deprecated and no longer supported.

 
So, how do I solve this?
- no longer update ?
- change the repository ?With what ?
- wait for Cloudera Manager to work in CentOS7.4 ?
- other options ?

 

New Contributor
Posts: 4
Registered: ‎10-05-2017

Re: Cloudera CentOS 7.2 on Azure - how to update to CentOS 7.3 ?

Any updates on this?

Anyone?

Highlighted
Posts: 614
Kudos: 69
Solutions: 36
Registered: ‎04-06-2015

Re: Cloudera CentOS 7.2 on Azure - how to update to CentOS 7.3 ?

While you are waiting for a more experienced person to chime in I thought I would provide a link to documentation on Upgrading Host Operating Systems in a CDH Cluster in hopes it may be of some assistance. 

 




Cy Jervis, Community Manager - I'm not an expert but will supply relevant content from time to time. :)

Learn more about the Cloudera Community:


Terms of Service


Community Guidelines


How to use the forum

New Contributor
Posts: 4
Registered: ‎10-05-2017

Re: Cloudera CentOS 7.2 on Azure - how to update to CentOS 7.3 ?

Hi cjervis,

 

Thank you for the idea and for the response, but that doesn't help.

 

The issue is simply related to CentOS version and compatibility with Cloudera software.

 

In Azure, the offer from Cloudera is a CentOS 7.2 version, created from a Rogue Wave initial image, or that is simply using the repository of Rogue Wave for updates.

 

The latest CentOS compatible version with the Cloudera Manager 5.11.1 seems to be CentOS7.3, but Rogue Wave doesn't support CentOS 7.3 and has disabled the repository for it, forcing CentOS 7.4 as upgrade from CentOS 7.2.

 

But Cloudera Manager  5.11.1 isn't compatible with CentOS 7.4. So, no update is possible.

 

I suppose, at this point, the question is:

- Cloudera Manager will get some update to work with CentOS 7.4 soon ?

- Cloudera has some additional repository available, that can replace the base repository of Rogue Wave for the CentOS images Cloudera added in the Azure Marketplace?

Posts: 614
Kudos: 69
Solutions: 36
Registered: ‎04-06-2015

Re: Cloudera CentOS 7.2 on Azure - how to update to CentOS 7.3 ?

I started to dig deeper into documentation and quickly determined I would be better off simply some of my contacts for assistance here. Let me see if I can find anything out get find someone to chime in. :)

 




Cy Jervis, Community Manager - I'm not an expert but will supply relevant content from time to time. :)

Learn more about the Cloudera Community:


Terms of Service


Community Guidelines


How to use the forum

New Contributor
Posts: 4
Registered: ‎10-05-2017

Re: Cloudera CentOS 7.2 on Azure - how to update to CentOS 7.3 ?

Hi cjervis 

 

I just found that Cloudera Manager 5.13.x is now supported on CentOS 7.4

So, I think the Cloudera team was silently listening and fixing things... :D 

 

 

https://www.cloudera.com/documentation/enterprise/release-notes/topics/rn_consolidated_pcm.html#conc...

 

Cloudera Employee
Posts: 25
Registered: ‎01-15-2015

Re: Cloudera CentOS 7.2 on Azure - how to update to CentOS 7.3 ?

[ Edited ]

New OS releases can be tested and certified only with new Cloudera Manager / CDH versions.


With the recent 5.13 release, RedHat / CentOS 7.4 is now supported for the 5.11, 5.12 and 5.13 releases, see CDH and Cloudera Manager Supported Operating Systems

Announcements