Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Cloudera CDP 7.1 Beta installations on RHEL 7.6 giving errors and not able to install cloudera daemons, agent and server components

Cloudera CDP 7.1 Beta installations on RHEL 7.6 giving errors and not able to install cloudera daemons, agent and server components

New Contributor

Hello Cloudera Team,

Platform - UCS hadoop clusters / Rhel 7.6

Please help me out solve this below situation when I was downloading CDP 7.1.1 early bits from my partner at cloudera. We have tried earlier CDP 7.0.3 and it worked in our platform but after following the similar download and integration steps with CDP 7.1.1, the installation of daemons, agent, and server fails repeatedly. One more observations during the installing of CDP 7.1.1 -

1. Had to install CM7 and RPMS directly under "cloudera-repos" separately to download the components where it did not download them automatically.

[root@rhel1 x86_64]# rpm -qa 'cloudera-manager-*' >>>>shows nothing????

[root@rhel1 cm7]# reposync --config=./cloudera-manager-trial.repo --repoid=cloudera-manager
Traceback (most recent call last):
File "/usr/bin/reposync", line 373, in <module>
main()
File "/usr/bin/reposync", line 185, in main
my.doRepoSetup()
File "/usr/lib/python2.7/site-packages/yum/__init__.py", line 681, in doRepoSetup
return self._getRepos(thisrepo, True)
File "/usr/lib/python2.7/site-packages/yum/__init__.py", line 721, in _getRepos
self._repos.doSetup(thisrepo)
File "/usr/lib/python2.7/site-packages/yum/repos.py", line 157, in doSetup
self.retrieveAllMD()
File "/usr/lib/python2.7/site-packages/yum/repos.py", line 88, in retrieveAllMD
dl = repo._async and repo._commonLoadRepoXML(repo)
File "/usr/lib/python2.7/site-packages/yum/yumRepo.py", line 1482, in _commonLoadRepoXML
result = self._getFileRepoXML(local, text)
File "/usr/lib/python2.7/site-packages/yum/yumRepo.py", line 1259, in _getFileRepoXML
size=102400) # setting max size as 100K
File "/usr/lib/python2.7/site-packages/yum/yumRepo.py", line 1042, in _getFile
raise e
yum.Errors.NoMoreMirrorsRepoError: failure: repodata/repomd.xml from cloudera-manager: [Errno 256] No more mirrors to try.

https://archive.cloudera.com/p/cm7/7.1.1/redhat7/yum/repodata/repomd.xml: [Errno 14] HTTPS Error 401 - Unauthorized

[root@rhel1 x86_64]# createrepo --baseurl http://10.18.1.131/cloudera-repos/cm7/ /var/www/html/cloudera-repos/cm7/
Spawning worker 0 with 1 pkgs
Spawning worker 1 with 1 pkgs
Spawning worker 2 with 1 pkgs
Spawning worker 3 with 1 pkgs
Spawning worker 4 with 1 pkgs
Spawning worker 5 with 1 pkgs
Spawning worker 6 with 0 pkgs
Spawning worker 7 with 0 pkgs
Spawning worker 8 with 0 pkgs
Spawning worker 9 with 0 pkgs
Spawning worker 10 with 0 pkgs
Spawning worker 11 with 0 pkgs
Spawning worker 12 with 0 pkgs
Spawning worker 13 with 0 pkgs
Spawning worker 14 with 0 pkgs
Spawning worker 15 with 0 pkgs
Spawning worker 16 with 0 pkgs
Spawning worker 17 with 0 pkgs
Spawning worker 18 with 0 pkgs
Spawning worker 19 with 0 pkgs
Spawning worker 20 with 0 pkgs
Spawning worker 21 with 0 pkgs
Spawning worker 22 with 0 pkgs
Spawning worker 23 with 0 pkgs
Spawning worker 24 with 0 pkgs
Spawning worker 25 with 0 pkgs
Spawning worker 26 with 0 pkgs
Spawning worker 27 with 0 pkgs
Spawning worker 28 with 0 pkgs
Spawning worker 29 with 0 pkgs
Spawning worker 30 with 0 pkgs
Spawning worker 31 with 0 pkgs
Spawning worker 32 with 0 pkgs
Spawning worker 33 with 0 pkgs
Spawning worker 34 with 0 pkgs
Spawning worker 35 with 0 pkgs
Spawning worker 36 with 0 pkgs
Spawning worker 37 with 0 pkgs
Spawning worker 38 with 0 pkgs
Spawning worker 39 with 0 pkgs
Spawning worker 40 with 0 pkgs
Spawning worker 41 with 0 pkgs
Spawning worker 42 with 0 pkgs
Spawning worker 43 with 0 pkgs
Spawning worker 44 with 0 pkgs
Spawning worker 45 with 0 pkgs
Spawning worker 46 with 0 pkgs
Spawning worker 47 with 0 pkgs
Workers Finished
Saving Primary metadata
Saving file lists metadata
Saving other metadata
Generating sqlite DBs
Sqlite DBs complete

 

[root@rhel1 x86_64]# rpm -qa 'cloudera-manager-*'
[root@rhel1 x86_64]# reposync --config=./cloudera-manager-trial.repo --repoid=cloudera-manager
Traceback (most recent call last):
File "/usr/bin/reposync", line 373, in <module>
main()
File "/usr/bin/reposync", line 158, in main
my.doConfigSetup(fn=opts.config, init_plugins=opts.plugins)
File "/usr/lib/python2.7/site-packages/yum/__init__.py", line 298, in doConfigSetup
return self.conf
File "/usr/lib/python2.7/site-packages/yum/__init__.py", line 1079, in <lambda>
conf = property(fget=lambda self: self._getConfig(),
File "/usr/lib/python2.7/site-packages/yum/__init__.py", line 349, in _getConfig
startupconf = config.readStartupConfig(fn, root, releasever)
File "/usr/lib/python2.7/site-packages/yum/config.py", line 1092, in readStartupConfig
confpp_obj = ConfigPreProcessor(configfile)
File "/usr/lib/python2.7/site-packages/yum/parser.py", line 93, in __init__
fo = self._pushfile( url )
File "/usr/lib/python2.7/site-packages/yum/parser.py", line 206, in _pushfile
'Error accessing file for config %s' % (absurl)
yum.Errors.ConfigError: Error accessing file for config file:///var/www/html/cloudera-repos/cm7/RPMS/x86_64/./cloudera-manager-trial.repo

[root@rhel1 ~]# ls /var/www/html/cloudera-repos/cm7/RPMS/x86_64/
cloudera-manager-agent-7.1.1-2414160.el7.x86_64.rpm cloudera-manager-server-7.1.1-2414160.el7.x86_64.rpm enterprise-debuginfo-7.1.1-2414160.el7.x86_64.rpm
cloudera-manager-daemons-7.1.1-2414160.el7.x86_64.rpm cloudera-manager-server-db-2-7.1.1-2414160.el7.x86_64.rpm openjdk8-8.0+232_9-cloudera.x86_64.rpm

[root@rhel1 ~]# rm -fr /var/cache/yum/*
[root@rhel1 ~]# yum clean all

[root@rhel1 ~]# yum repolist
Loaded plugins: langpacks, product-id, search-disabled-repos, subscription-manager
repo id repo name status
!cloudera-repo Cloudera Manager 7.1.1           6
rhel-7-server-ansible-2-rpms/x86_64 Red Hat Ansible Engine 2 RPMs for Red Hat Enterprise Linux 7 Server      65
rhel-7-server-rpms/7Server/x86_64 Red Hat Enterprise Linux 7 Server (RPMs)       28,773
!rhel7.6 Red Hat Enterprise Linux 7.6      5,259
repolist: 34,103

[root@rhel1 repodata]# cat repomd.xml
<?xml version="1.0" encoding="UTF-8"?>
<repomd xmlns="http://linux.duke.edu/metadata/repo" xmlns:rpm="http://linux.duke.edu/metadata/rpm">
<revision>1587524316</revision>
<data type="filelists">
<checksum type="sha256">401dc19bda88c82c403423fb835844d64345f7e95f5b9835888189c03834cc93</checksum>
<open-checksum type="sha256">bf9808b81cb2dbc54b4b8e35adc584ddcaa73bd81f7088d73bf7dbbada961310</open-checksum>
<location xml:base="http://10.18.1.131/cloudera-repos/cm7/" href="repodata/401dc19bda88c82c403423fb835844d64345f7e95f5b9835888189c03834cc93-filelists.xml.gz"/>
<timestamp>1587524316</timestamp>
<size>123</size>
<open-size>125</open-size>
</data>
<data type="primary">
<checksum type="sha256">dabe2ce5481d23de1f4f52bdcfee0f9af98316c9e0de2ce8123adeefa0dd08b9</checksum>
<open-checksum type="sha256">e1e2ffd2fb1ee76f87b70750d00ca5677a252b397ab6c2389137a0c33e7b359f</open-checksum>
<location xml:base="http://10.18.1.131/cloudera-repos/cm7/" href="repodata/dabe2ce5481d23de1f4f52bdcfee0f9af98316c9e0de2ce8123adeefa0dd08b9-primary.xml.gz"/>
<timestamp>1587524316</timestamp>
<size>134</size>
<open-size>167</open-size>
</data>
<data type="primary_db">
<checksum type="sha256">5dc1e6e73c84803f059bb3065e684e56adfc289a7e398946574d79dac6643945</checksum>
<open-checksum type="sha256">f0d550414e8f2e960e82e704549364299ca9e3e8664ad4faffd208262c3b6d12</open-checksum>
<location xml:base="http://10.18.1.131/cloudera-repos/cm7/" href="repodata/5dc1e6e73c84803f059bb3065e684e56adfc289a7e398946574d79dac6643945-primary.sqlite.bz2"/>
<timestamp>1587524316</timestamp>
<database_version>10</database_version>
<size>1131</size>
<open-size>21504</open-size>
</data>
<data type="other_db">
<checksum type="sha256">7c36572015e075add2b38b900837bcdbb8a504130ddff49b2351a7fc0affa3d4</checksum>
<open-checksum type="sha256">4de0fe7c5dd2674849a7c63c326e42f33af0a0f46219bc6dd59f51dfa2ac8c68</open-checksum>
<location xml:base="http://10.18.1.131/cloudera-repos/cm7/" href="repodata/7c36572015e075add2b38b900837bcdbb8a504130ddff49b2351a7fc0affa3d4-other.sqlite.bz2"/>
<timestamp>1587524316</timestamp>
<database_version>10</database_version>
<size>575</size>
<open-size>6144</open-size>
</data>
<data type="other">
<checksum type="sha256">6bf9672d0862e8ef8b8ff05a2fd0208a922b1f5978e6589d87944c88259cb670</checksum>
<open-checksum type="sha256">e0ed5e0054194df036cf09c1a911e15bf2a4e7f26f2a788b6f47d53e80717ccc</open-checksum>
<location xml:base="http://10.18.1.131/cloudera-repos/cm7/" href="repodata/6bf9672d0862e8ef8b8ff05a2fd0208a922b1f5978e6589d87944c88259cb670-other.xml.gz"/>
<timestamp>1587524316</timestamp>
<size>123</size>
<open-size>121</open-size>
</data>
<data type="filelists_db">
<checksum type="sha256">01a3b489a465bcac22a43492163df43451dc6ce47d27f66de289756b91635523</checksum>
<open-checksum type="sha256">c4211f57bdcbb142c9f93a6d32401539f775eb6a670ab7a423e13f435ce94689</open-checksum>
<location xml:base="http://10.18.1.131/cloudera-repos/cm7/" href="repodata/01a3b489a465bcac22a43492163df43451dc6ce47d27f66de289756b91635523-filelists.sqlite.bz2"/>
<timestamp>1587524316</timestamp>
<database_version>10</database_version>
<size>586</size>
<open-size>7168</open-size>
</data>
</repomd>

 

Thanks in advance for your help!

1 REPLY 1
Highlighted

Re: Cloudera CDP 7.1 Beta installations on RHEL 7.6 giving errors and not able to install cloudera daemons, agent and server components

Moderator

Hello @yramesh ,

 

thank you for raising your issue hitting 401 exception. It means authentication issue. When you navigate to the link via browser where you wanted to download the repodata, it prompts for username and password. It means only subsciption customers can access this file.

 

For C7 there are files in 2 different repos. One for paying customers one for trial.
https://archive.cloudera.com/cm7/7.0.3/redhat7/yum/cloudera-manager-trial.repo is the free trial .repo file to download.

 

For subscription customers to identify authentication credentials using the license key file, the below steps should be followed [1]:
From cloudera.com, log into the cloudera.com account associated with the CDP Data Center license and subscription agreement.
On the CDP Data Center Download page, click Download Now and scroll down to the Credential Generator.
In the Generate Credentials text box, copy and paste the text of the “PGP Signed Message” within the license key file and click Get Credentials. The credentials generator returns the username and password.

 

Please let me know if you hit any different issue.


Best regards:

Ferenc

 

[1] https://docs.cloudera.com/cdpdc/7.0/installation/topics/cdpdc-cm-download-information.html


Ferenc Erdelyi, Technical Solutions Manager

Was your question answered? Make sure to mark the answer as the accepted solution.
If you find a reply useful, say thanks by clicking on the thumbs up button.

Learn more about the Cloudera Community:

Don't have an account?
Coming from Hortonworks? Activate your account here