question Re: Installation of Hadoop using Cloudera manager url in Archives of Support Questions (Read Only)

Installation of Hadoop using Cloudera manager url

syed101 — Tue, 07 Feb 2017 07:39:37 GMT

Error: Package: cloudera-manager-agent-5.10.0-1.cm5100.p0.85.el6.x86_64 (cloudera-manager)
Requires: fuse-libs
Error: Package: cloudera-manager-agent-5.10.0-1.cm5100.p0.85.el6.x86_64 (cloudera-manager)
Requires: openssl-devel
Error: Package: cloudera-manager-agent-5.10.0-1.cm5100.p0.85.el6.x86_64 (cloudera-manager)
Requires: httpd
Error: Package: cloudera-manager-agent-5.10.0-1.cm5100.p0.85.el6.x86_64 (cloudera-manager)
Requires: fuse
Error: Package: cloudera-manager-agent-5.10.0-1.cm5100.p0.85.el6.x86_64 (cloudera-manager)
Requires: MySQL-python
Error: Package: cloudera-manager-agent-5.10.0-1.cm5100.p0.85.el6.x86_64 (cloudera-manager)
Requires: mod_ssl
You could try using --skip-broken to work around the problem
You could try running: rpm -Va --nofiles --nodigest

Re: Installation of Hadoop using Cloudera manager url

truonala — Tue, 07 Feb 2017 14:23:58 GMT

Looks like you will need to manually install the required software:

Requires: fuse-libs

Requires: openssl-devel

Requires: httpd

Requires: fuse

Requires: MySQL-python

Requires: mod_ssl

on all your hosts, then reinstall the Cloudera manager agents.

Re: Installation of Hadoop using Cloudera manager url

mbigelow — Tue, 07 Feb 2017 19:48:28 GMT

Fuse should be part of the CDH repo but httpd and openssl, etc. should come from the OS or possible epel repos. What OS are you using?

You will need to manage these dependencies manually or set up the CM repo on all nodes and use your package manager.

Just checking but is there a reason you are not pushing it through CM?

Re: Installation of Hadoop using Cloudera manager url

syed101 — Wed, 08 Feb 2017 04:54:35 GMT

Hi, do you have any idea which location (url) to get all the required missing softwares?

Thanks in advance

Re: Installation of Hadoop using Cloudera manager url

syed101 — Wed, 08 Feb 2017 04:57:20 GMT

Hi I am using Redhat linux 6.4 release, where do I get os packages for openssl and httpd. I don't have Red Hat subscription account. How do I update the above packages in my OS

Re: Installation of Hadoop using Cloudera manager url

mbigelow — Wed, 08 Feb 2017 04:59:19 GMT

try 'sudo yum list installed | grep <package>'

that will tell you if it is available in the currently installed repositories and which ones. Let me know if you can't find one or more of them.

Re: Installation of Hadoop using Cloudera manager url

syed101 — Wed, 08 Feb 2017 07:48:04 GMT

All the packages which are throwing errors are not available when I list using yum command. Please help me to get the rpms of the package lists.

Re: Installation of Hadoop using Cloudera manager url

truonala — Wed, 08 Feb 2017 14:55:10 GMT

You need the epel repository which you probably do not have in your older version of CentOS 6.4.

Look at this page https://fedoraproject.org/wiki/EPEL read under

How can I use these extra packages?

you need to get the repo, then enable the repo and install python, I think you will get all the software you need installed that way.

yum --enablerepo=epel install python26-devel

or some command like that.

Hope this helps.

Re: Installation of Hadoop using Cloudera manager url

syed101 — Thu, 09 Feb 2017 05:10:11 GMT

As per your direction successfully installed epel repository. But I couldn't find the packages fuse,fuse-libs, open-ssl,httpd,mod-ssl,MYSQL-python packages in the list where epel repository uses the url https://dl.fedoraproject.org/pub/epel/6/x86_64/

Please help me to resolve this to find the packages...

Re: Installation of Hadoop using Cloudera manager url

mbigelow — Thu, 09 Feb 2017 05:14:48 GMT

Please try 'sudo yum clean all'

Post the output of 'sudo yum repolist' to confirm that the epel repo is present and loaded correctly.

Re: Installation of Hadoop using Cloudera manager url

syed101 — Thu, 09 Feb 2017 05:57:31 GMT

I could able to resolve the dependencies of fuse and fuse-libs using the repository which uses the url http://mirrors.fedoraproject.org/mirrorlist?repo=extras-6&arch=$basearch

Still waiting for the installation of other packages like httpd, open-ssl, http, mod-ssl etc..

Thanks,

Best Regards

Re: Installation of Hadoop using Cloudera manager url

mbigelow — Thu, 09 Feb 2017 06:13:09 GMT

fuse.x86_64 2.9.2-7.el7 @rhui-REGION-rhel-server-releases
fuse-libs.x86_64 2.9.2-7.el7 @rhui-REGION-rhel-server-releases
httpd.x86_64 2.4.6-45.el7 @rhui-REGION-rhel-server-releases
openssl.x86_64 1:1.0.1e-60.el7 @rhui-REGION-rhel-server-releases

There are the ones I could find from my RHEL 7.1 in AWS. I am pretty sure that http and mod-ssl will be install as a dependency of the others.

From the repolist command:

rhui-REGION-rhel-server-releases Red Hat Enterprise Linux Server 7 (RPMs)

It should be part of the base OS repository. If that repo is present try enabling using the command posted earlier.

Re: Installation of Hadoop using Cloudera manager url

syed101 — Thu, 09 Feb 2017 06:20:23 GMT

Hi I am using RHEL 6 and not RHEL 7

Re: Installation of Hadoop using Cloudera manager url

mbigelow — Thu, 09 Feb 2017 06:21:58 GMT

So your repo would state that it is for RHEL 6. The commands are the same. Do you have the base RHEL 6 repo available?

Re: Installation of Hadoop using Cloudera manager url

syed101 — Thu, 09 Feb 2017 07:54:17 GMT

I could complete the installation of all the packages successfully except open-ssl..

I have used the rpm file openssl-devel-1.1.0d-2.fc26.x86_64.rpm for installation of open-ssl.

I have resulted with the following dependency errors:

error: Failed dependencies:
        krb5-devel(x86-64) is needed by openssl-devel-1:1.1.0d-2.fc26.x86_64
        libcrypto.so.1.1()(64bit) is needed by openssl-devel-1:1.1.0d-2.fc26.x86_64
        libssl.so.1.1()(64bit) is needed by openssl-devel-1:1.1.0d-2.fc26.x86_64
        openssl-libs(x86-64) = 1:1.1.0d-2.fc26 is needed by openssl-devel-1:1.1.0d-2.fc26.x86_64

Am I using the right rpm file...Your help is of great use.

Re: Installation of Hadoop using Cloudera manager url

mbigelow — Thu, 09 Feb 2017 07:59:54 GMT

Did you search as 'open-ssl' or 'openssl'? The package names needs to be precise.

Can you try to install the CM agent again to see if it still complains about this dependency? I have never had to have it installed until I implement TLS for CM Agents.

Re: Installation of Hadoop using Cloudera manager url

syed101 — Thu, 09 Feb 2017 10:03:26 GMT

CM agent is failing with the error

Error: Package: cloudera-manager-agent-5.10.0-1.cm5100.p0.85.el6.x86_64 (cloudera-manager)
Requires: openssl-devel

Re: Installation of Hadoop using Cloudera manager url

syed101 — Thu, 09 Feb 2017 11:48:02 GMT

Hi CM agent is installed successfully.

Now hadoop throws errors:

Error: Package: hadoop-2.6.0+cdh5.10.0+2102-1.cdh5.10.0.p0.72.el6.x86_64 (cloudera-cdh5)
Requires: nc

Re: Installation of Hadoop using Cloudera manager url

syed101 — Sun, 12 Feb 2017 05:26:26 GMT

Thanks Gurus.

The installaiton of all packages successful.

During the Cluster setup, while deploying client configuration the following errors were thrown:

Command failed to run because service Hive has invalid configuration. Review and correct its configuration. First error: Hive Metastore Database Host must be configured when Hive metastore is configured to use a database other than Derby.

Please help to resolve this error

Re: Installation of Hadoop using Cloudera manager url

syed101 — Sun, 12 Feb 2017 11:51:56 GMT

WARNING: Can't load server.xml from /var/lib/oozie/tomcat-deployment/conf/server.xml
Feb 12, 2017 3:48:30 PM org.apache.catalina.startup.Catalina load
WARNING: Can't load server.xml from /var/lib/oozie/tomcat-deployment/conf/server.xml
Feb 12, 2017 3:48:30 PM org.apache.catalina.startup.Catalina start
SEVERE: Cannot start server. Server instance is not configured.