Not able to install agents when trying to add a host in an existing cluster

[#1]

I have a cluster with Cloudera manager version of 6.3.0 and 2 hosts already.

Both the hosts have CentOS - 7

I am trying to add a new host server with CentOS - 6.9. While trying to add I have successfully passed through the below steps except one:

1) Specify Hosts- added one host

2) Select Repository- the public repository is chosen.

3) Accept JDK License- checkbox unchecked as I have already installed it and set JAVA_HOME

4) Enter Login Credentials- have root access/password

5) Install Agents- NOW during this phase in getting error as: Installation failed. Failed to install cloudera-manager-agent package.

When I checked my logs from cloudera manager in : /var/log/cloudera-scm-server/

I saw this one warning and two error printed as follows:

WARN NodeConfiguratorThread-22-0:com.cloudera.server.cmf.node.NodeConfigurator: Command bash -c 'bash /tmp/scm_prepare_node.kB9YnFSV/scm_prepare_node.sh --server_version 6.3.0 --server_build 1281944 --packages /tmp/scm_prepare_node.kB9YnFSV/packages.scm --always /tmp/scm_prepare_node.kB9YnFSV/always_install.scm --x86_64 /tmp/scm_prepare_node.kB9YnFSV/x86_64_packages.scm --certtar /tmp/scm_prepare_node.kB9YnFSV/cert.tar --unlimitedJCE false --javaInstallStrategy NONE --agentUserMode ROOT --cm https://archive.cloudera.com/cm6/6.3.0 --skipCloudConfig false | tee /tmp/scm_prepare_node.kB9YnFSV/scm_prepare_node.log; exit ${PIPESTATUS[0]}' on inmuzv-spe-dea15187.zycus.net finished with exit status 1

ERROR CommandPusher:com.cloudera.cmf.command.flow.WorkOutputs: CMD id: 9067 Failed to complete installation on host server1.abc.net.

ERROR CommandPusher:com.cloudera.cmf.model.DbCommand: Command 9067(GlobalHostInstall) has completed. finalstate:FINISHED, success:false, msg:Failed to complete installation.

Can somebody please explain to me the above issue and how to solve them so that I can add the host?

Also, I have https://archive.cloudera.com/cm6 whitelisted.

Thank you in advance!

[#2]

@backlashhardik I am wondering if this is due to RHEL version difference. Since you are trying to add 6.9 hosts and CM is running on RHEL 7. 

Have to tried to install agent manually on host and then add it to CM? 

[#3]

Hey, @GangWar thanks for your input.

As I tried to install the agent manually it says it's already installed.

Following the below link: https://docs.cloudera.com/documentation/enterprise/latest/topics/install_cloudera_packages.html

It has the following command which I ran:

sudo yum install cloudera-manager-agent cloudera-manager-daemons

The above gave me:

Loaded plugins: fastestmirror
Setting up Install Process
Loading mirror speeds from cached hostfile
Package cloudera-manager-agent-6.3.0-2117683.el6.x86_64 already installed and latest version
Package cloudera-manager-daemons-6.3.0-2117683.el6.x86_64 already installed and latest version
Nothing to do

Then I tried to add the host using Cloudera manager, it didn't work

No, manual installation did not work either.

[#4]

@backlashhardik  The manual process means install agent beforehand on all of the hosts which you are going to add. Make sure you have local repo or internet access. 

sudo yum install cloudera-manager-agent cloudera-manager-daemons

 If agent is installed then reinstall to avoid any issue once again. 

sudo yum reinstall cloudera-manager-agent cloudera-manager-daemons

 Then you have to modify the /etc/cloudera-scm-agent/config.ini file and post this to CM server, also if TLS is enabled make necessary changes. 

[General]
# Hostname of the CM server.
server_host=host-xx.xxx.xxx.cloudera.com

Then go to the CM and try to add hosts from there. Since agent is already installed this should not take much time and you can start agent then and see if that helps.