ERROR MESSAGE:This host is not in contact with the Host Monitor.

[#1]

Hi ,

I want to add a host to cluster as a datanode.

Now i can find the host in host list and adding the New Hosts to existing Cluster.

it looks it takes time because i began it 1hours ago but it is still running.

And i can find it in the cluster with new windows even the processing is running.  

Bus Health test is bad.

"This host is in contact with the Cloudera Manager Server. This host is not in contact with the Host Monitor."

How can i investigate it ?

[#2]

i'm sure i started agent in the host(datanode).

/etc/init.d/cloudera-scm-agent status
cloudera-scm-agent (pid  112359) is running...

[#3]

And i confirmed the log of host and found it.

Caught unexpected exception in main loop.
Traceback (most recent call last):
  File "/usr/lib64/cmf/agent/build/env/lib/python2.6/site-packages/cmf-5.10.0-py2.6.egg/cmf/agent.py", line 710, in __issue_heartbeat
    self._init_after_first_heartbeat_response(resp_data)
  File "/usr/lib64/cmf/agent/build/env/lib/python2.6/site-packages/cmf-5.10.0-py2.6.egg/cmf/agent.py", line 881, in _init_after_first_heartbeat_response
    assert response_data.get("cm_guid") is not None
AssertionError

[#4]

I restarted host monitor , but it still not working.

[#5]

Whats the status of cloudera-scm-server-db and cloudera-scm-server ? 

Please share your Cloudera Manager Agent logs and Host monitor logs for more insight .

[#6]

Hi csguna ,

Working fine.

I want to add a new datanode to existing system.
and existing system is working fine .

The added host not work well only.

[#7]

Can you restart the Cloudera Manager Agent on that host .

to see if it could receive the heart beat

[#8]

I restarted the agent in host.

But can't reslove it .

And i found i can't get the CDH version ("None") in the host list.

But existing datanode shows "CDH 5"

[#9]

Host Monitor come under the Cloudera manger server  , you could restart 

sudo service cloudera-scm-server restart
 

 to see if that fix the issue. 

[#10]

I restarted the CDM and HOST MONITOR, it still can't be resloved.

And i can't find CDH version in host list also for new host.

By the way , HOST MONITOR service and other datanode (existing) is working fine.

so i guess some setting in new host is not good.