question Re: This host is not in contact with the Host Monitor. in Support Questions

ERROR MESSAGE:This host is not in contact with the Host Monitor.

wenjie — Fri, 16 Sep 2022 11:16:12 GMT

Hi ,

I want to add a host to cluster as a datanode.

Now i can find the host in host list and adding the New Hosts to existing Cluster.

it looks it takes time because i began it 1hours ago but it is still running.

And i can find it in the cluster with new windows even the processing is running.

Bus Health test is bad.

"This host is in contact with the Cloudera Manager Server. This host is not in contact with the Host Monitor."

How can i investigate it ?

Re: This host is not in contact with the Host Monitor.

wenjie — Fri, 17 Mar 2017 06:47:51 GMT

i'm sure i started agent in the host(datanode).

/etc/init.d/cloudera-scm-agent status
cloudera-scm-agent (pid 112359) is running...

Re: This host is not in contact with the Host Monitor.

wenjie — Fri, 17 Mar 2017 06:55:28 GMT

And i confirmed the log of host and found it.

Caught unexpected exception in main loop.
Traceback (most recent call last):
File "/usr/lib64/cmf/agent/build/env/lib/python2.6/site-packages/cmf-5.10.0-py2.6.egg/cmf/agent.py", line 710, in __issue_heartbeat
self._init_after_first_heartbeat_response(resp_data)
File "/usr/lib64/cmf/agent/build/env/lib/python2.6/site-packages/cmf-5.10.0-py2.6.egg/cmf/agent.py", line 881, in _init_after_first_heartbeat_response
assert response_data.get("cm_guid") is not None
AssertionError

Re: This host is not in contact with the Host Monitor.

csguna — Fri, 17 Mar 2017 07:13:04 GMT

Whats the status of cloudera-scm-server-db and cloudera-scm-server ?

Please share your Cloudera Manager Agent logs and Host monitor logs for more insight .

Re: This host is not in contact with the Host Monitor.

wenjie — Fri, 17 Mar 2017 07:08:40 GMT

I restarted host monitor , but it still not working.

Re: This host is not in contact with the Host Monitor.

wenjie — Fri, 17 Mar 2017 07:12:57 GMT

Hi csguna ,

Working fine.

I want to add a new datanode to existing system.
and existing system is working fine .

The added host not work well only.

Re: This host is not in contact with the Host Monitor.

csguna — Fri, 17 Mar 2017 07:15:16 GMT

Can you restart the Cloudera Manager Agent on that host .

to see if it could receive the heart beat

Re: This host is not in contact with the Host Monitor.

wenjie — Fri, 17 Mar 2017 07:21:02 GMT

I restarted the agent in host.

But can't reslove it .

And i found i can't get the CDH version ("None") in the host list.

But existing datanode shows "CDH 5"

Re: This host is not in contact with the Host Monitor.

csguna — Fri, 17 Mar 2017 07:23:29 GMT

Host Monitor come under the Cloudera manger server , you could restart

sudo service cloudera-scm-server restart

to see if that fix the issue.

Re: This host is not in contact with the Host Monitor.

wenjie — Fri, 17 Mar 2017 08:33:57 GMT

I restarted the CDM and HOST MONITOR, it still can't be resloved.

And i can't find CDH version in host list also for new host.

By the way , HOST MONITOR service and other datanode (existing) is working fine.

so i guess some setting in new host is not good.

Re: This host is not in contact with the Host Monitor.

csguna — Fri, 17 Mar 2017 09:40:45 GMT

I am sorry confused here you intial problem is quote from ur post "This host is not in contact with the Host Monitor."

now you say HOST MONITOR service and other datanode (existing) is working fine - can i assume that the problem is solved or you have new problem arising .

also please share the host monitor and cm agent logs .

Re: This host is not in contact with the Host Monitor.

wenjie — Tue, 21 Mar 2017 05:57:10 GMT

NO ,

The problem has not be resolved.

Re: ERROR MESSAGE:This host is not in contact with the Host Monitor.

wenjie — Tue, 21 Mar 2017 06:17:42 GMT

I created a new ticket for this problem as a summury, but i can't find it , why?

I move it to here.

I want to add a host to existing cluster as a datanode.

But the host don't work fine as expected.

1, I confirmed status of agent and it is working fine.

cloudera-scm-agent (pid 162575) is running...

2, I restarted the cluster and CDM , the problem can't be resolve.

3, I stopped agent and add the host and restart agent again , the problem can't be resolve also.

Looking forward to your response.

And please let me know if you want more info.

Thanks,

Wenjie

Re: ERROR MESSAGE:This host is not in contact with the Host Monitor.

wenjie — Thu, 23 Mar 2017 02:11:51 GMT

I installed the host again , and the problem has been fixed.

I'm not sure the reason.

Re: ERROR MESSAGE:This host is not in contact with the Host Monitor.

csguna — Thu, 23 Mar 2017 02:49:35 GMT

sounds good .

Re: ERROR MESSAGE:This host is not in contact with the Host Monitor.

renuka20 — Thu, 10 Aug 2017 14:56:28 GMT

We are facing the same issue. What steps did you follow to install the host again?

Re: ERROR MESSAGE:This host is not in contact with the Host Monitor.

csguna — Fri, 11 Aug 2017 05:11:26 GMT

Could you share any error logs or screenshot ? where are you facing the issue ?

Were you able to see the CDH version in the Host summary ?

Re: ERROR MESSAGE:This host is not in contact with the Host Monitor.

renuka20 — Fri, 11 Aug 2017 13:56:31 GMT

Hi,

I removed 2 nodes from the cluster and tried to add them back from managed hosts and the download , distribute is successful but stuck at the activation.

But the 2 nodes got added to the cluster and show up in the hosts but CDH version is NONE.(Host in bad health)

Host Agent status:

This host is in contact with the Cloudera Manager Server. This host is not in contact with the Host Monitor.

Not able to run any services on these nodes and getting connection refusal to all ports except "7180"

Error in the cloudera-scm-agent

Caught unexpected exception in main loop.
Traceback (most recent call last):
  File "/usr/lib64/cmf/agent/build/env/lib/python2.7/site-packages/cmf-5.9.0-py2.7.egg/cmf/agent.py", line 758, in start
    self._init_after_first_heartbeat_response(resp_data)
  File "/usr/lib64/cmf/agent/build/env/lib/python2.7/site-packages/cmf-5.9.0-py2.7.egg/cmf/agent.py", line 938, in _init_after_first_heartbeat_response
    self.client_configs.load()
  File "/usr/lib64/cmf/agent/build/env/lib/python2.7/site-packages/cmf-5.9.0-py2.7.egg/cmf/client_configs.py", line 686, in load
    new_deployed.update(self._lookup_alternatives(fname))
  File "/usr/lib64/cmf/agent/build/env/lib/python2.7/site-packages/cmf-5.9.0-py2.7.egg/cmf/client_configs.py", line 432, in _lookup_alternatives
    return self._parse_alternatives(alt_name, out)
  File "/usr/lib64/cmf/agent/build/env/lib/python2.7/site-packages/cmf-5.9.0-py2.7.egg/cmf/client_configs.py", line 444, in _parse_alternatives
    path, _, _, priority_str = line.rstrip().split(" ")
ValueError: too many values to unpack

Could you please help me with this?

Re: ERROR MESSAGE:This host is not in contact with the Host Monitor.

narendarreddy — Wed, 23 Aug 2017 22:03:20 GMT

This issue in RHEL 7.3

1. We edited the /usr/lib64/cmf/agent/build/env/lib/python2.7/site-packages/cmf-5.9.0-py2.7.egg/cmf/client_configs.py file

2. Searched for "path, _" and line no 444

3. commented out the #path, _, _, priority_str = line.rstrip().split(" ") line.

4. Added three lines and add one tab at the beginning to match the other lines in the file:
thisLine = line.rstrip().split(" ")
path = thisLine[0]
priority_str = thisLine[-1]

5. The end result should look like:
#path, _, _, priority_str = line.rstrip().split(" ")
thisLine = line.rstrip().split(" ")
path = thisLine[0]
priority_str = thisLine[-1]

6 Restarted the agent:
sudo service cloudera-scm-agent restart

It started working

Thanks

Narendar

Re: This host is not in contact with the Host Monitor.

ssandona92 — Wed, 04 Oct 2017 11:04:44 GMT

I know this is a really old post but just for knowledge I'm sharing my solution. For me the restart of the agent in the CDH None host solved the problem

sudo service cloudera-scm-agent restart