Removing and adding same nodes to cluster - Not working

[#1]

We have 2 edge nodes whose health is bad and services were not running so we removed them from the cluster and tried to add it back as new hosts to the cluster. While doing that it is getting stuck at the activation part but the nodes got added to the cluster.

Now we see the CDH version as none and we are not able to start any service on these 2 edge nodes and are showing bad health but we are seing hearbeat and these hosts are not in contact with the host monitor.

Could you please help me to get the two nodes working?

[#2]

The below error is thrown on the node - in logs

Caught unexpected exception in main loop.
Traceback (most recent call last):
File "/usr/lib64/cmf/agent/build/env/lib/python2.7/site-packages/cmf-5.9.0-py2.7.egg/cmf/agent.py", line 758, in start
self._init_after_first_heartbeat_response(resp_data)
File "/usr/lib64/cmf/agent/build/env/lib/python2.7/site-packages/cmf-5.9.0-py2.7.egg/cmf/agent.py", line 938, in _init_after_first_heartbeat_response
self.client_configs.load()
File "/usr/lib64/cmf/agent/build/env/lib/python2.7/site-packages/cmf-5.9.0-py2.7.egg/cmf/client_configs.py", line 686, in load
new_deployed.update(self._lookup_alternatives(fname))
File "/usr/lib64/cmf/agent/build/env/lib/python2.7/site-packages/cmf-5.9.0-py2.7.egg/cmf/client_configs.py", line 432, in _lookup_alternatives
return self._parse_alternatives(alt_name, out)
File "/usr/lib64/cmf/agent/build/env/lib/python2.7/site-packages/cmf-5.9.0-py2.7.egg/cmf/client_configs.py", line 444, in _parse_alternatives
path, _, _, priority_str = line.rstrip().split(" ")
ValueError: too many values to unpack

How can this be fixed?

[#3]

Hi renuka20,

The stack trace you are listing seems to be a known issue.

can you show the output of the following command;

grep -E "@.*@" /var/lib/alternatives/*

If it returns a value then you will need to adjust your alternatives configuration file, preferably upgrade CM to the latest version or maintenance release.