@bgooley pvt key was missing. Thanks for your help ... View more

@bgooley Thanks for taking the time to look at the issue. As suggested I have ran the curl command and below is the output. I haven't seen this error on other nodes in the cluster just this one. i'll check the certs and keystore also.   * About to connect() to nodemanager.example.com port 8042 (#0) * Trying 10.28.153.47... * Connected to nodemanager.example.com (10.28.153.47) port 8042 (#0) * Initializing NSS with certpath: sql:/etc/pki/nssdb * NSS error -12286 (SSL_ERROR_NO_CYPHER_OVERLAP) * Cannot communicate securely with peer: no common encryption algorithm(s). * Closing connection 0 curl: (35) Cannot communicate securely with peer: no common encryption algorithm(s). ... View more

[20/Mar/2020 13:18:15 +0000] 89447 Monitor-GenericMonitor throttling_logger ERROR Error fetching metrics at 'https://NodeManager.example.com:8042/jmx' Traceback (most recent call last): File "/opt/cloudera/cm-agent/lib/python2.7/site-packages/cmf/monitor/generic/metric_collectors.py", line 203, in _collect_and_parse_and_return self._adapter.safety_valve)) File "/opt/cloudera/cm-agent/lib/python2.7/site-packages/cmf/util/url.py", line 241, in urlopen_with_retry_on_authentication_errors return function() File "/opt/cloudera/cm-agent/lib/python2.7/site-packages/cmf/monitor/generic/metric_collectors.py", line 220, in _open_url password=self._password_value) File "/opt/cloudera/cm-agent/lib/python2.7/site-packages/cmf/util/url.py", line 82, in urlopen_with_timeout return opener.open(url, data, timeout) File "/usr/lib64/python2.7/urllib2.py", line 431, in open response = self._open(req, data) File "/usr/lib64/python2.7/urllib2.py", line 449, in _open '_open', req) File "/usr/lib64/python2.7/urllib2.py", line 409, in _call_chain result = func(*args) File "/opt/cloudera/cm-agent/lib/python2.7/site-packages/cmf/util/url.py", line 229, in https_open return self.do_open(HTTPSConnection, req) File "/usr/lib64/python2.7/urllib2.py", line 1211, in do_open h.request(req.get_method(), req.get_selector(), req.data, headers) File "/usr/lib64/python2.7/httplib.py", line 1056, in request self._send_request(method, url, body, headers) File "/usr/lib64/python2.7/httplib.py", line 1090, in _send_request self.endheaders(body) File "/usr/lib64/python2.7/httplib.py", line 1052, in endheaders self._send_output(message_body) File "/usr/lib64/python2.7/httplib.py", line 890, in _send_output self.send(msg) File "/usr/lib64/python2.7/httplib.py", line 852, in send self.connect() File "/opt/cloudera/cm-agent/lib/python2.7/site-packages/cmf/util/url.py", line 224, in connect self.sock.connect((self.host, self.port)) File "/opt/cloudera/cm-agent/lib/python2.7/site-packages/M2Crypto/SSL/Connection.py", line 309, in connect ret = self.connect_ssl() File "/opt/cloudera/cm-agent/lib/python2.7/site-packages/M2Crypto/SSL/Connection.py", line 295, in connect_ssl return m2.ssl_connect(self.ssl, self._timeout) SSLError: sslv3 alert handshake failure [20/Mar/2020 13:18:15 +0000] 89447 MonitorDaemon-Scheduler daemon INFO Monitor expired: ('GenericMonitor YARN-NODEMANAGER for yarn-NODEMANAGER-f6d6bb549fe50d7a52ac23558edb4509',) [20/Mar/2020 13:18:19 +0000] 89447 MonitorDaemon-Reporter firehoses INFO Creating a connection to the SERVICEMONITOR. [20/Mar/2020 13:18:19 +0000] 89447 MonitorDaemon-Reporter firehoses INFO Creating a connection to the HOSTMONITOR. [20/Mar/2020 13:21:18 +0000] 89447 MonitorDaemon-Reporter throttling_logger INFO Descendants user CPU lower than expected for process 10751: 18630414.15, 18630292.07 [20/Mar/2020 13:27:01 +0000] 89447 MainThread heartbeat_tracker INFO HB stats (seconds): num:40 LIFE_MIN:0.02 min:0.02 mean:0.02 max:0.05 LIFE_MAX:0.11 ... View more