Hello @All,
we are running CDH 5.4.4 and Cloudera Manager 5.4.3 on Centos 6.4 Systems
Everything runs fine except the impala Monitoring.
The service itself is also running fine. It seems that only the monitoring of the impala daemons on all hosts and the catalogserver is not working:
The error-Messages are as follows:
"The Cloudera Manager Agent got an unexpected response from this role's web server. "
/var/log/cloudera-scm-agent/cloudera-scm-agent.log:
[21/Jul/2015 09:33:34 +0000] 2502 MonitorDaemon-Scheduler __init__ INFO Monitor expired: ('ImpaladMonitor for impala-IMPALAD-4462e41b224353ea47cbbf50630dc528',)
[21/Jul/2015 09:51:19 +0000] 2502 ImpalaDaemonQueryMonitoring throttling_logger ERROR (3429 skipped) Error fetching metrics at 'http://cloudera01-vm.spiegel.de:25000/jsonmetrics?json'
Traceback (most recent call last):
File "/usr/lib64/cmf/agent/src/cmf/monitor/abstract_monitor.py", line 394, in collect_metrics_from_url
result = self.parse_metrics(simplejson.load(openedUrl))
File "/usr/lib64/cmf/agent/build/env/lib/python2.6/site-packages/simplejson-2.1.2-py2.6-linux-x86_64.egg/simplejson/__init__.py", line 328, in load
use_decimal=use_decimal, **kw)
File "/usr/lib64/cmf/agent/build/env/lib/python2.6/site-packages/simplejson-2.1.2-py2.6-linux-x86_64.egg/simplejson/__init__.py", line 384, in loads
return _default_decoder.decode(s)
File "/usr/lib64/cmf/agent/build/env/lib/python2.6/site-packages/simplejson-2.1.2-py2.6-linux-x86_64.egg/simplejson/decoder.py", line 402, in decode
obj, end = self.raw_decode(s, idx=_w(s, 0).end())
File "/usr/lib64/cmf/agent/build/env/lib/python2.6/site-packages/simplejson-2.1.2-py2.6-linux-x86_64.egg/simplejson/decoder.py", line 418, in raw_decode
obj, end = self.scan_once(s, idx)
JSONDecodeError: Expecting property name: line 75 column 19 (char 2309)
[21/Jul/2015 09:59:12 +0000] 2502 CP Server Thread-10 _cplogging INFO 172.25.12.99 - - [21/Jul/2015:09:59:12] "GET /heartbeat HTTP/1.1" 200 2 "" "NING/1.0"
[21/Jul/2015 09:59:13 +0000] 2502 MainThread agent INFO Process with same id has changed: 1285-impala-IMPALAD.
[21/Jul/2015 09:59:13 +0000] 2502 MainThread agent INFO Deactivating process 1285-impala-IMPALAD
[21/Jul/2015 09:59:13 +0000] 2502 MainThread __init__ INFO Stopping query monitoring thread.
[21/Jul/2015 09:59:13 +0000] 2502 MainThread agent INFO Triggering supervisord update.
[21/Jul/2015 09:59:15 +0000] 2502 CP Server Thread-11 _cplogging INFO 172.25.12.99 - - [21/Jul/2015:09:59:15] "GET /heartbeat HTTP/1.1" 200 2 "" "NING/1.0"
[21/Jul/2015 09:59:15 +0000] 2502 MainThread agent INFO Deleting process 1285-impala-IMPALAD
Does anybody know how to get rid of this error?
Best Regards
Markus
