Reply
New Contributor
Posts: 1
Registered: ‎12-20-2017

Web Server Status check failed for Impala services

[ Edited ]

Service agent requests url /jsonmetrics while checking Impala.

11000 Monitor-GenericMonitor throttling_logger ERROR    (60 skipped) Error fetching metrics at 'http://url:25010/jsonmetrics'
Traceback (most recent call last):
File "/usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/cmf-5.13.0-py2.7.egg/cmf/monitor/generic/metric_collectors.py", line 203, in _collect_and_parse_and_return
simplejson.load(opened_url))
File "/usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/simplejson-2.1.2-py2.7-linux-x86_64.egg/simplejson/__init__.py", line 328, in load
use_decimal=use_decimal, **kw)
File "/usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/simplejson-2.1.2-py2.7-linux-x86_64.egg/simplejson/__init__.py", line 384, in loads
return _default_decoder.decode(s)
File "/usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/simplejson-2.1.2-py2.7-linux-x86_64.egg/simplejson/decoder.py", line 402, in decode
obj, end = self.raw_decode(s, idx=_w(s, 0).end())
File "/usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/simplejson-2.1.2-py2.7-linux-x86_64.egg/simplejson/decoder.py", line 420, in raw_decode
raise JSONDecodeError("No JSON object could be decoded", s, idx)
JSONDecodeError: No JSON object could be decoded: line 1 column 0 (char 0)

While the proper url for metrics is /jsonmetrics?json.

 

https://community.cloudera.com/t5/Cloudera-Manager-Installation/CDH-5-4-Impala-webinterface-monitori...

In that thread it says it's because of an old CM < 5.4. But my versions is newer and it still doesnt work

 

Cloudera Manager Agent 5.13.0

Impala2.10.0+cdh5.13.0+01.cdh5.13.0.p0.34CDH 5

 

What can I do to fix the check?

Cloudera Employee
Posts: 820
Registered: ‎03-23-2015

Re: Web Server Status check failed for Impala services

I checked my version of CM/CDH 5.13.0, I don't see such issue. There were timeout occasionally as well, but the URL is correct:

 

[28/Nov/2017 16:46:34 +0000] 10847 Monitor-GenericMonitor throttling_logger ERROR    Error fetching metrics at 'http://{statestore-url}:25010/jsonmetrics?json'
Traceback (most recent call last):
File "/usr/lib64/cmf/agent/build/env/lib/python2.7/site-packages/cmf-5.13.0-py2.7.egg/cmf/monitor/generic/metric_collectors.py", line 200, in _collect_and_parse_and_return
self._adapter.safety_valve)) .... File "/usr/lib64/python2.7/socket.py", line 476, in readline data = self._sock.recv(self._rbufsize) error: [Errno 104] Connection reset by peer

And I can see it does have "/jsonmetrics?json" in the URL. Can you check the cloudera-scm-agent server logs on impala daemon hosts to see if you noticed the same issue or not, that the URL is missing "?json" in the end? Can you please share some sample logs here?