Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Internal error while querying the Host Monitor

Internal error while querying the Host Monitor

New Contributor

Hi,

 

When I restart the machines of cloudera then I faced the host monitor, event server and service monitor are down.

 

But logs showing below warning and error :

 

Apr 29, 4:09:38.921 PM WARN com.cloudera.cmon.firehose.Main
No descriptor fetched from http://cloudera1.x.x.x:7180 on after 1 tries, sleeping...
Apr 29, 4:09:39.141 PM WARN com.cloudera.cmf.event.publish.EventStorePublisherWithRetry
Failed to publish event: SimpleEvent{attributes={ROLE_TYPE=[HOSTMONITOR], EXCEPTION_TYPES=[java.net.ConnectException], HOST_IDS=[4ea88dd0-70d6-4a97-8589-3f53d1ccac7d], STACKTRACE=[java.net.ConnectException: Connection refused
at java.net.PlainSocketImpl.socketConnect(Native Method)
at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350)
at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206)
at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188)
at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392)
at java.net.Socket.connect(Socket.java:589)
at sun.net.NetworkClient.doConnect(NetworkClient.java:175)
at sun.net.www.http.HttpClient.openServer(HttpClient.java:432)
at sun.net.www.http.HttpClient.openServer(HttpClient.java:527)
at sun.net.www.http.HttpClient.<init>(HttpClient.java:211)
at sun.net.www.http.HttpClient.New(HttpClient.java:308)
at sun.net.www.http.HttpClient.New(HttpClient.java:326)
at sun.net.www.protocol.http.HttpURLConnection.getNewHttpClient(HttpURLConnection.java:1169)
at sun.net.www.protocol.http.HttpURLConnection.plainConnect0(HttpURLConnection.java:1105)
at sun.net.www.protocol.http.HttpURLConnection.plainConnect(HttpURLConnection.java:999)
at sun.net.www.protocol.http.HttpURLConnection.connect(HttpURLConnection.java:933)
at sun.net.www.protocol.http.HttpURLConnection.getOutputStream0(HttpURLConnection.java:1283)
at sun.net.www.protocol.http.HttpURLConnection.getOutputStream(HttpURLConnection.java:1258)
at com.cloudera.cmf.BasicScmProxy.authenticate(BasicScmProxy.java:265)
at com.cloudera.cmf.BasicScmProxy.fetch(BasicScmProxy.java:557)
at com.cloudera.cmf.BasicScmProxy.getFragmentAndHash(BasicScmProxy.java:647)
at com.cloudera.cmf.DescriptorAndFragments.newDescriptorAndFragments(DescriptorAndFragments.java:64)
at com.cloudera.cmon.firehose.Main.main(Main.java:376)
], ROLE=[mgmt-HOSTMONITOR-90f47471c0740a9e61a69726db90a1fd], HOSTS=[cloudera1.x.x.x], CATEGORY=[LOG_MESSAGE], EVENTCODE=[EV_LOG_EVENT], SERVICE=[mgmt], SERVICE_TYPE=[MGMT], LOG_LEVEL=[WARN], SEVERITY=[IMPORTANT]}, content=Exception while getting fetch configDefaults hash: none, timestamp=1461935378895}
Apr 29, 4:09:40.984 PM WARN com.cloudera.cmon.firehose.Main
No descriptor fetched from http://cloudera1.x.x.x:7180 on after 2 tries, sleeping...
Apr 29, 4:09:42.987 PM WARN com.cloudera.cmon.firehose.Main
No descriptor fetched from http://cloudera1.x.x.x:7180 on after 3 tries, sleeping...
Apr 29, 4:09:44.992 PM WARN com.cloudera.cmon.firehose.Main
No descriptor fetched from http://cloudera1.x.x.x:7180 on after 4 tries, sleeping...
Apr 29, 4:09:46.994 PM WARN com.cloudera.cmon.firehose.Main
No descriptor fetched from http://cloudera1.x.x.x:7180 on after 5 tries, sleeping...
Apr 29, 4:09:49.001 PM ERROR com.cloudera.cmon.firehose.Main
Could not fetch descriptor after 5 tries, exiting. 

 

 

If we restart the cloudera management services then its started properly but any solution for this whenever machine power off and on then its should start the services.

 

Please assist.

3 REPLIES 3

Re: Internal error while querying the Host Monitor

Expert Contributor
did you try on non cloud machine Pritam

Re: Internal error while querying the Host Monitor

New Contributor

Thanks Ripu.

 

But, These issue is facing on the non cloude machine.

 

Highlighted

Re: Internal error while querying the Host Monitor

Expert Contributor
ok Thanks , let me also check