Created 09-30-2015 08:27 PM
From ambari-server 2 log:
28 Sep 2015 19:04:23,498 ERROR [qtp-client-6858] MetricsPropertyProvider:183 - Error getting timeline metrics. Can not connect to collector, socket error. 28 Sep 2015 19:04:28,989 INFO [AlertNoticeDispatchService] AlertNoticeDispatchService:279 - There are 1 pending alert notices about to be dispatched... 28 Sep 2015 19:04:28,993 INFO [alert-dispatch-96] EmailDispatcher:88 - Sending email: org.apache.ambari.server.state.alert.AlertNotification@35b0f886 28 Sep 2015 19:04:29,245 WARN [ambari-hearbeat-monitor] HeartbeatMonitor:154 - Heartbeat lost from host blpd813-priv.bhdc.att.com 28 Sep 2015 19:04:33,519 ERROR [qtp-client-6858] MetricsReportPropertyProvider:223 - Error getting timeline metrics. Can not connect to collector, socket error.
From the ambari-alerts log:
2015-09-28 18:34:01,981 [CRITICAL] [YARN] [yarn_nodemanager_webui] (NodeManager Web UI) Connection failed to http://blpd852-priv.bhdc.att.com:8042 (<urlopen error timed out>) 2015-09-28 18:34:03,088 [CRITICAL] [YARN] [yarn_nodemanager_webui] (NodeManager Web UI) Connection failed to http://blpd820-priv.bhdc.att.com:8042 (<urlopen error timed out>) 2015-09-28 18:34:52,711 [OK] [YARN] [yarn_nodemanager_webui] (NodeManager Web UI) HTTP 200 response in 0.000s 2015-09-28 18:34:53,709 [OK] [YARN] [yarn_nodemanager_webui] (NodeManager Web UI) HTTP 200 response in 0.000s 2015-09-28 19:04:05,354 [CRITICAL] [YARN] [yarn_nodemanager_webui] (NodeManager Web UI) Connection failed to http://blpd810-priv.bhdc.att.com:8042 (<urlopen error timed out>) 2015-09-28 19:04:56,024 [OK] [YARN] [yarn_nodemanager_webui] (NodeManager Web UI) HTTP 200 response in 0.000s
Created 10-01-2015 05:57 PM
https://hortonworks.jira.com/browse/EAR-2354 was created for this issue
Created 09-30-2015 08:46 PM
Is Ambari Metrics service up?
Created 09-30-2015 08:57 PM
Is AMS configured in embedded or distributed mode?
Created 09-30-2015 09:02 PM
I don't know if it is setup in distributed or embedded mode, but I will check on that and if metrics services are up and update you.
Created 10-01-2015 02:43 PM
they are running in embedded mode and ams is up and running
Created 10-01-2015 05:38 PM
Can you create an EAR for this an attach the Ambari Metrics Collector logs?
Created 10-01-2015 05:46 PM
Instructions on list of items to upload:
https://cwiki.apache.org/confluence/display/AMBARI/Troubleshooting+Guide
Created 10-01-2015 05:57 PM
https://hortonworks.jira.com/browse/EAR-2354 was created for this issue