ambari-metrics-collector not showing any data on dashboard

[#1]

ambari-metrics collector running but in log its showing that no live collector to collect data.

hbase-ams-master.log:

No live collector to send metrics to. Metrics to be sent will be discarded. This message will be skipped for the next 20 times.

ambari-metrics-collector.log:

2019-06-10 13:29:52,653 INFO org.apache.hadoop.hbase.client.RpcRetryingCaller: Call exception, tries=15, retries=35, started=629189 ms ago, cancelled=false, msg=java.io.IOException: Table Namespace Manager not fully initialized, try again later

at org.apache.hadoop.hbase.master.HMaster.checkNamespaceManagerReady(HMaster.java:2753)

at org.apache.hadoop.hbase.master.HMaster.ensureNamespaceExists(HMaster.java:2976)

at org.apache.hadoop.hbase.master.HMaster.createTable(HMaster.java:1746)

at org.apache.hadoop.hbase.master.MasterRpcServices.createTable(MasterRpcServices.java:491)

at org.apache.hadoop.hbase.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java:59956)

at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2150)

at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:112)

at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:187)

at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:167)

ambari alert: metrics-collector process alert

connection refused to ambari-metrics collector:6188

[#2]

@John

The log snippet which you have shared is just the side effect (after effect) of some issue which is already logged previous to the message that you posted here.

 Table Namespace Manager not fully initialized, try again later

.

So if we really want to know why the AMS is not running then we will have to take a look at the complete ambari metrics collector logs. Along with the Memory settings. GC logs .

If you are still facing the issue then please share the complete logs after restarting the AMS service.

/var/log/ambari-metrics-collector/hbase-ams-master-*.log
/var/log/ambari-metrics-collector/ambari-metrics-collector.log*
/var/log/ambari-metrics-collector/collector-gc.log*
/var/log/ambari-metrics-collector/gc.log*

.