Support Questions
Find answers, ask questions, and share your expertise

Help after moving Ambari metrics server

Solved Go to solution

Help after moving Ambari metrics server

Super Collaborator

I moved our ambari metrics server from a data node to an edge node.

I followed all of the directions outlined here:

http://docs.hortonworks.com/HDPDocuments/Ambari-2.2.0.0/bk_ambari_reference_guide/content/ch_moving_...

Now, ambari metrics kind of 'works', but not completely.

The main Ambari dashboard looks good - all of the metrics are populated.

But if I drill into HDFS, YARN, HBase, etc - only some of the metrics are there.

Many say "No data available".

I tried re-starting ambari server, but no luck.

I tried ctrl+shift+r to force a clean refresh of the GUI, and that didn't help either.

I know that all the nodes are pointing to the right place in /etc/ambari-metrics-monitor/conf/metric_monitor.ini

Where can I look to figure this out?

1 ACCEPTED SOLUTION

Accepted Solutions

Re: Help after moving Ambari metrics server

Contributor
@Zack Riesland

After moving AMS, you need to restart the HDFS, YARN, HBase services so that they can start sending data to new AMS host.

View solution in original post

10 REPLIES 10

Re: Help after moving Ambari metrics server

Mentor

@Zack Riesland let's do a few things. Do you have firewall rules per port? Is there a rule you need to add to your firewall for each monitor? What is the version of Ambari you're running? There were issues in Ambari metrics 2.1.x https://cwiki.apache.org/confluence/display/AMBARI/Known+Issues

Re: Help after moving Ambari metrics server

Super Collaborator

We are on ambari 2.1.1

We run HA, w/o Kerberos or any security.

I restarted ambari server and then restarted all the monitors and it didn't help.

I don't know about firewalls on our server. Where would I look for this?

Thanks!

Re: Help after moving Ambari metrics server

Mentor

I'll find out the exact firewall conf file in a bit but also look at our docs for DNS and proxy settings requirements, I've seen similar symptoms from other HCC entries. I'm not by computer so can't be of more use right now. Look at HCC for similar threads.

Re: Help after moving Ambari metrics server

Mentor

Re: Help after moving Ambari metrics server

Mentor

Re: Help after moving Ambari metrics server

Contributor
@Zack Riesland

After moving AMS, you need to restart the HDFS, YARN, HBase services so that they can start sending data to new AMS host.

View solution in original post

Re: Help after moving Ambari metrics server

Super Collaborator

Thanks @rgangappa, that seems to be what I needed. @Artem Ervits, that original instructions document probably needs this.

Thanks!

Re: Help after moving Ambari metrics server

Mentor

@Zack Riesland you're right, seems like an obvious thing to restart the services, usually it will have an orange circle next to all services needing a restart. Good catch @rgangappa

Re: Help after moving Ambari metrics server

Super Collaborator

No orange circle. No indication to restart services. FYI.