Support Questions
Find answers, ask questions, and share your expertise

Ambari Metrics changed from Embedded mode to distributed mode, but still see ams Hbase master and region server processes are running on the metrics collector server locally. Please advice

Contributor
 
8 REPLIES 8

Re: Ambari Metrics changed from Embedded mode to distributed mode, but still see ams Hbase master and region server processes are running on the metrics collector server locally. Please advice

Contributor

Comments only

Re: Ambari Metrics changed from Embedded mode to distributed mode, but still see ams Hbase master and region server processes are running on the metrics collector server locally. Please advice

Expert Contributor

Hi Srikiran,

Changing AMS to distributed mode only means that AMS HBase will run separate daemons for Master and RegionServer. Both these processes will still be co-located with AMS collector.

Whereas, in embedded mode, AMS uses HBase in "standalone" mode - 1 daemon for HBase Master, RS and its own local Zk

Re: Ambari Metrics changed from Embedded mode to distributed mode, but still see ams Hbase master and region server processes are running on the metrics collector server locally. Please advice

Contributor
@Aravindan Vijayan

Well distributed mode means it should use cluster resources and not local resources rt? So Customer is asking whats the use of distributed mode and still have processes running locally?

Re: Ambari Metrics changed from Embedded mode to distributed mode, but still see ams Hbase master and region server processes are running on the metrics collector server locally. Please advice

Expert Contributor

@Srikiran

AMS in distributed mode does use the cluster resources. In distributed mode, AMS HBase is configured to write to HDFS on the cluster. In fact, it can be configured to write to any external file system as well. The AMS HBase processes though, run locally on the collector host.

Re: Ambari Metrics changed from Embedded mode to distributed mode, but still see ams Hbase master and region server processes are running on the metrics collector server locally. Please advice

@Srikaran Jangidi

At this moment, 'embedded'/'distributed' decides only about where the AMS collected data is stored. Distributed only means the data collected by AMS is stored in HDFS and nothing else. It uses only the local resource except for HDFS. In embedded mode, the AMS data is stored in a physical file in the location defined in /etc/ams-hbase/conf/hbase-site.xml and resides local to the node where the collector is running.

Currently, there is only one Region Server in the Standalone Hbase used by AMS. Slowly AMS has started using cluster resources - for example, in the recent releases, the Cluster zookeeper could be used. At some point, we might have multiple region servers spread across the nodes in cluster as well.

Re: Ambari Metrics changed from Embedded mode to distributed mode, but still see ams Hbase master and region server processes are running on the metrics collector server locally. Please advice

Hi @vpoornalingam

Do you know if above is still applicable for Ambari 2.5.x? Any Jira for this multiple RS enhancement request?

Re: Ambari Metrics changed from Embedded mode to distributed mode, but still see ams Hbase master and region server processes are running on the metrics collector server locally. Please advice

Expert Contributor

@Hajime

From Ambari 2.5.0, we have multiple collector support for AMS. Each collector will have an HBase RS running.

https://issues.apache.org/jira/browse/AMBARI-15901

Re: Ambari Metrics changed from Embedded mode to distributed mode, but still see ams Hbase master and region server processes are running on the metrics collector server locally. Please advice

Awesome!!!!