Created on 01-12-2020 11:24 AM - last edited on 01-12-2020 10:40 PM by VidyaSargur
since metrics take space on the local disk ,
we want to move to distributed mode , so metrics data will be on HDFS and not on local disk
we start to work according to the link - https://cwiki.apache.org/confluence/display/AMBARI/AMS+-+distributed+mode
we are using ambari cluster 2.6.4 with active/stand by name node
so we start the configuration
first we set in ambari the following
ams-site, Set timeline.metrics.service.operation.mode = distributed
now we need to Edit ams-hbase-site,
hdfs://<nameservice-id>/user/ams/hbase
the question is - how to find the nameservice-id ?
since we have active/stand by name node
then how to know the - nameservice-id value?
Created on 01-12-2020 12:56 PM - edited 01-12-2020 12:57 PM
When your cluster is in HA it uses a namespace that acts as a load balancer to facilitate the switch from active to standby and vice versa.
The dfs-site-xml holds these values filter using dfs.nameservices the nameservice-id should be your namespace or in HA look for dfs.ha.namenodes.[nameservice ID]
dfs.ha.namenodes.[nameservice ID] e.g dfs.ha.namenodes.mycluster
And that's the value to set eg
hdfs://mycluster_namespace/user/ams/hbase
The refresh the stale configs , now HBase should sending the metrics to that directory
HTH
Created on 01-12-2020 12:56 PM - edited 01-12-2020 12:57 PM
When your cluster is in HA it uses a namespace that acts as a load balancer to facilitate the switch from active to standby and vice versa.
The dfs-site-xml holds these values filter using dfs.nameservices the nameservice-id should be your namespace or in HA look for dfs.ha.namenodes.[nameservice ID]
dfs.ha.namenodes.[nameservice ID] e.g dfs.ha.namenodes.mycluster
And that's the value to set eg
hdfs://mycluster_namespace/user/ams/hbase
The refresh the stale configs , now HBase should sending the metrics to that directory
HTH