Created 02-02-2016 06:38 PM
We implemented ambari-metrics-collector in embedded mode. Now, it is taking more disk space under /hadoop/var/lib/ambari-metrics-collector/hbase/data/default. How can we delete prior data in the metrics collector? What are the precautions to be taken while deleting directories in the above location. Which directories need to be untouched? I saw Metric Aggregator took 2.8GB,Metric Record monitor took 1.4 GB.
Created 02-02-2016 06:46 PM
See this https://cwiki.apache.org/confluence/display/AMBARI/Configuration
Property | Default value | Description |
---|---|---|
timeline.metrics.host.aggregator.daily.ttl | 31536000 | Host based daily resolution data purge interval. Default is 1 year. |
timeline.metrics.cluster.aggregator.minute.ttl | 2592000 | Cluster wide minute resolution data purge interval. Default is 30 days. |
timeline.metrics.cluster.aggregator.hourly.ttl | 31536000 | Cluster wide hourly resolution data purge interval. Default is 1 year. |
timeline.metrics.cluster.aggregator.daily.ttl | 63072000 | Cluster wide daily resolution data purge interval. Default is 2 years. |
Created 02-02-2016 06:43 PM
Is there any parameter to set auto delete old metrics based on time frame?
Created 02-02-2016 06:45 PM
recommendation is to migrate to distributed mode and then you can clean up old directories. There's also time to live properties you can find them here this is Hortonworks documentation for TTL settings.
Created 02-02-2016 06:46 PM
See this https://cwiki.apache.org/confluence/display/AMBARI/Configuration
Property | Default value | Description |
---|---|---|
timeline.metrics.host.aggregator.daily.ttl | 31536000 | Host based daily resolution data purge interval. Default is 1 year. |
timeline.metrics.cluster.aggregator.minute.ttl | 2592000 | Cluster wide minute resolution data purge interval. Default is 30 days. |
timeline.metrics.cluster.aggregator.hourly.ttl | 31536000 | Cluster wide hourly resolution data purge interval. Default is 1 year. |
timeline.metrics.cluster.aggregator.daily.ttl | 63072000 | Cluster wide daily resolution data purge interval. Default is 2 years. |
Created 02-02-2016 07:03 PM
What is the recommended value instead of 1 year for host and 1 year for cluster?