question Re: ambari metrics not working in Support Questions

ambari metrics not working

Manoj690 — Tue, 19 Nov 2019 08:08:09 GMT

stderr: /var/lib/ambari-agent/data/errors-2079.txt

/Traceback (most recent call last):
  File "/usr/lib/ambari-agent/lib/resource_management/libraries/script/script.py", line 995, in restart
    self.status(env)
  File "/var/lib/ambari-agent/cache/stacks/HDP/3.0/services/AMBARI_METRICS/package/scripts/metrics_collector.py", line 63, in status
    check_service_status(env, name='collector')
  File "/usr/lib/ambari-agent/lib/ambari_commons/os_family_impl.py", line 89, in thunk
    return fn(*args, **kwargs)
  File "/var/lib/ambari-agent/cache/stacks/HDP/3.0/services/AMBARI_METRICS/package/scripts/status.py", line 41, in check_service_status
    check_process_status(pid_file)
  File "/usr/lib/ambari-agent/lib/resource_management/libraries/functions/check_process_status.py", line 43, in check_process_status
    raise ComponentIsNotRunning()
ComponentIsNotRunning

The above exception was the cause of the following exception:

Traceback (most recent call last):
  File "/var/lib/ambari-agent/cache/stacks/HDP/3.0/services/AMBARI_METRICS/package/scripts/metrics_collector.py", line 90, in <module>
    AmsCollector().execute()
  File "/usr/lib/ambari-agent/lib/resource_management/libraries/script/script.py", line 352, in execute
    method(env)
  File "/usr/lib/ambari-agent/lib/resource_management/libraries/script/script.py", line 1012, in restart
    self.post_start(env)
  File "/usr/lib/ambari-agent/lib/resource_management/libraries/script/script.py", line 424, in post_start
    raise Fail("Pid file {0} doesn't exist after starting of the component.".format(pid_file))
resource_management.core.exceptions.Fail: Pid file /var/run/ambari-metrics-collector//hbase-ams-master.pid doesn't exist after starting of the component./

Re: ambari metrics not working

sagarshimpi — Tue, 19 Nov 2019 07:11:23 GMT

Hi @Manoj690

Did the earlier community link helped to resolve issue - https://community.cloudera.com/t5/Support-Questions/Ambari-metircs-not-started/m-p/283228#M210525 ??

Please confirm!!

Re: ambari metrics not working

Manoj690 — Tue, 19 Nov 2019 07:39:06 GMT

No its not resolved and also one more question how to completely uninstall
Phoenix in my system and reinstall?

Re: ambari metrics not working

sagarshimpi — Tue, 19 Nov 2019 08:04:06 GMT

@Manoj690

1. What is the error you are getting after following the link - https://community.cloudera.com/t5/Support-Questions/Ambari-metircs-not-started/m-p/283228#M210525%C2%A0%C2%A0

The error you pasted are you getting it while starting AMS via Ambari?

Did you tried to start from CLI/backend using command "ambari-metrics-collector start"? Make sure you stop the service properly, kill if any pid exist and then start.

2. For phoenix - I see phoenix comes as part of hbase and is enabled or disabled from hbase configs as shown below.

Its basically comes as part of hdp bits located in -
/usr/hdp/current/phoenix-client

/usr/hdp/current/phoenix-server

Why do you want to completely uninstall phoenix ? Can you pass details so that we can help to understand and provide you if any workaround.

Re: ambari metrics not working

Manoj690 — Tue, 19 Nov 2019 09:35:06 GMT

ambari metrics still shows same error

stderr:
Traceback (most recent call last):
File "/var/lib/ambari-agent/cache/stacks/HDP/3.0/services/AMBARI_METRICS/package/scripts/metrics_collector.py",
line 90, in
AmsCollector().execute()
File "/usr/lib/ambari-agent/lib/resource_management/libraries/script/script.py",
line 355, in execute
self.execute_prefix_function(self.command_name, 'post', env)
File "/usr/lib/ambari-agent/lib/resource_management/libraries/script/script.py",
line 382, in execute_prefix_function
method(env)
File "/usr/lib/ambari-agent/lib/resource_management/libraries/script/script.py",
line 424, in post_start
raise Fail("Pid file {0} doesn't exist after starting of the
component.".format(pid_file))
resource_management.core.exceptions.Fail: Pid file
/var/run/ambari-metrics-collector//hbase-ams-master.pid doesn't exist
after starting of the component.
stdout:
2019-11-19 14:56:48,719 - Stack Feature Version Info: Cluster
Stack=3.1, Command Stack=None, Command Version=3.1.0.0-78 ->
3.1.0.0-78
2019-11-19 14:56:48,735 - Using hadoop conf dir: /usr/hdp/3.1.0.0-78/hadoop/conf
2019-11-19 14:56:48,920 - Stack Feature Version Info: Cluster
Stack=3.1, Command Stack=None, Command Version=3.1.0.0-78 ->
3.1.0.0-78
2019-11-19 14:56:48,926 - Using hadoop conf dir: /usr/hdp/3.1.0.0-78/hadoop/conf
2019-11-19 14:56:48,927 - Group['hdfs'] {}
2019-11-19 14:56:48,927 - Group['hadoop'] {}
2019-11-19 14:56:48,928 - Group['users'] {}
2019-11-19 14:56:48,928 - User['yarn-ats'] {'gid': 'hadoop',
'fetch_nonlocal_groups': True, 'groups': ['hadoop'], 'uid': None}
2019-11-19 14:56:48,929 - User['hive'] {'gid': 'hadoop',
'fetch_nonlocal_groups': True, 'groups': ['hadoop'], 'uid': None}
2019-11-19 14:56:48,930 - User['storm'] {'gid': 'hadoop',
'fetch_nonlocal_groups': True, 'groups': ['hadoop'], 'uid': None}
2019-11-19 14:56:48,931 - User['zookeeper'] {'gid': 'hadoop',
'fetch_nonlocal_groups': True, 'groups': ['hadoop'], 'uid': None}
2019-11-19 14:56:48,931 - User['oozie'] {'gid': 'hadoop',
'fetch_nonlocal_groups': True, 'groups': ['hadoop', 'users'], 'uid':
None}
2019-11-19 14:56:48,932 - User['atlas'] {'gid': 'hadoop',
'fetch_nonlocal_groups': True, 'groups': ['hadoop'], 'uid': None}
2019-11-19 14:56:48,933 - User['ams'] {'gid': 'hadoop',
'fetch_nonlocal_groups': True, 'groups': ['hadoop'], 'uid': None}
2019-11-19 14:56:48,933 - User['tez'] {'gid': 'hadoop',
'fetch_nonlocal_groups': True, 'groups': ['hadoop', 'users'], 'uid':
None}
2019-11-19 14:56:48,934 - User['ambari-qa'] {'gid': 'hadoop',
'fetch_nonlocal_groups': True, 'groups': ['hadoop', 'users'], 'uid':
None}
2019-11-19 14:56:48,935 - User['kafka'] {'gid': 'hadoop',
'fetch_nonlocal_groups': True, 'groups': ['hadoop'], 'uid': None}
2019-11-19 14:56:48,936 - User['hdfs'] {'gid': 'hadoop',
'fetch_nonlocal_groups': True, 'groups': ['hdfs', 'hadoop'], 'uid':
None}
2019-11-19 14:56:48,936 - User['yarn'] {'gid': 'hadoop',
'fetch_nonlocal_groups': True, 'groups': ['hadoop'], 'uid': None}
2019-11-19 14:56:48,937 - User['mapred'] {'gid': 'hadoop',
'fetch_nonlocal_groups': True, 'groups': ['hadoop'], 'uid': None}
2019-11-19 14:56:48,938 - User['hbase'] {'gid': 'hadoop',
'fetch_nonlocal_groups': True, 'groups': ['hadoop'], 'uid': None}
2019-11-19 14:56:48,938 -
File['/var/lib/ambari-agent/tmp/changeUid.sh'] {'content':
StaticFile('changeToSecureUid.sh'), 'mode': 0555}
2019-11-19 14:56:48,939 -
Execute['/var/lib/ambari-agent/tmp/changeUid.sh ambari-qa
/tmp/hadoop-ambari-qa,/tmp/hsperfdata_ambari-qa,/home/ambari-qa,/tmp/ambari-qa,/tmp/sqoop-ambari-qa
0'] {'not_if': '(test $(id -u ambari-qa) -gt 1000) || (false)'}
2019-11-19 14:56:48,945 - Skipping
Execute['/var/lib/ambari-agent/tmp/changeUid.sh ambari-qa
/tmp/hadoop-ambari-qa,/tmp/hsperfdata_ambari-qa,/home/ambari-qa,/tmp/ambari-qa,/tmp/sqoop-ambari-qa
0'] due to not_if
2019-11-19 14:56:48,945 - Directory['/tmp/hbase-hbase'] {'owner':
'hbase', 'create_parents': True, 'mode': 0775, 'cd_access': 'a'}
2019-11-19 14:56:48,947 -
File['/var/lib/ambari-agent/tmp/changeUid.sh'] {'content':
StaticFile('changeToSecureUid.sh'), 'mode': 0555}
2019-11-19 14:56:48,947 -
File['/var/lib/ambari-agent/tmp/changeUid.sh'] {'content':
StaticFile('changeToSecureUid.sh'), 'mode': 0555}
2019-11-19 14:56:48,948 - call['/var/lib/ambari-agent/tmp/changeUid.sh
hbase'] {}
2019-11-19 14:56:48,956 - call returned (0, '1015')
2019-11-19 14:56:48,957 -
Execute['/var/lib/ambari-agent/tmp/changeUid.sh hbase
/home/hbase,/tmp/hbase,/usr/bin/hbase,/var/log/hbase,/tmp/hbase-hbase
1015'] {'not_if': '(test $(id -u hbase) -gt 1000) || (false)'}
2019-11-19 14:56:48,963 - Skipping
Execute['/var/lib/ambari-agent/tmp/changeUid.sh hbase
/home/hbase,/tmp/hbase,/usr/bin/hbase,/var/log/hbase,/tmp/hbase-hbase
1015'] due to not_if
2019-11-19 14:56:48,963 - Group['hdfs'] {}
2019-11-19 14:56:48,964 - User['hdfs'] {'fetch_nonlocal_groups': True,
'groups': ['hdfs', 'hadoop', u'hdfs']}
2019-11-19 14:56:48,964 - FS Type: HDFS
2019-11-19 14:56:48,965 - Directory['/etc/hadoop'] {'mode': 0755}
2019-11-19 14:56:48,982 -
File['/usr/hdp/3.1.0.0-78/hadoop/conf/hadoop-env.sh'] {'content':
InlineTemplate(...), 'owner': 'hdfs', 'group': 'hadoop'}
2019-11-19 14:56:48,983 - Writing
File['/usr/hdp/3.1.0.0-78/hadoop/conf/hadoop-env.sh'] because contents
don't match
2019-11-19 14:56:48,983 -
Directory['/var/lib/ambari-agent/tmp/hadoop_java_io_tmpdir'] {'owner':
'hdfs', 'group': 'hadoop', 'mode': 01777}
2019-11-19 14:56:49,003 - Execute[('setenforce', '0')] {'not_if': '(!
which getenforce ) || (which getenforce && getenforce | grep -q
Disabled)', 'sudo': True, 'only_if': 'test -f /selinux/enforce'}
2019-11-19 14:56:49,008 - Skipping Execute[('setenforce', '0')] due to not_if
2019-11-19 14:56:49,008 - Directory['/var/log/hadoop'] {'owner':
'root', 'create_parents': True, 'group': 'hadoop', 'mode': 0775,
'cd_access': 'a'}
2019-11-19 14:56:49,010 - Directory['/var/run/hadoop'] {'owner':
'root', 'create_parents': True, 'group': 'root', 'cd_access': 'a'}
2019-11-19 14:56:49,010 - Directory['/var/run/hadoop/hdfs'] {'owner':
'hdfs', 'cd_access': 'a'}
2019-11-19 14:56:49,011 - Directory['/tmp/hadoop-hdfs'] {'owner':
'hdfs', 'create_parents': True, 'cd_access': 'a'}
2019-11-19 14:56:49,014 -
File['/usr/hdp/3.1.0.0-78/hadoop/conf/commons-logging.properties']
{'content': Template('commons-logging.properties.j2'), 'owner':
'hdfs'}
2019-11-19 14:56:49,016 -
File['/usr/hdp/3.1.0.0-78/hadoop/conf/health_check'] {'content':
Template('health_check.j2'), 'owner': 'hdfs'}
2019-11-19 14:56:49,023 -
File['/usr/hdp/3.1.0.0-78/hadoop/conf/log4j.properties'] {'content':
InlineTemplate(...), 'owner': 'hdfs', 'group': 'hadoop', 'mode': 0644}
2019-11-19 14:56:49,031 -
File['/usr/hdp/3.1.0.0-78/hadoop/conf/hadoop-metrics2.properties']
{'content': InlineTemplate(...), 'owner': 'hdfs', 'group': 'hadoop'}
2019-11-19 14:56:49,032 -
File['/usr/hdp/3.1.0.0-78/hadoop/conf/task-log4j.properties']
{'content': StaticFile('task-log4j.properties'), 'mode': 0755}
2019-11-19 14:56:49,032 -
File['/usr/hdp/3.1.0.0-78/hadoop/conf/configuration.xsl'] {'owner':
'hdfs', 'group': 'hadoop'}
2019-11-19 14:56:49,036 -
File['/etc/hadoop/conf/topology_mappings.data'] {'owner': 'hdfs',
'content': Template('topology_mappings.data.j2'), 'only_if': 'test -d
/etc/hadoop/conf', 'group': 'hadoop', 'mode': 0644}
2019-11-19 14:56:49,040 - File['/etc/hadoop/conf/topology_script.py']
{'content': StaticFile('topology_script.py'), 'only_if': 'test -d
/etc/hadoop/conf', 'mode': 0755}
2019-11-19 14:56:49,043 - Skipping unlimited key JCE policy check and
setup since it is not required
2019-11-19 14:56:49,050 - Skipping stack-select on AMBARI_METRICS
because it does not exist in the stack-select package structure.
2019-11-19 14:56:49,291 - Using hadoop conf dir: /usr/hdp/3.1.0.0-78/hadoop/conf
2019-11-19 14:56:49,293 - checked_call['hostid'] {}
2019-11-19 14:56:49,296 - checked_call returned (0, 'a8c02018')
2019-11-19 14:56:49,298 - Directory['/etc/ams-hbase/conf'] {'owner':
'ams', 'group': 'hadoop', 'create_parents': True,
'recursive_ownership': True}
2019-11-19 14:56:49,299 -
Directory['/var/lib/ambari-metrics-collector/hbase-tmp'] {'owner':
'ams', 'create_parents': True, 'recursive_ownership': True,
'cd_access': 'a'}
2019-11-19 14:56:49,315 -
Directory['/var/lib/ambari-metrics-collector/hbase-tmp/local/jars']
{'owner': 'ams', 'group': 'hadoop', 'create_parents': True, 'mode':
0775, 'cd_access': 'a'}
2019-11-19 14:56:49,316 - File['/etc/ams-hbase/conf/core-site.xml']
{'owner': 'ams', 'action': ['delete']}
2019-11-19 14:56:49,316 - File['/etc/ams-hbase/conf/hdfs-site.xml']
{'owner': 'ams', 'action': ['delete']}
2019-11-19 14:56:49,316 - XmlConfig['hbase-site.xml'] {'owner': 'ams',
'group': 'hadoop', 'conf_dir': '/etc/ams-hbase/conf',
'configuration_attributes': {u'final': {u'hbase.zookeeper.quorum':
u'true'}}, 'configurations': ...}
2019-11-19 14:56:49,325 - Generating config: /etc/ams-hbase/conf/hbase-site.xml
2019-11-19 14:56:49,325 - File['/etc/ams-hbase/conf/hbase-site.xml']
{'owner': 'ams', 'content': InlineTemplate(...), 'group': 'hadoop',
'mode': None, 'encoding': 'UTF-8'}
2019-11-19 14:56:49,355 - XmlConfig['hbase-policy.xml'] {'owner':
'ams', 'group': 'hadoop', 'conf_dir': '/etc/ams-hbase/conf',
'configuration_attributes': {}, 'configurations':
{u'security.admin.protocol.acl': u'*',
u'security.masterregion.protocol.acl': u'*',
u'security.client.protocol.acl': u'*'}}
2019-11-19 14:56:49,362 - Generating config:
/etc/ams-hbase/conf/hbase-policy.xml
2019-11-19 14:56:49,362 - File['/etc/ams-hbase/conf/hbase-policy.xml']
{'owner': 'ams', 'content': InlineTemplate(...), 'group': 'hadoop',
'mode': None, 'encoding': 'UTF-8'}
2019-11-19 14:56:49,371 - File['/etc/ams-hbase/conf/hbase-env.sh']
{'content': InlineTemplate(...), 'owner': 'ams'}
2019-11-19 14:56:49,376 -
File['/etc/ams-hbase/conf/hadoop-metrics2-hbase.properties']
{'content': Template('hadoop-metrics2-hbase.properties.j2'), 'owner':
'ams', 'group': 'hadoop'}
2019-11-19 14:56:49,376 -
TemplateConfig['/etc/ams-hbase/conf/regionservers'] {'owner': 'ams',
'template_tag': None}
2019-11-19 14:56:49,378 - File['/etc/ams-hbase/conf/regionservers']
{'content': Template('regionservers.j2'), 'owner': 'ams', 'group':
None, 'mode': None}
2019-11-19 14:56:49,378 -
Directory['/var/run/ambari-metrics-collector/'] {'owner': 'ams',
'create_parents': True, 'mode': 0755, 'cd_access': 'a'}
2019-11-19 14:56:49,379 -
Directory['/var/log/ambari-metrics-collector'] {'owner': 'ams',
'create_parents': True, 'mode': 0755, 'cd_access': 'a'}
2019-11-19 14:56:49,379 -
Directory['/var/lib/ambari-metrics-collector/hbase'] {'owner': 'ams',
'create_parents': True, 'recursive_ownership': True, 'cd_access': 'a'}
2019-11-19 14:56:49,415 -
File['/var/run/ambari-metrics-collector//distributed_mode'] {'owner':
'ams', 'action': ['delete']}
2019-11-19 14:56:49,418 - File['/etc/ams-hbase/conf/log4j.properties']
{'content': InlineTemplate(...), 'owner': 'ams', 'group': 'hadoop',
'mode': 0644}
2019-11-19 14:56:49,423 -
Directory['/usr/lib/ambari-logsearch-logfeeder/conf']
{'create_parents': True, 'mode': 0755, 'cd_access': 'a'}
2019-11-19 14:56:49,423 - Generate Log Feeder config file:
/usr/lib/ambari-logsearch-logfeeder/conf/input.config-ambari-metrics.json
2019-11-19 14:56:49,424 -
File['/usr/lib/ambari-logsearch-logfeeder/conf/input.config-ambari-metrics.json']
{'content': Template('input.config-ambari-metrics.json.j2'), 'mode':
0644}
2019-11-19 14:56:49,424 - Directory['/etc/ams-hbase/conf'] {'owner':
'ams', 'group': 'hadoop', 'create_parents': True,
'recursive_ownership': True}
2019-11-19 14:56:49,425 -
Directory['/var/lib/ambari-metrics-collector/hbase-tmp'] {'owner':
'ams', 'create_parents': True, 'recursive_ownership': True,
'cd_access': 'a'}
2019-11-19 14:56:49,442 -
Directory['/var/lib/ambari-metrics-collector/hbase-tmp/local/jars']
{'owner': 'ams', 'group': 'hadoop', 'create_parents': True, 'mode':
0775, 'cd_access': 'a'}
2019-11-19 14:56:49,443 - File['/etc/ams-hbase/conf/core-site.xml']
{'owner': 'ams', 'action': ['delete']}
2019-11-19 14:56:49,444 - File['/etc/ams-hbase/conf/hdfs-site.xml']
{'owner': 'ams', 'action': ['delete']}
2019-11-19 14:56:49,444 - XmlConfig['hbase-site.xml'] {'owner': 'ams',
'group': 'hadoop', 'conf_dir': '/etc/ams-hbase/conf',
'configuration_attributes': {u'final': {u'hbase.zookeeper.quorum':
u'true'}}, 'configurations': ...}
2019-11-19 14:56:49,451 - Generating config: /etc/ams-hbase/conf/hbase-site.xml
2019-11-19 14:56:49,452 - File['/etc/ams-hbase/conf/hbase-site.xml']
{'owner': 'ams', 'content': InlineTemplate(...), 'group': 'hadoop',
'mode': None, 'encoding': 'UTF-8'}
2019-11-19 14:56:49,482 - XmlConfig['hbase-policy.xml'] {'owner':
'ams', 'group': 'hadoop', 'conf_dir': '/etc/ams-hbase/conf',
'configuration_attributes': {}, 'configurations':
{u'security.admin.protocol.acl': u'*',
u'security.masterregion.protocol.acl': u'*',
u'security.client.protocol.acl': u'*'}}
2019-11-19 14:56:49,489 - Generating config:
/etc/ams-hbase/conf/hbase-policy.xml
2019-11-19 14:56:49,489 - File['/etc/ams-hbase/conf/hbase-policy.xml']
{'owner': 'ams', 'content': InlineTemplate(...), 'group': 'hadoop',
'mode': None, 'encoding': 'UTF-8'}
2019-11-19 14:56:49,498 - File['/etc/ams-hbase/conf/hbase-env.sh']
{'content': InlineTemplate(...), 'owner': 'ams'}
2019-11-19 14:56:49,502 -
File['/etc/ams-hbase/conf/hadoop-metrics2-hbase.properties']
{'content': Template('hadoop-metrics2-hbase.properties.j2'), 'owner':
'ams', 'group': 'hadoop'}
2019-11-19 14:56:49,503 -
TemplateConfig['/etc/ams-hbase/conf/regionservers'] {'owner': 'ams',
'template_tag': None}
2019-11-19 14:56:49,504 - File['/etc/ams-hbase/conf/regionservers']
{'content': Template('regionservers.j2'), 'owner': 'ams', 'group':
None, 'mode': None}
2019-11-19 14:56:49,505 -
Directory['/var/run/ambari-metrics-collector/'] {'owner': 'ams',
'create_parents': True, 'mode': 0755, 'cd_access': 'a'}
2019-11-19 14:56:49,505 -
Directory['/var/log/ambari-metrics-collector'] {'owner': 'ams',
'create_parents': True, 'mode': 0755, 'cd_access': 'a'}
2019-11-19 14:56:49,508 - File['/etc/ams-hbase/conf/log4j.properties']
{'content': InlineTemplate(...), 'owner': 'ams', 'group': 'hadoop',
'mode': 0644}
2019-11-19 14:56:49,513 -
Directory['/usr/lib/ambari-logsearch-logfeeder/conf']
{'create_parents': True, 'mode': 0755, 'cd_access': 'a'}
2019-11-19 14:56:49,513 - Generate Log Feeder config file:
/usr/lib/ambari-logsearch-logfeeder/conf/input.config-ambari-metrics.json
2019-11-19 14:56:49,513 -
File['/usr/lib/ambari-logsearch-logfeeder/conf/input.config-ambari-metrics.json']
{'content': Template('input.config-ambari-metrics.json.j2'), 'mode':
0644}
2019-11-19 14:56:49,514 -
Directory['/etc/ambari-metrics-collector/conf'] {'owner': 'ams',
'group': 'hadoop', 'create_parents': True, 'recursive_ownership':
True}
2019-11-19 14:56:49,515 -
Directory['/var/lib/ambari-metrics-collector/checkpoint'] {'owner':
'ams', 'group': 'hadoop', 'create_parents': True,
'recursive_ownership': True, 'cd_access': 'a'}
2019-11-19 14:56:49,516 - XmlConfig['ams-site.xml'] {'owner': 'ams',
'group': 'hadoop', 'conf_dir': '/etc/ambari-metrics-collector/conf',
'configuration_attributes': {}, 'configurations': ...}
2019-11-19 14:56:49,523 - Generating config:
/etc/ambari-metrics-collector/conf/ams-site.xml
2019-11-19 14:56:49,523 -
File['/etc/ambari-metrics-collector/conf/ams-site.xml'] {'owner':
'ams', 'content': InlineTemplate(...), 'group': 'hadoop', 'mode':
None, 'encoding': 'UTF-8'}
2019-11-19 14:56:49,569 - XmlConfig['ssl-server.xml'] {'owner': 'ams',
'group': 'hadoop', 'conf_dir': '/etc/ambari-metrics-collector/conf',
'configuration_attributes': {}, 'configurations': ...}
2019-11-19 14:56:49,577 - Generating config:
/etc/ambari-metrics-collector/conf/ssl-server.xml
2019-11-19 14:56:49,578 -
File['/etc/ambari-metrics-collector/conf/ssl-server.xml'] {'owner':
'ams', 'content': InlineTemplate(...), 'group': 'hadoop', 'mode':
None, 'encoding': 'UTF-8'}
2019-11-19 14:56:49,583 - XmlConfig['hbase-site.xml'] {'owner': 'ams',
'group': 'hadoop', 'conf_dir': '/etc/ambari-metrics-collector/conf',
'configuration_attributes': {u'final': {u'hbase.zookeeper.quorum':
u'true'}}, 'configurations': ...}
2019-11-19 14:56:49,590 - Generating config:
/etc/ambari-metrics-collector/conf/hbase-site.xml
2019-11-19 14:56:49,590 -
File['/etc/ambari-metrics-collector/conf/hbase-site.xml'] {'owner':
'ams', 'content': InlineTemplate(...), 'group': 'hadoop', 'mode':
None, 'encoding': 'UTF-8'}
2019-11-19 14:56:49,623 -
File['/etc/ambari-metrics-collector/conf/log4j.properties']
{'content': InlineTemplate(...), 'owner': 'ams', 'group': 'hadoop',
'mode': 0644}
2019-11-19 14:56:49,626 -
File['/etc/ambari-metrics-collector/conf/ams-env.sh'] {'content':
InlineTemplate(...), 'owner': 'ams'}
2019-11-19 14:56:49,627 -
Directory['/var/log/ambari-metrics-collector'] {'owner': 'ams',
'group': 'hadoop', 'create_parents': True, 'mode': 0755, 'cd_access':
'a'}
2019-11-19 14:56:49,658 -
Directory['/var/run/ambari-metrics-collector'] {'owner': 'ams',
'group': 'hadoop', 'create_parents': True, 'mode': 0755, 'cd_access':
'a'}
2019-11-19 14:56:49,659 - File['/usr/lib/ams-hbase/bin/hadoop']
{'owner': 'ams', 'mode': 0755}
2019-11-19 14:56:49,659 - Directory['/etc/security/limits.d']
{'owner': 'root', 'create_parents': True, 'group': 'root'}
2019-11-19 14:56:49,661 - File['/etc/security/limits.d/ams.conf']
{'content': Template('ams.conf.j2'), 'owner': 'root', 'group': 'root',
'mode': 0644}
2019-11-19 14:56:49,666 -
Directory['/usr/lib/ambari-logsearch-logfeeder/conf']
{'create_parents': True, 'mode': 0755, 'cd_access': 'a'}
2019-11-19 14:56:49,685 - Generate Log Feeder config file:
/usr/lib/ambari-logsearch-logfeeder/conf/input.config-ambari-metrics.json
2019-11-19 14:56:49,685 -
File['/usr/lib/ambari-logsearch-logfeeder/conf/input.config-ambari-metrics.json']
{'content': Template('input.config-ambari-metrics.json.j2'), 'mode':
0644}
2019-11-19 14:56:49,687 -
Execute['/usr/lib/ams-hbase/bin/hbase-daemon.sh --config
/etc/ams-hbase/conf stop regionserver'] {'on_timeout': 'ls
/var/run/ambari-metrics-collector//hbase-ams-regionserver.pid
>/dev/null 2>&1 && ps `cat
/var/run/ambari-metrics-collector//hbase-ams-regionserver.pid`
>/dev/null 2>&1 && ambari-sudo.sh -H -E kill -9 `ambari-sudo.sh cat
/var/run/ambari-metrics-collector//hbase-ams-regionserver.pid`',
'timeout': 30, 'user': 'ams'}
2019-11-19 14:56:49,739 -
File['/var/run/ambari-metrics-collector//hbase-ams-regionserver.pid']
{'action': ['delete']}
2019-11-19 14:56:49,740 - Execute['/usr/sbin/ambari-metrics-collector
--config /etc/ambari-metrics-collector/conf stop'] {'user': 'ams'}
2019-11-19 14:56:54,834 - Execute['ambari-sudo.sh rm -rf
/var/lib/ambari-metrics-collector/hbase-tmp/*.tmp'] {}
2019-11-19 14:56:54,845 -
File['/etc/ambari-metrics-collector/conf/core-site.xml'] {'owner':
'ams', 'action': ['delete']}
2019-11-19 14:56:54,845 -
File['/etc/ambari-metrics-collector/conf/hdfs-site.xml'] {'owner':
'ams', 'action': ['delete']}
2019-11-19 14:56:54,846 - Execute['/usr/sbin/ambari-metrics-collector
--config /etc/ambari-metrics-collector/conf start'] {'user': 'ams'}
2019-11-19 15:02:19,965 - Skipping stack-select on AMBARI_METRICS
because it does not exist in the stack-select package structure.

Command failed after 1 tries

Re: ambari metrics not working

sagarshimpi — Tue, 19 Nov 2019 10:18:17 GMT

@Manoj690

Try below 2 options -

1. Check if "/var/run/ambari-metrics-collector/" directory exist and is with permission ams:hadoop

If YES. Then go for option2.

If Not try creating directory and check if AMS startup works.

2. Delete AMS service and its components from CLI also -

rpm -qa|grep ams

-Remove all components of ams

And reinstall AMS.

Let me know if that works.

Also please share new logs in text file attach. Its easy way of formatting logs to be displayed at remote end.

Re: ambari metrics not working

Manoj690 — Tue, 19 Nov 2019 10:23:06 GMT

How to uninstall and reinstall AMS, can you tell me steps

Re: ambari metrics not working

Manoj690 — Tue, 19 Nov 2019 10:54:05 GMT

Hbase is starting successfully but in ambari still shows stopped.