Support Questions

Find answers, ask questions, and share your expertise
Announcements
Celebrating as our community reaches 100,000 members! Thank you!

ambari metrics not working

avatar
Contributor

stderr:   /var/lib/ambari-agent/data/errors-2079.txt

/Traceback (most recent call last):
  File "/usr/lib/ambari-agent/lib/resource_management/libraries/script/script.py", line 995, in restart
    self.status(env)
  File "/var/lib/ambari-agent/cache/stacks/HDP/3.0/services/AMBARI_METRICS/package/scripts/metrics_collector.py", line 63, in status
    check_service_status(env, name='collector')
  File "/usr/lib/ambari-agent/lib/ambari_commons/os_family_impl.py", line 89, in thunk
    return fn(*args, **kwargs)
  File "/var/lib/ambari-agent/cache/stacks/HDP/3.0/services/AMBARI_METRICS/package/scripts/status.py", line 41, in check_service_status
    check_process_status(pid_file)
  File "/usr/lib/ambari-agent/lib/resource_management/libraries/functions/check_process_status.py", line 43, in check_process_status
    raise ComponentIsNotRunning()
ComponentIsNotRunning

The above exception was the cause of the following exception:

Traceback (most recent call last):
  File "/var/lib/ambari-agent/cache/stacks/HDP/3.0/services/AMBARI_METRICS/package/scripts/metrics_collector.py", line 90, in <module>
    AmsCollector().execute()
  File "/usr/lib/ambari-agent/lib/resource_management/libraries/script/script.py", line 352, in execute
    method(env)
  File "/usr/lib/ambari-agent/lib/resource_management/libraries/script/script.py", line 1012, in restart
    self.post_start(env)
  File "/usr/lib/ambari-agent/lib/resource_management/libraries/script/script.py", line 424, in post_start
    raise Fail("Pid file {0} doesn't exist after starting of the component.".format(pid_file))
resource_management.core.exceptions.Fail: Pid file /var/run/ambari-metrics-collector//hbase-ams-master.pid doesn't exist after starting of the component./ 

 

1 ACCEPTED SOLUTION

avatar
Expert Contributor

@Manoj690 

 

Try below 2 options -

 

1. Check if "/var/run/ambari-metrics-collector/" directory exist and is with permission ams:hadoop

If YES. Then go for option2.

If Not try creating directory and check if AMS startup works.

2. Delete AMS service and its components from CLI also -

rpm -qa|grep ams

-Remove all components of ams

And reinstall AMS.

 

Let me know if that works.

Also please share new logs in text file attach. Its easy way of formatting logs to be displayed at remote end.

View solution in original post

7 REPLIES 7

avatar
Expert Contributor

Hi @Manoj690 

 

Did the earlier community link helped to resolve issue - https://community.cloudera.com/t5/Support-Questions/Ambari-metircs-not-started/m-p/283228#M210525   ??

 

Please confirm!!

avatar
Contributor
No its not resolved and also one more question how to completely uninstall
Phoenix in my system and reinstall?

avatar
Expert Contributor

@Manoj690 

 

1. What is the error you are getting after following the link - https://community.cloudera.com/t5/Support-Questions/Ambari-metircs-not-started/m-p/283228#M210525%C2...

 

The error you pasted are you getting it while starting AMS via Ambari?

Did you tried to start from CLI/backend using command "ambari-metrics-collector  start"?  Make sure you stop the service properly, kill if any pid exist and then start.

 

2. For phoenix - I see phoenix comes as part of hbase and is enabled or disabled from hbase configs as shown below.

img22.PNG

Its basically comes as part of hdp bits located in -
/usr/hdp/current/phoenix-client

/usr/hdp/current/phoenix-server


Why do you want to completely uninstall phoenix ? Can you pass details so that we can help to understand and provide you if any workaround.

 

 

avatar
Contributor
ambari metrics still shows same error


stderr:
Traceback (most recent call last):
File "/var/lib/ambari-agent/cache/stacks/HDP/3.0/services/AMBARI_METRICS/package/scripts/metrics_collector.py",
line 90, in
AmsCollector().execute()
File "/usr/lib/ambari-agent/lib/resource_management/libraries/script/script.py",
line 355, in execute
self.execute_prefix_function(self.command_name, 'post', env)
File "/usr/lib/ambari-agent/lib/resource_management/libraries/script/script.py",
line 382, in execute_prefix_function
method(env)
File "/usr/lib/ambari-agent/lib/resource_management/libraries/script/script.py",
line 424, in post_start
raise Fail("Pid file {0} doesn't exist after starting of the
component.".format(pid_file))
resource_management.core.exceptions.Fail: Pid file
/var/run/ambari-metrics-collector//hbase-ams-master.pid doesn't exist
after starting of the component.
stdout:
2019-11-19 14:56:48,719 - Stack Feature Version Info: Cluster
Stack=3.1, Command Stack=None, Command Version=3.1.0.0-78 ->
3.1.0.0-78
2019-11-19 14:56:48,735 - Using hadoop conf dir: /usr/hdp/3.1.0.0-78/hadoop/conf
2019-11-19 14:56:48,920 - Stack Feature Version Info: Cluster
Stack=3.1, Command Stack=None, Command Version=3.1.0.0-78 ->
3.1.0.0-78
2019-11-19 14:56:48,926 - Using hadoop conf dir: /usr/hdp/3.1.0.0-78/hadoop/conf
2019-11-19 14:56:48,927 - Group['hdfs'] {}
2019-11-19 14:56:48,927 - Group['hadoop'] {}
2019-11-19 14:56:48,928 - Group['users'] {}
2019-11-19 14:56:48,928 - User['yarn-ats'] {'gid': 'hadoop',
'fetch_nonlocal_groups': True, 'groups': ['hadoop'], 'uid': None}
2019-11-19 14:56:48,929 - User['hive'] {'gid': 'hadoop',
'fetch_nonlocal_groups': True, 'groups': ['hadoop'], 'uid': None}
2019-11-19 14:56:48,930 - User['storm'] {'gid': 'hadoop',
'fetch_nonlocal_groups': True, 'groups': ['hadoop'], 'uid': None}
2019-11-19 14:56:48,931 - User['zookeeper'] {'gid': 'hadoop',
'fetch_nonlocal_groups': True, 'groups': ['hadoop'], 'uid': None}
2019-11-19 14:56:48,931 - User['oozie'] {'gid': 'hadoop',
'fetch_nonlocal_groups': True, 'groups': ['hadoop', 'users'], 'uid':
None}
2019-11-19 14:56:48,932 - User['atlas'] {'gid': 'hadoop',
'fetch_nonlocal_groups': True, 'groups': ['hadoop'], 'uid': None}
2019-11-19 14:56:48,933 - User['ams'] {'gid': 'hadoop',
'fetch_nonlocal_groups': True, 'groups': ['hadoop'], 'uid': None}
2019-11-19 14:56:48,933 - User['tez'] {'gid': 'hadoop',
'fetch_nonlocal_groups': True, 'groups': ['hadoop', 'users'], 'uid':
None}
2019-11-19 14:56:48,934 - User['ambari-qa'] {'gid': 'hadoop',
'fetch_nonlocal_groups': True, 'groups': ['hadoop', 'users'], 'uid':
None}
2019-11-19 14:56:48,935 - User['kafka'] {'gid': 'hadoop',
'fetch_nonlocal_groups': True, 'groups': ['hadoop'], 'uid': None}
2019-11-19 14:56:48,936 - User['hdfs'] {'gid': 'hadoop',
'fetch_nonlocal_groups': True, 'groups': ['hdfs', 'hadoop'], 'uid':
None}
2019-11-19 14:56:48,936 - User['yarn'] {'gid': 'hadoop',
'fetch_nonlocal_groups': True, 'groups': ['hadoop'], 'uid': None}
2019-11-19 14:56:48,937 - User['mapred'] {'gid': 'hadoop',
'fetch_nonlocal_groups': True, 'groups': ['hadoop'], 'uid': None}
2019-11-19 14:56:48,938 - User['hbase'] {'gid': 'hadoop',
'fetch_nonlocal_groups': True, 'groups': ['hadoop'], 'uid': None}
2019-11-19 14:56:48,938 -
File['/var/lib/ambari-agent/tmp/changeUid.sh'] {'content':
StaticFile('changeToSecureUid.sh'), 'mode': 0555}
2019-11-19 14:56:48,939 -
Execute['/var/lib/ambari-agent/tmp/changeUid.sh ambari-qa
/tmp/hadoop-ambari-qa,/tmp/hsperfdata_ambari-qa,/home/ambari-qa,/tmp/ambari-qa,/tmp/sqoop-ambari-qa
0'] {'not_if': '(test $(id -u ambari-qa) -gt 1000) || (false)'}
2019-11-19 14:56:48,945 - Skipping
Execute['/var/lib/ambari-agent/tmp/changeUid.sh ambari-qa
/tmp/hadoop-ambari-qa,/tmp/hsperfdata_ambari-qa,/home/ambari-qa,/tmp/ambari-qa,/tmp/sqoop-ambari-qa
0'] due to not_if
2019-11-19 14:56:48,945 - Directory['/tmp/hbase-hbase'] {'owner':
'hbase', 'create_parents': True, 'mode': 0775, 'cd_access': 'a'}
2019-11-19 14:56:48,947 -
File['/var/lib/ambari-agent/tmp/changeUid.sh'] {'content':
StaticFile('changeToSecureUid.sh'), 'mode': 0555}
2019-11-19 14:56:48,947 -
File['/var/lib/ambari-agent/tmp/changeUid.sh'] {'content':
StaticFile('changeToSecureUid.sh'), 'mode': 0555}
2019-11-19 14:56:48,948 - call['/var/lib/ambari-agent/tmp/changeUid.sh
hbase'] {}
2019-11-19 14:56:48,956 - call returned (0, '1015')
2019-11-19 14:56:48,957 -
Execute['/var/lib/ambari-agent/tmp/changeUid.sh hbase
/home/hbase,/tmp/hbase,/usr/bin/hbase,/var/log/hbase,/tmp/hbase-hbase
1015'] {'not_if': '(test $(id -u hbase) -gt 1000) || (false)'}
2019-11-19 14:56:48,963 - Skipping
Execute['/var/lib/ambari-agent/tmp/changeUid.sh hbase
/home/hbase,/tmp/hbase,/usr/bin/hbase,/var/log/hbase,/tmp/hbase-hbase
1015'] due to not_if
2019-11-19 14:56:48,963 - Group['hdfs'] {}
2019-11-19 14:56:48,964 - User['hdfs'] {'fetch_nonlocal_groups': True,
'groups': ['hdfs', 'hadoop', u'hdfs']}
2019-11-19 14:56:48,964 - FS Type: HDFS
2019-11-19 14:56:48,965 - Directory['/etc/hadoop'] {'mode': 0755}
2019-11-19 14:56:48,982 -
File['/usr/hdp/3.1.0.0-78/hadoop/conf/hadoop-env.sh'] {'content':
InlineTemplate(...), 'owner': 'hdfs', 'group': 'hadoop'}
2019-11-19 14:56:48,983 - Writing
File['/usr/hdp/3.1.0.0-78/hadoop/conf/hadoop-env.sh'] because contents
don't match
2019-11-19 14:56:48,983 -
Directory['/var/lib/ambari-agent/tmp/hadoop_java_io_tmpdir'] {'owner':
'hdfs', 'group': 'hadoop', 'mode': 01777}
2019-11-19 14:56:49,003 - Execute[('setenforce', '0')] {'not_if': '(!
which getenforce ) || (which getenforce && getenforce | grep -q
Disabled)', 'sudo': True, 'only_if': 'test -f /selinux/enforce'}
2019-11-19 14:56:49,008 - Skipping Execute[('setenforce', '0')] due to not_if
2019-11-19 14:56:49,008 - Directory['/var/log/hadoop'] {'owner':
'root', 'create_parents': True, 'group': 'hadoop', 'mode': 0775,
'cd_access': 'a'}
2019-11-19 14:56:49,010 - Directory['/var/run/hadoop'] {'owner':
'root', 'create_parents': True, 'group': 'root', 'cd_access': 'a'}
2019-11-19 14:56:49,010 - Directory['/var/run/hadoop/hdfs'] {'owner':
'hdfs', 'cd_access': 'a'}
2019-11-19 14:56:49,011 - Directory['/tmp/hadoop-hdfs'] {'owner':
'hdfs', 'create_parents': True, 'cd_access': 'a'}
2019-11-19 14:56:49,014 -
File['/usr/hdp/3.1.0.0-78/hadoop/conf/commons-logging.properties']
{'content': Template('commons-logging.properties.j2'), 'owner':
'hdfs'}
2019-11-19 14:56:49,016 -
File['/usr/hdp/3.1.0.0-78/hadoop/conf/health_check'] {'content':
Template('health_check.j2'), 'owner': 'hdfs'}
2019-11-19 14:56:49,023 -
File['/usr/hdp/3.1.0.0-78/hadoop/conf/log4j.properties'] {'content':
InlineTemplate(...), 'owner': 'hdfs', 'group': 'hadoop', 'mode': 0644}
2019-11-19 14:56:49,031 -
File['/usr/hdp/3.1.0.0-78/hadoop/conf/hadoop-metrics2.properties']
{'content': InlineTemplate(...), 'owner': 'hdfs', 'group': 'hadoop'}
2019-11-19 14:56:49,032 -
File['/usr/hdp/3.1.0.0-78/hadoop/conf/task-log4j.properties']
{'content': StaticFile('task-log4j.properties'), 'mode': 0755}
2019-11-19 14:56:49,032 -
File['/usr/hdp/3.1.0.0-78/hadoop/conf/configuration.xsl'] {'owner':
'hdfs', 'group': 'hadoop'}
2019-11-19 14:56:49,036 -
File['/etc/hadoop/conf/topology_mappings.data'] {'owner': 'hdfs',
'content': Template('topology_mappings.data.j2'), 'only_if': 'test -d
/etc/hadoop/conf', 'group': 'hadoop', 'mode': 0644}
2019-11-19 14:56:49,040 - File['/etc/hadoop/conf/topology_script.py']
{'content': StaticFile('topology_script.py'), 'only_if': 'test -d
/etc/hadoop/conf', 'mode': 0755}
2019-11-19 14:56:49,043 - Skipping unlimited key JCE policy check and
setup since it is not required
2019-11-19 14:56:49,050 - Skipping stack-select on AMBARI_METRICS
because it does not exist in the stack-select package structure.
2019-11-19 14:56:49,291 - Using hadoop conf dir: /usr/hdp/3.1.0.0-78/hadoop/conf
2019-11-19 14:56:49,293 - checked_call['hostid'] {}
2019-11-19 14:56:49,296 - checked_call returned (0, 'a8c02018')
2019-11-19 14:56:49,298 - Directory['/etc/ams-hbase/conf'] {'owner':
'ams', 'group': 'hadoop', 'create_parents': True,
'recursive_ownership': True}
2019-11-19 14:56:49,299 -
Directory['/var/lib/ambari-metrics-collector/hbase-tmp'] {'owner':
'ams', 'create_parents': True, 'recursive_ownership': True,
'cd_access': 'a'}
2019-11-19 14:56:49,315 -
Directory['/var/lib/ambari-metrics-collector/hbase-tmp/local/jars']
{'owner': 'ams', 'group': 'hadoop', 'create_parents': True, 'mode':
0775, 'cd_access': 'a'}
2019-11-19 14:56:49,316 - File['/etc/ams-hbase/conf/core-site.xml']
{'owner': 'ams', 'action': ['delete']}
2019-11-19 14:56:49,316 - File['/etc/ams-hbase/conf/hdfs-site.xml']
{'owner': 'ams', 'action': ['delete']}
2019-11-19 14:56:49,316 - XmlConfig['hbase-site.xml'] {'owner': 'ams',
'group': 'hadoop', 'conf_dir': '/etc/ams-hbase/conf',
'configuration_attributes': {u'final': {u'hbase.zookeeper.quorum':
u'true'}}, 'configurations': ...}
2019-11-19 14:56:49,325 - Generating config: /etc/ams-hbase/conf/hbase-site.xml
2019-11-19 14:56:49,325 - File['/etc/ams-hbase/conf/hbase-site.xml']
{'owner': 'ams', 'content': InlineTemplate(...), 'group': 'hadoop',
'mode': None, 'encoding': 'UTF-8'}
2019-11-19 14:56:49,355 - XmlConfig['hbase-policy.xml'] {'owner':
'ams', 'group': 'hadoop', 'conf_dir': '/etc/ams-hbase/conf',
'configuration_attributes': {}, 'configurations':
{u'security.admin.protocol.acl': u'*',
u'security.masterregion.protocol.acl': u'*',
u'security.client.protocol.acl': u'*'}}
2019-11-19 14:56:49,362 - Generating config:
/etc/ams-hbase/conf/hbase-policy.xml
2019-11-19 14:56:49,362 - File['/etc/ams-hbase/conf/hbase-policy.xml']
{'owner': 'ams', 'content': InlineTemplate(...), 'group': 'hadoop',
'mode': None, 'encoding': 'UTF-8'}
2019-11-19 14:56:49,371 - File['/etc/ams-hbase/conf/hbase-env.sh']
{'content': InlineTemplate(...), 'owner': 'ams'}
2019-11-19 14:56:49,376 -
File['/etc/ams-hbase/conf/hadoop-metrics2-hbase.properties']
{'content': Template('hadoop-metrics2-hbase.properties.j2'), 'owner':
'ams', 'group': 'hadoop'}
2019-11-19 14:56:49,376 -
TemplateConfig['/etc/ams-hbase/conf/regionservers'] {'owner': 'ams',
'template_tag': None}
2019-11-19 14:56:49,378 - File['/etc/ams-hbase/conf/regionservers']
{'content': Template('regionservers.j2'), 'owner': 'ams', 'group':
None, 'mode': None}
2019-11-19 14:56:49,378 -
Directory['/var/run/ambari-metrics-collector/'] {'owner': 'ams',
'create_parents': True, 'mode': 0755, 'cd_access': 'a'}
2019-11-19 14:56:49,379 -
Directory['/var/log/ambari-metrics-collector'] {'owner': 'ams',
'create_parents': True, 'mode': 0755, 'cd_access': 'a'}
2019-11-19 14:56:49,379 -
Directory['/var/lib/ambari-metrics-collector/hbase'] {'owner': 'ams',
'create_parents': True, 'recursive_ownership': True, 'cd_access': 'a'}
2019-11-19 14:56:49,415 -
File['/var/run/ambari-metrics-collector//distributed_mode'] {'owner':
'ams', 'action': ['delete']}
2019-11-19 14:56:49,418 - File['/etc/ams-hbase/conf/log4j.properties']
{'content': InlineTemplate(...), 'owner': 'ams', 'group': 'hadoop',
'mode': 0644}
2019-11-19 14:56:49,423 -
Directory['/usr/lib/ambari-logsearch-logfeeder/conf']
{'create_parents': True, 'mode': 0755, 'cd_access': 'a'}
2019-11-19 14:56:49,423 - Generate Log Feeder config file:
/usr/lib/ambari-logsearch-logfeeder/conf/input.config-ambari-metrics.json
2019-11-19 14:56:49,424 -
File['/usr/lib/ambari-logsearch-logfeeder/conf/input.config-ambari-metrics.json']
{'content': Template('input.config-ambari-metrics.json.j2'), 'mode':
0644}
2019-11-19 14:56:49,424 - Directory['/etc/ams-hbase/conf'] {'owner':
'ams', 'group': 'hadoop', 'create_parents': True,
'recursive_ownership': True}
2019-11-19 14:56:49,425 -
Directory['/var/lib/ambari-metrics-collector/hbase-tmp'] {'owner':
'ams', 'create_parents': True, 'recursive_ownership': True,
'cd_access': 'a'}
2019-11-19 14:56:49,442 -
Directory['/var/lib/ambari-metrics-collector/hbase-tmp/local/jars']
{'owner': 'ams', 'group': 'hadoop', 'create_parents': True, 'mode':
0775, 'cd_access': 'a'}
2019-11-19 14:56:49,443 - File['/etc/ams-hbase/conf/core-site.xml']
{'owner': 'ams', 'action': ['delete']}
2019-11-19 14:56:49,444 - File['/etc/ams-hbase/conf/hdfs-site.xml']
{'owner': 'ams', 'action': ['delete']}
2019-11-19 14:56:49,444 - XmlConfig['hbase-site.xml'] {'owner': 'ams',
'group': 'hadoop', 'conf_dir': '/etc/ams-hbase/conf',
'configuration_attributes': {u'final': {u'hbase.zookeeper.quorum':
u'true'}}, 'configurations': ...}
2019-11-19 14:56:49,451 - Generating config: /etc/ams-hbase/conf/hbase-site.xml
2019-11-19 14:56:49,452 - File['/etc/ams-hbase/conf/hbase-site.xml']
{'owner': 'ams', 'content': InlineTemplate(...), 'group': 'hadoop',
'mode': None, 'encoding': 'UTF-8'}
2019-11-19 14:56:49,482 - XmlConfig['hbase-policy.xml'] {'owner':
'ams', 'group': 'hadoop', 'conf_dir': '/etc/ams-hbase/conf',
'configuration_attributes': {}, 'configurations':
{u'security.admin.protocol.acl': u'*',
u'security.masterregion.protocol.acl': u'*',
u'security.client.protocol.acl': u'*'}}
2019-11-19 14:56:49,489 - Generating config:
/etc/ams-hbase/conf/hbase-policy.xml
2019-11-19 14:56:49,489 - File['/etc/ams-hbase/conf/hbase-policy.xml']
{'owner': 'ams', 'content': InlineTemplate(...), 'group': 'hadoop',
'mode': None, 'encoding': 'UTF-8'}
2019-11-19 14:56:49,498 - File['/etc/ams-hbase/conf/hbase-env.sh']
{'content': InlineTemplate(...), 'owner': 'ams'}
2019-11-19 14:56:49,502 -
File['/etc/ams-hbase/conf/hadoop-metrics2-hbase.properties']
{'content': Template('hadoop-metrics2-hbase.properties.j2'), 'owner':
'ams', 'group': 'hadoop'}
2019-11-19 14:56:49,503 -
TemplateConfig['/etc/ams-hbase/conf/regionservers'] {'owner': 'ams',
'template_tag': None}
2019-11-19 14:56:49,504 - File['/etc/ams-hbase/conf/regionservers']
{'content': Template('regionservers.j2'), 'owner': 'ams', 'group':
None, 'mode': None}
2019-11-19 14:56:49,505 -
Directory['/var/run/ambari-metrics-collector/'] {'owner': 'ams',
'create_parents': True, 'mode': 0755, 'cd_access': 'a'}
2019-11-19 14:56:49,505 -
Directory['/var/log/ambari-metrics-collector'] {'owner': 'ams',
'create_parents': True, 'mode': 0755, 'cd_access': 'a'}
2019-11-19 14:56:49,508 - File['/etc/ams-hbase/conf/log4j.properties']
{'content': InlineTemplate(...), 'owner': 'ams', 'group': 'hadoop',
'mode': 0644}
2019-11-19 14:56:49,513 -
Directory['/usr/lib/ambari-logsearch-logfeeder/conf']
{'create_parents': True, 'mode': 0755, 'cd_access': 'a'}
2019-11-19 14:56:49,513 - Generate Log Feeder config file:
/usr/lib/ambari-logsearch-logfeeder/conf/input.config-ambari-metrics.json
2019-11-19 14:56:49,513 -
File['/usr/lib/ambari-logsearch-logfeeder/conf/input.config-ambari-metrics.json']
{'content': Template('input.config-ambari-metrics.json.j2'), 'mode':
0644}
2019-11-19 14:56:49,514 -
Directory['/etc/ambari-metrics-collector/conf'] {'owner': 'ams',
'group': 'hadoop', 'create_parents': True, 'recursive_ownership':
True}
2019-11-19 14:56:49,515 -
Directory['/var/lib/ambari-metrics-collector/checkpoint'] {'owner':
'ams', 'group': 'hadoop', 'create_parents': True,
'recursive_ownership': True, 'cd_access': 'a'}
2019-11-19 14:56:49,516 - XmlConfig['ams-site.xml'] {'owner': 'ams',
'group': 'hadoop', 'conf_dir': '/etc/ambari-metrics-collector/conf',
'configuration_attributes': {}, 'configurations': ...}
2019-11-19 14:56:49,523 - Generating config:
/etc/ambari-metrics-collector/conf/ams-site.xml
2019-11-19 14:56:49,523 -
File['/etc/ambari-metrics-collector/conf/ams-site.xml'] {'owner':
'ams', 'content': InlineTemplate(...), 'group': 'hadoop', 'mode':
None, 'encoding': 'UTF-8'}
2019-11-19 14:56:49,569 - XmlConfig['ssl-server.xml'] {'owner': 'ams',
'group': 'hadoop', 'conf_dir': '/etc/ambari-metrics-collector/conf',
'configuration_attributes': {}, 'configurations': ...}
2019-11-19 14:56:49,577 - Generating config:
/etc/ambari-metrics-collector/conf/ssl-server.xml
2019-11-19 14:56:49,578 -
File['/etc/ambari-metrics-collector/conf/ssl-server.xml'] {'owner':
'ams', 'content': InlineTemplate(...), 'group': 'hadoop', 'mode':
None, 'encoding': 'UTF-8'}
2019-11-19 14:56:49,583 - XmlConfig['hbase-site.xml'] {'owner': 'ams',
'group': 'hadoop', 'conf_dir': '/etc/ambari-metrics-collector/conf',
'configuration_attributes': {u'final': {u'hbase.zookeeper.quorum':
u'true'}}, 'configurations': ...}
2019-11-19 14:56:49,590 - Generating config:
/etc/ambari-metrics-collector/conf/hbase-site.xml
2019-11-19 14:56:49,590 -
File['/etc/ambari-metrics-collector/conf/hbase-site.xml'] {'owner':
'ams', 'content': InlineTemplate(...), 'group': 'hadoop', 'mode':
None, 'encoding': 'UTF-8'}
2019-11-19 14:56:49,623 -
File['/etc/ambari-metrics-collector/conf/log4j.properties']
{'content': InlineTemplate(...), 'owner': 'ams', 'group': 'hadoop',
'mode': 0644}
2019-11-19 14:56:49,626 -
File['/etc/ambari-metrics-collector/conf/ams-env.sh'] {'content':
InlineTemplate(...), 'owner': 'ams'}
2019-11-19 14:56:49,627 -
Directory['/var/log/ambari-metrics-collector'] {'owner': 'ams',
'group': 'hadoop', 'create_parents': True, 'mode': 0755, 'cd_access':
'a'}
2019-11-19 14:56:49,658 -
Directory['/var/run/ambari-metrics-collector'] {'owner': 'ams',
'group': 'hadoop', 'create_parents': True, 'mode': 0755, 'cd_access':
'a'}
2019-11-19 14:56:49,659 - File['/usr/lib/ams-hbase/bin/hadoop']
{'owner': 'ams', 'mode': 0755}
2019-11-19 14:56:49,659 - Directory['/etc/security/limits.d']
{'owner': 'root', 'create_parents': True, 'group': 'root'}
2019-11-19 14:56:49,661 - File['/etc/security/limits.d/ams.conf']
{'content': Template('ams.conf.j2'), 'owner': 'root', 'group': 'root',
'mode': 0644}
2019-11-19 14:56:49,666 -
Directory['/usr/lib/ambari-logsearch-logfeeder/conf']
{'create_parents': True, 'mode': 0755, 'cd_access': 'a'}
2019-11-19 14:56:49,685 - Generate Log Feeder config file:
/usr/lib/ambari-logsearch-logfeeder/conf/input.config-ambari-metrics.json
2019-11-19 14:56:49,685 -
File['/usr/lib/ambari-logsearch-logfeeder/conf/input.config-ambari-metrics.json']
{'content': Template('input.config-ambari-metrics.json.j2'), 'mode':
0644}
2019-11-19 14:56:49,687 -
Execute['/usr/lib/ams-hbase/bin/hbase-daemon.sh --config
/etc/ams-hbase/conf stop regionserver'] {'on_timeout': 'ls
/var/run/ambari-metrics-collector//hbase-ams-regionserver.pid
>/dev/null 2>&1 && ps `cat
/var/run/ambari-metrics-collector//hbase-ams-regionserver.pid`
>/dev/null 2>&1 && ambari-sudo.sh -H -E kill -9 `ambari-sudo.sh cat
/var/run/ambari-metrics-collector//hbase-ams-regionserver.pid`',
'timeout': 30, 'user': 'ams'}
2019-11-19 14:56:49,739 -
File['/var/run/ambari-metrics-collector//hbase-ams-regionserver.pid']
{'action': ['delete']}
2019-11-19 14:56:49,740 - Execute['/usr/sbin/ambari-metrics-collector
--config /etc/ambari-metrics-collector/conf stop'] {'user': 'ams'}
2019-11-19 14:56:54,834 - Execute['ambari-sudo.sh rm -rf
/var/lib/ambari-metrics-collector/hbase-tmp/*.tmp'] {}
2019-11-19 14:56:54,845 -
File['/etc/ambari-metrics-collector/conf/core-site.xml'] {'owner':
'ams', 'action': ['delete']}
2019-11-19 14:56:54,845 -
File['/etc/ambari-metrics-collector/conf/hdfs-site.xml'] {'owner':
'ams', 'action': ['delete']}
2019-11-19 14:56:54,846 - Execute['/usr/sbin/ambari-metrics-collector
--config /etc/ambari-metrics-collector/conf start'] {'user': 'ams'}
2019-11-19 15:02:19,965 - Skipping stack-select on AMBARI_METRICS
because it does not exist in the stack-select package structure.

Command failed after 1 tries

avatar
Expert Contributor

@Manoj690 

 

Try below 2 options -

 

1. Check if "/var/run/ambari-metrics-collector/" directory exist and is with permission ams:hadoop

If YES. Then go for option2.

If Not try creating directory and check if AMS startup works.

2. Delete AMS service and its components from CLI also -

rpm -qa|grep ams

-Remove all components of ams

And reinstall AMS.

 

Let me know if that works.

Also please share new logs in text file attach. Its easy way of formatting logs to be displayed at remote end.

avatar
Contributor
How to uninstall and reinstall AMS, can you tell me steps

avatar
Contributor

Hbase is starting successfully but in ambari still shows stopped.