Cloudera Community

Support Questions

Find answers, ask questions, and share your expertise
cancel
Turn on suggestions
Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.
Showing results for 
Show  only  | Search instead for 
Did you mean: 
Advanced Search
Announcements
Celebrating as our community reaches 100,000 members! Thank you!
Solved Go to solution

ambari metrics not working

Labels:
avatar
author-rank Manoj690
Contributor

Created on ‎11-18-2019 11:07 PM - last edited on ‎11-19-2019 12:08 AM by Community Manager Community Manager

stderr:   /var/lib/ambari-agent/data/errors-2079.txt

/Traceback (most recent call last):
  File "/usr/lib/ambari-agent/lib/resource_management/libraries/script/script.py", line 995, in restart
    self.status(env)
  File "/var/lib/ambari-agent/cache/stacks/HDP/3.0/services/AMBARI_METRICS/package/scripts/metrics_collector.py", line 63, in status
    check_service_status(env, name='collector')
  File "/usr/lib/ambari-agent/lib/ambari_commons/os_family_impl.py", line 89, in thunk
    return fn(*args, **kwargs)
  File "/var/lib/ambari-agent/cache/stacks/HDP/3.0/services/AMBARI_METRICS/package/scripts/status.py", line 41, in check_service_status
    check_process_status(pid_file)
  File "/usr/lib/ambari-agent/lib/resource_management/libraries/functions/check_process_status.py", line 43, in check_process_status
    raise ComponentIsNotRunning()
ComponentIsNotRunning

The above exception was the cause of the following exception:

Traceback (most recent call last):
  File "/var/lib/ambari-agent/cache/stacks/HDP/3.0/services/AMBARI_METRICS/package/scripts/metrics_collector.py", line 90, in <module>
    AmsCollector().execute()
  File "/usr/lib/ambari-agent/lib/resource_management/libraries/script/script.py", line 352, in execute
    method(env)
  File "/usr/lib/ambari-agent/lib/resource_management/libraries/script/script.py", line 1012, in restart
    self.post_start(env)
  File "/usr/lib/ambari-agent/lib/resource_management/libraries/script/script.py", line 424, in post_start
    raise Fail("Pid file {0} doesn't exist after starting of the component.".format(pid_file))
resource_management.core.exceptions.Fail: Pid file /var/run/ambari-metrics-collector//hbase-ams-master.pid doesn't exist after starting of the component./ 

 

4,747 Views
0 Kudos
1 ACCEPTED SOLUTION

avatar
author-rank sagarshimpi
Expert Contributor

Created ‎11-19-2019 02:18 AM

@Manoj690 

 

Try below 2 options -

 

1. Check if "/var/run/ambari-metrics-collector/" directory exist and is with permission ams:hadoop

If YES. Then go for option2.

If Not try creating directory and check if AMS startup works.

2. Delete AMS service and its components from CLI also -

rpm -qa|grep ams

-Remove all components of ams

And reinstall AMS.

 

Let me know if that works.

Also please share new logs in text file attach. Its easy way of formatting logs to be displayed at remote end.

View solution in original post

4,710 Views
7 REPLIES 7

avatar
author-rank sagarshimpi
Expert Contributor

Created ‎11-18-2019 11:11 PM

Hi @Manoj690 

 

Did the earlier community link helped to resolve issue - https://community.cloudera.com/t5/Support-Questions/Ambari-metircs-not-started/m-p/283228#M210525   ??

 

Please confirm!!

4,741 Views
0 Kudos

avatar
author-rank Manoj690
Contributor

Created ‎11-18-2019 11:39 PM

No its not resolved and also one more question how to completely uninstall
Phoenix in my system and reinstall?
4,732 Views
0 Kudos

avatar
author-rank sagarshimpi
Expert Contributor

Created ‎11-19-2019 12:04 AM

@Manoj690 

 

1. What is the error you are getting after following the link - https://community.cloudera.com/t5/Support-Questions/Ambari-metircs-not-started/m-p/283228#M210525%C2...

 

The error you pasted are you getting it while starting AMS via Ambari?

Did you tried to start from CLI/backend using command "ambari-metrics-collector  start"?  Make sure you stop the service properly, kill if any pid exist and then start.

 

2. For phoenix - I see phoenix comes as part of hbase and is enabled or disabled from hbase configs as shown below.

img22.PNG

Its basically comes as part of hdp bits located in -
/usr/hdp/current/phoenix-client

/usr/hdp/current/phoenix-server


Why do you want to completely uninstall phoenix ? Can you pass details so that we can help to understand and provide you if any workaround.

 

 

4,726 Views
0 Kudos

avatar
author-rank Manoj690
Contributor

Created ‎11-19-2019 01:35 AM

ambari metrics still shows same error


stderr:
Traceback (most recent call last):
File "/var/lib/ambari-agent/cache/stacks/HDP/3.0/services/AMBARI_METRICS/package/scripts/metrics_collector.py",
line 90, in
AmsCollector().execute()
File "/usr/lib/ambari-agent/lib/resource_management/libraries/script/script.py",
line 355, in execute
self.execute_prefix_function(self.command_name, 'post', env)
File "/usr/lib/ambari-agent/lib/resource_management/libraries/script/script.py",
line 382, in execute_prefix_function
method(env)
File "/usr/lib/ambari-agent/lib/resource_management/libraries/script/script.py",
line 424, in post_start
raise Fail("Pid file {0} doesn't exist after starting of the
component.".format(pid_file))
resource_management.core.exceptions.Fail: Pid file
/var/run/ambari-metrics-collector//hbase-ams-master.pid doesn't exist
after starting of the component.
stdout:
2019-11-19 14:56:48,719 - Stack Feature Version Info: Cluster
Stack=3.1, Command Stack=None, Command Version=3.1.0.0-78 ->
3.1.0.0-78
2019-11-19 14:56:48,735 - Using hadoop conf dir: /usr/hdp/3.1.0.0-78/hadoop/conf
2019-11-19 14:56:48,920 - Stack Feature Version Info: Cluster
Stack=3.1, Command Stack=None, Command Version=3.1.0.0-78 ->
3.1.0.0-78
2019-11-19 14:56:48,926 - Using hadoop conf dir: /usr/hdp/3.1.0.0-78/hadoop/conf
2019-11-19 14:56:48,927 - Group['hdfs'] {}
2019-11-19 14:56:48,927 - Group['hadoop'] {}
2019-11-19 14:56:48,928 - Group['users'] {}
2019-11-19 14:56:48,928 - User['yarn-ats'] {'gid': 'hadoop',
'fetch_nonlocal_groups': True, 'groups': ['hadoop'], 'uid': None}
2019-11-19 14:56:48,929 - User['hive'] {'gid': 'hadoop',
'fetch_nonlocal_groups': True, 'groups': ['hadoop'], 'uid': None}
2019-11-19 14:56:48,930 - User['storm'] {'gid': 'hadoop',
'fetch_nonlocal_groups': True, 'groups': ['hadoop'], 'uid': None}
2019-11-19 14:56:48,931 - User['zookeeper'] {'gid': 'hadoop',
'fetch_nonlocal_groups': True, 'groups': ['hadoop'], 'uid': None}
2019-11-19 14:56:48,931 - User['oozie'] {'gid': 'hadoop',
'fetch_nonlocal_groups': True, 'groups': ['hadoop', 'users'], 'uid':
None}
2019-11-19 14:56:48,932 - User['atlas'] {'gid': 'hadoop',
'fetch_nonlocal_groups': True, 'groups': ['hadoop'], 'uid': None}
2019-11-19 14:56:48,933 - User['ams'] {'gid': 'hadoop',
'fetch_nonlocal_groups': True, 'groups': ['hadoop'], 'uid': None}
2019-11-19 14:56:48,933 - User['tez'] {'gid': 'hadoop',
'fetch_nonlocal_groups': True, 'groups': ['hadoop', 'users'], 'uid':
None}
2019-11-19 14:56:48,934 - User['ambari-qa'] {'gid': 'hadoop',
'fetch_nonlocal_groups': True, 'groups': ['hadoop', 'users'], 'uid':
None}
2019-11-19 14:56:48,935 - User['kafka'] {'gid': 'hadoop',
'fetch_nonlocal_groups': True, 'groups': ['hadoop'], 'uid': None}
2019-11-19 14:56:48,936 - User['hdfs'] {'gid': 'hadoop',
'fetch_nonlocal_groups': True, 'groups': ['hdfs', 'hadoop'], 'uid':
None}
2019-11-19 14:56:48,936 - User['yarn'] {'gid': 'hadoop',
'fetch_nonlocal_groups': True, 'groups': ['hadoop'], 'uid': None}
2019-11-19 14:56:48,937 - User['mapred'] {'gid': 'hadoop',
'fetch_nonlocal_groups': True, 'groups': ['hadoop'], 'uid': None}
2019-11-19 14:56:48,938 - User['hbase'] {'gid': 'hadoop',
'fetch_nonlocal_groups': True, 'groups': ['hadoop'], 'uid': None}
2019-11-19 14:56:48,938 -
File['/var/lib/ambari-agent/tmp/changeUid.sh'] {'content':
StaticFile('changeToSecureUid.sh'), 'mode': 0555}
2019-11-19 14:56:48,939 -
Execute['/var/lib/ambari-agent/tmp/changeUid.sh ambari-qa
/tmp/hadoop-ambari-qa,/tmp/hsperfdata_ambari-qa,/home/ambari-qa,/tmp/ambari-qa,/tmp/sqoop-ambari-qa
0'] {'not_if': '(test $(id -u ambari-qa) -gt 1000) || (false)'}
2019-11-19 14:56:48,945 - Skipping
Execute['/var/lib/ambari-agent/tmp/changeUid.sh ambari-qa
/tmp/hadoop-ambari-qa,/tmp/hsperfdata_ambari-qa,/home/ambari-qa,/tmp/ambari-qa,/tmp/sqoop-ambari-qa
0'] due to not_if
2019-11-19 14:56:48,945 - Directory['/tmp/hbase-hbase'] {'owner':
'hbase', 'create_parents': True, 'mode': 0775, 'cd_access': 'a'}
2019-11-19 14:56:48,947 -
File['/var/lib/ambari-agent/tmp/changeUid.sh'] {'content':
StaticFile('changeToSecureUid.sh'), 'mode': 0555}
2019-11-19 14:56:48,947 -
File['/var/lib/ambari-agent/tmp/changeUid.sh'] {'content':
StaticFile('changeToSecureUid.sh'), 'mode': 0555}
2019-11-19 14:56:48,948 - call['/var/lib/ambari-agent/tmp/changeUid.sh
hbase'] {}
2019-11-19 14:56:48,956 - call returned (0, '1015')
2019-11-19 14:56:48,957 -
Execute['/var/lib/ambari-agent/tmp/changeUid.sh hbase
/home/hbase,/tmp/hbase,/usr/bin/hbase,/var/log/hbase,/tmp/hbase-hbase
1015'] {'not_if': '(test $(id -u hbase) -gt 1000) || (false)'}
2019-11-19 14:56:48,963 - Skipping
Execute['/var/lib/ambari-agent/tmp/changeUid.sh hbase
/home/hbase,/tmp/hbase,/usr/bin/hbase,/var/log/hbase,/tmp/hbase-hbase
1015'] due to not_if
2019-11-19 14:56:48,963 - Group['hdfs'] {}
2019-11-19 14:56:48,964 - User['hdfs'] {'fetch_nonlocal_groups': True,
'groups': ['hdfs', 'hadoop', u'hdfs']}
2019-11-19 14:56:48,964 - FS Type: HDFS
2019-11-19 14:56:48,965 - Directory['/etc/hadoop'] {'mode': 0755}
2019-11-19 14:56:48,982 -
File['/usr/hdp/3.1.0.0-78/hadoop/conf/hadoop-env.sh'] {'content':
InlineTemplate(...), 'owner': 'hdfs', 'group': 'hadoop'}
2019-11-19 14:56:48,983 - Writing
File['/usr/hdp/3.1.0.0-78/hadoop/conf/hadoop-env.sh'] because contents
don't match
2019-11-19 14:56:48,983 -
Directory['/var/lib/ambari-agent/tmp/hadoop_java_io_tmpdir'] {'owner':
'hdfs', 'group': 'hadoop', 'mode': 01777}
2019-11-19 14:56:49,003 - Execute[('setenforce', '0')] {'not_if': '(!
which getenforce ) || (which getenforce && getenforce | grep -q
Disabled)', 'sudo': True, 'only_if': 'test -f /selinux/enforce'}
2019-11-19 14:56:49,008 - Skipping Execute[('setenforce', '0')] due to not_if
2019-11-19 14:56:49,008 - Directory['/var/log/hadoop'] {'owner':
'root', 'create_parents': True, 'group': 'hadoop', 'mode': 0775,
'cd_access': 'a'}
2019-11-19 14:56:49,010 - Directory['/var/run/hadoop'] {'owner':
'root', 'create_parents': True, 'group': 'root', 'cd_access': 'a'}
2019-11-19 14:56:49,010 - Directory['/var/run/hadoop/hdfs'] {'owner':
'hdfs', 'cd_access': 'a'}
2019-11-19 14:56:49,011 - Directory['/tmp/hadoop-hdfs'] {'owner':
'hdfs', 'create_parents': True, 'cd_access': 'a'}
2019-11-19 14:56:49,014 -
File['/usr/hdp/3.1.0.0-78/hadoop/conf/commons-logging.properties']
{'content': Template('commons-logging.properties.j2'), 'owner':
'hdfs'}
2019-11-19 14:56:49,016 -
File['/usr/hdp/3.1.0.0-78/hadoop/conf/health_check'] {'content':
Template('health_check.j2'), 'owner': 'hdfs'}
2019-11-19 14:56:49,023 -
File['/usr/hdp/3.1.0.0-78/hadoop/conf/log4j.properties'] {'content':
InlineTemplate(...), 'owner': 'hdfs', 'group': 'hadoop', 'mode': 0644}
2019-11-19 14:56:49,031 -
File['/usr/hdp/3.1.0.0-78/hadoop/conf/hadoop-metrics2.properties']
{'content': InlineTemplate(...), 'owner': 'hdfs', 'group': 'hadoop'}
2019-11-19 14:56:49,032 -
File['/usr/hdp/3.1.0.0-78/hadoop/conf/task-log4j.properties']
{'content': StaticFile('task-log4j.properties'), 'mode': 0755}
2019-11-19 14:56:49,032 -
File['/usr/hdp/3.1.0.0-78/hadoop/conf/configuration.xsl'] {'owner':
'hdfs', 'group': 'hadoop'}
2019-11-19 14:56:49,036 -
File['/etc/hadoop/conf/topology_mappings.data'] {'owner': 'hdfs',
'content': Template('topology_mappings.data.j2'), 'only_if': 'test -d
/etc/hadoop/conf', 'group': 'hadoop', 'mode': 0644}
2019-11-19 14:56:49,040 - File['/etc/hadoop/conf/topology_script.py']
{'content': StaticFile('topology_script.py'), 'only_if': 'test -d
/etc/hadoop/conf', 'mode': 0755}
2019-11-19 14:56:49,043 - Skipping unlimited key JCE policy check and
setup since it is not required
2019-11-19 14:56:49,050 - Skipping stack-select on AMBARI_METRICS
because it does not exist in the stack-select package structure.
2019-11-19 14:56:49,291 - Using hadoop conf dir: /usr/hdp/3.1.0.0-78/hadoop/conf
2019-11-19 14:56:49,293 - checked_call['hostid'] {}
2019-11-19 14:56:49,296 - checked_call returned (0, 'a8c02018')
2019-11-19 14:56:49,298 - Directory['/etc/ams-hbase/conf'] {'owner':
'ams', 'group': 'hadoop', 'create_parents': True,
'recursive_ownership': True}
2019-11-19 14:56:49,299 -
Directory['/var/lib/ambari-metrics-collector/hbase-tmp'] {'owner':
'ams', 'create_parents': True, 'recursive_ownership': True,
'cd_access': 'a'}
2019-11-19 14:56:49,315 -
Directory['/var/lib/ambari-metrics-collector/hbase-tmp/local/jars']
{'owner': 'ams', 'group': 'hadoop', 'create_parents': True, 'mode':
0775, 'cd_access': 'a'}
2019-11-19 14:56:49,316 - File['/etc/ams-hbase/conf/core-site.xml']
{'owner': 'ams', 'action': ['delete']}
2019-11-19 14:56:49,316 - File['/etc/ams-hbase/conf/hdfs-site.xml']
{'owner': 'ams', 'action': ['delete']}
2019-11-19 14:56:49,316 - XmlConfig['hbase-site.xml'] {'owner': 'ams',
'group': 'hadoop', 'conf_dir': '/etc/ams-hbase/conf',
'configuration_attributes': {u'final': {u'hbase.zookeeper.quorum':
u'true'}}, 'configurations': ...}
2019-11-19 14:56:49,325 - Generating config: /etc/ams-hbase/conf/hbase-site.xml
2019-11-19 14:56:49,325 - File['/etc/ams-hbase/conf/hbase-site.xml']
{'owner': 'ams', 'content': InlineTemplate(...), 'group': 'hadoop',
'mode': None, 'encoding': 'UTF-8'}
2019-11-19 14:56:49,355 - XmlConfig['hbase-policy.xml'] {'owner':
'ams', 'group': 'hadoop', 'conf_dir': '/etc/ams-hbase/conf',
'configuration_attributes': {}, 'configurations':
{u'security.admin.protocol.acl': u'*',
u'security.masterregion.protocol.acl': u'*',
u'security.client.protocol.acl': u'*'}}
2019-11-19 14:56:49,362 - Generating config:
/etc/ams-hbase/conf/hbase-policy.xml
2019-11-19 14:56:49,362 - File['/etc/ams-hbase/conf/hbase-policy.xml']
{'owner': 'ams', 'content': InlineTemplate(...), 'group': 'hadoop',
'mode': None, 'encoding': 'UTF-8'}
2019-11-19 14:56:49,371 - File['/etc/ams-hbase/conf/hbase-env.sh']
{'content': InlineTemplate(...), 'owner': 'ams'}
2019-11-19 14:56:49,376 -
File['/etc/ams-hbase/conf/hadoop-metrics2-hbase.properties']
{'content': Template('hadoop-metrics2-hbase.properties.j2'), 'owner':
'ams', 'group': 'hadoop'}
2019-11-19 14:56:49,376 -
TemplateConfig['/etc/ams-hbase/conf/regionservers'] {'owner': 'ams',
'template_tag': None}
2019-11-19 14:56:49,378 - File['/etc/ams-hbase/conf/regionservers']
{'content': Template('regionservers.j2'), 'owner': 'ams', 'group':
None, 'mode': None}
2019-11-19 14:56:49,378 -
Directory['/var/run/ambari-metrics-collector/'] {'owner': 'ams',
'create_parents': True, 'mode': 0755, 'cd_access': 'a'}
2019-11-19 14:56:49,379 -
Directory['/var/log/ambari-metrics-collector'] {'owner': 'ams',
'create_parents': True, 'mode': 0755, 'cd_access': 'a'}
2019-11-19 14:56:49,379 -
Directory['/var/lib/ambari-metrics-collector/hbase'] {'owner': 'ams',
'create_parents': True, 'recursive_ownership': True, 'cd_access': 'a'}
2019-11-19 14:56:49,415 -
File['/var/run/ambari-metrics-collector//distributed_mode'] {'owner':
'ams', 'action': ['delete']}
2019-11-19 14:56:49,418 - File['/etc/ams-hbase/conf/log4j.properties']
{'content': InlineTemplate(...), 'owner': 'ams', 'group': 'hadoop',
'mode': 0644}
2019-11-19 14:56:49,423 -
Directory['/usr/lib/ambari-logsearch-logfeeder/conf']
{'create_parents': True, 'mode': 0755, 'cd_access': 'a'}
2019-11-19 14:56:49,423 - Generate Log Feeder config file:
/usr/lib/ambari-logsearch-logfeeder/conf/input.config-ambari-metrics.json
2019-11-19 14:56:49,424 -
File['/usr/lib/ambari-logsearch-logfeeder/conf/input.config-ambari-metrics.json']
{'content': Template('input.config-ambari-metrics.json.j2'), 'mode':
0644}
2019-11-19 14:56:49,424 - Directory['/etc/ams-hbase/conf'] {'owner':
'ams', 'group': 'hadoop', 'create_parents': True,
'recursive_ownership': True}
2019-11-19 14:56:49,425 -
Directory['/var/lib/ambari-metrics-collector/hbase-tmp'] {'owner':
'ams', 'create_parents': True, 'recursive_ownership': True,
'cd_access': 'a'}
2019-11-19 14:56:49,442 -
Directory['/var/lib/ambari-metrics-collector/hbase-tmp/local/jars']
{'owner': 'ams', 'group': 'hadoop', 'create_parents': True, 'mode':
0775, 'cd_access': 'a'}
2019-11-19 14:56:49,443 - File['/etc/ams-hbase/conf/core-site.xml']
{'owner': 'ams', 'action': ['delete']}
2019-11-19 14:56:49,444 - File['/etc/ams-hbase/conf/hdfs-site.xml']
{'owner': 'ams', 'action': ['delete']}
2019-11-19 14:56:49,444 - XmlConfig['hbase-site.xml'] {'owner': 'ams',
'group': 'hadoop', 'conf_dir': '/etc/ams-hbase/conf',
'configuration_attributes': {u'final': {u'hbase.zookeeper.quorum':
u'true'}}, 'configurations': ...}
2019-11-19 14:56:49,451 - Generating config: /etc/ams-hbase/conf/hbase-site.xml
2019-11-19 14:56:49,452 - File['/etc/ams-hbase/conf/hbase-site.xml']
{'owner': 'ams', 'content': InlineTemplate(...), 'group': 'hadoop',
'mode': None, 'encoding': 'UTF-8'}
2019-11-19 14:56:49,482 - XmlConfig['hbase-policy.xml'] {'owner':
'ams', 'group': 'hadoop', 'conf_dir': '/etc/ams-hbase/conf',
'configuration_attributes': {}, 'configurations':
{u'security.admin.protocol.acl': u'*',
u'security.masterregion.protocol.acl': u'*',
u'security.client.protocol.acl': u'*'}}
2019-11-19 14:56:49,489 - Generating config:
/etc/ams-hbase/conf/hbase-policy.xml
2019-11-19 14:56:49,489 - File['/etc/ams-hbase/conf/hbase-policy.xml']
{'owner': 'ams', 'content': InlineTemplate(...), 'group': 'hadoop',
'mode': None, 'encoding': 'UTF-8'}
2019-11-19 14:56:49,498 - File['/etc/ams-hbase/conf/hbase-env.sh']
{'content': InlineTemplate(...), 'owner': 'ams'}
2019-11-19 14:56:49,502 -
File['/etc/ams-hbase/conf/hadoop-metrics2-hbase.properties']
{'content': Template('hadoop-metrics2-hbase.properties.j2'), 'owner':
'ams', 'group': 'hadoop'}
2019-11-19 14:56:49,503 -
TemplateConfig['/etc/ams-hbase/conf/regionservers'] {'owner': 'ams',
'template_tag': None}
2019-11-19 14:56:49,504 - File['/etc/ams-hbase/conf/regionservers']
{'content': Template('regionservers.j2'), 'owner': 'ams', 'group':
None, 'mode': None}
2019-11-19 14:56:49,505 -
Directory['/var/run/ambari-metrics-collector/'] {'owner': 'ams',
'create_parents': True, 'mode': 0755, 'cd_access': 'a'}
2019-11-19 14:56:49,505 -
Directory['/var/log/ambari-metrics-collector'] {'owner': 'ams',
'create_parents': True, 'mode': 0755, 'cd_access': 'a'}
2019-11-19 14:56:49,508 - File['/etc/ams-hbase/conf/log4j.properties']
{'content': InlineTemplate(...), 'owner': 'ams', 'group': 'hadoop',
'mode': 0644}
2019-11-19 14:56:49,513 -
Directory['/usr/lib/ambari-logsearch-logfeeder/conf']
{'create_parents': True, 'mode': 0755, 'cd_access': 'a'}
2019-11-19 14:56:49,513 - Generate Log Feeder config file:
/usr/lib/ambari-logsearch-logfeeder/conf/input.config-ambari-metrics.json
2019-11-19 14:56:49,513 -
File['/usr/lib/ambari-logsearch-logfeeder/conf/input.config-ambari-metrics.json']
{'content': Template('input.config-ambari-metrics.json.j2'), 'mode':
0644}
2019-11-19 14:56:49,514 -
Directory['/etc/ambari-metrics-collector/conf'] {'owner': 'ams',
'group': 'hadoop', 'create_parents': True, 'recursive_ownership':
True}
2019-11-19 14:56:49,515 -
Directory['/var/lib/ambari-metrics-collector/checkpoint'] {'owner':
'ams', 'group': 'hadoop', 'create_parents': True,
'recursive_ownership': True, 'cd_access': 'a'}
2019-11-19 14:56:49,516 - XmlConfig['ams-site.xml'] {'owner': 'ams',
'group': 'hadoop', 'conf_dir': '/etc/ambari-metrics-collector/conf',
'configuration_attributes': {}, 'configurations': ...}
2019-11-19 14:56:49,523 - Generating config:
/etc/ambari-metrics-collector/conf/ams-site.xml
2019-11-19 14:56:49,523 -
File['/etc/ambari-metrics-collector/conf/ams-site.xml'] {'owner':
'ams', 'content': InlineTemplate(...), 'group': 'hadoop', 'mode':
None, 'encoding': 'UTF-8'}
2019-11-19 14:56:49,569 - XmlConfig['ssl-server.xml'] {'owner': 'ams',
'group': 'hadoop', 'conf_dir': '/etc/ambari-metrics-collector/conf',
'configuration_attributes': {}, 'configurations': ...}
2019-11-19 14:56:49,577 - Generating config:
/etc/ambari-metrics-collector/conf/ssl-server.xml
2019-11-19 14:56:49,578 -
File['/etc/ambari-metrics-collector/conf/ssl-server.xml'] {'owner':
'ams', 'content': InlineTemplate(...), 'group': 'hadoop', 'mode':
None, 'encoding': 'UTF-8'}
2019-11-19 14:56:49,583 - XmlConfig['hbase-site.xml'] {'owner': 'ams',
'group': 'hadoop', 'conf_dir': '/etc/ambari-metrics-collector/conf',
'configuration_attributes': {u'final': {u'hbase.zookeeper.quorum':
u'true'}}, 'configurations': ...}
2019-11-19 14:56:49,590 - Generating config:
/etc/ambari-metrics-collector/conf/hbase-site.xml
2019-11-19 14:56:49,590 -
File['/etc/ambari-metrics-collector/conf/hbase-site.xml'] {'owner':
'ams', 'content': InlineTemplate(...), 'group': 'hadoop', 'mode':
None, 'encoding': 'UTF-8'}
2019-11-19 14:56:49,623 -
File['/etc/ambari-metrics-collector/conf/log4j.properties']
{'content': InlineTemplate(...), 'owner': 'ams', 'group': 'hadoop',
'mode': 0644}
2019-11-19 14:56:49,626 -
File['/etc/ambari-metrics-collector/conf/ams-env.sh'] {'content':
InlineTemplate(...), 'owner': 'ams'}
2019-11-19 14:56:49,627 -
Directory['/var/log/ambari-metrics-collector'] {'owner': 'ams',
'group': 'hadoop', 'create_parents': True, 'mode': 0755, 'cd_access':
'a'}
2019-11-19 14:56:49,658 -
Directory['/var/run/ambari-metrics-collector'] {'owner': 'ams',
'group': 'hadoop', 'create_parents': True, 'mode': 0755, 'cd_access':
'a'}
2019-11-19 14:56:49,659 - File['/usr/lib/ams-hbase/bin/hadoop']
{'owner': 'ams', 'mode': 0755}
2019-11-19 14:56:49,659 - Directory['/etc/security/limits.d']
{'owner': 'root', 'create_parents': True, 'group': 'root'}
2019-11-19 14:56:49,661 - File['/etc/security/limits.d/ams.conf']
{'content': Template('ams.conf.j2'), 'owner': 'root', 'group': 'root',
'mode': 0644}
2019-11-19 14:56:49,666 -
Directory['/usr/lib/ambari-logsearch-logfeeder/conf']
{'create_parents': True, 'mode': 0755, 'cd_access': 'a'}
2019-11-19 14:56:49,685 - Generate Log Feeder config file:
/usr/lib/ambari-logsearch-logfeeder/conf/input.config-ambari-metrics.json
2019-11-19 14:56:49,685 -
File['/usr/lib/ambari-logsearch-logfeeder/conf/input.config-ambari-metrics.json']
{'content': Template('input.config-ambari-metrics.json.j2'), 'mode':
0644}
2019-11-19 14:56:49,687 -
Execute['/usr/lib/ams-hbase/bin/hbase-daemon.sh --config
/etc/ams-hbase/conf stop regionserver'] {'on_timeout': 'ls
/var/run/ambari-metrics-collector//hbase-ams-regionserver.pid
>/dev/null 2>&1 && ps `cat
/var/run/ambari-metrics-collector//hbase-ams-regionserver.pid`
>/dev/null 2>&1 && ambari-sudo.sh -H -E kill -9 `ambari-sudo.sh cat
/var/run/ambari-metrics-collector//hbase-ams-regionserver.pid`',
'timeout': 30, 'user': 'ams'}
2019-11-19 14:56:49,739 -
File['/var/run/ambari-metrics-collector//hbase-ams-regionserver.pid']
{'action': ['delete']}
2019-11-19 14:56:49,740 - Execute['/usr/sbin/ambari-metrics-collector
--config /etc/ambari-metrics-collector/conf stop'] {'user': 'ams'}
2019-11-19 14:56:54,834 - Execute['ambari-sudo.sh rm -rf
/var/lib/ambari-metrics-collector/hbase-tmp/*.tmp'] {}
2019-11-19 14:56:54,845 -
File['/etc/ambari-metrics-collector/conf/core-site.xml'] {'owner':
'ams', 'action': ['delete']}
2019-11-19 14:56:54,845 -
File['/etc/ambari-metrics-collector/conf/hdfs-site.xml'] {'owner':
'ams', 'action': ['delete']}
2019-11-19 14:56:54,846 - Execute['/usr/sbin/ambari-metrics-collector
--config /etc/ambari-metrics-collector/conf start'] {'user': 'ams'}
2019-11-19 15:02:19,965 - Skipping stack-select on AMBARI_METRICS
because it does not exist in the stack-select package structure.

Command failed after 1 tries
4,713 Views
0 Kudos

avatar
author-rank sagarshimpi
Expert Contributor

Created ‎11-19-2019 02:18 AM

@Manoj690 

 

Try below 2 options -

 

1. Check if "/var/run/ambari-metrics-collector/" directory exist and is with permission ams:hadoop

If YES. Then go for option2.

If Not try creating directory and check if AMS startup works.

2. Delete AMS service and its components from CLI also -

rpm -qa|grep ams

-Remove all components of ams

And reinstall AMS.

 

Let me know if that works.

Also please share new logs in text file attach. Its easy way of formatting logs to be displayed at remote end.

4,711 Views

avatar
author-rank Manoj690
Contributor

Created ‎11-19-2019 02:23 AM

How to uninstall and reinstall AMS, can you tell me steps
4,709 Views
0 Kudos

avatar
author-rank Manoj690
Contributor

Created ‎11-19-2019 02:54 AM

Hbase is starting successfully but in ambari still shows stopped.

4,702 Views
0 Kudos
webinar banner
Announcements
Product Announcements
[ANNOUNCE] Cloudera on Public Cloud Runtime 7.2.18 is GA!
What's New @ Cloudera
Cloudera Operational Database (COD) supports enhancements to...
Community Announcements
March 2024 Community Highlights
Community Announcements
Celebrating 100,000 Members: A Journey of Growth and Connect...
Product Announcements
[ANNOUNCE] New Cloudera JDBC Connector for Apache Hive 2.6.2...
View More Announcements
meetups banner