Support Questions
Find answers, ask questions, and share your expertise

Ambari Metrics Collector not starting on Hortonworks Sandbox HDP 2.5

I have a clean import of the Hortonworks Sandbox for HDP 2.5. When I attempt to to start the Metrics Collector I get the following error:

Traceback (most recent call last):
  File "/var/lib/ambari-agent/cache/common-services/AMBARI_METRICS/0.1.0/package/scripts/metrics_collector.py", line 148, in <module>
    AmsCollector().execute()
  File "/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py", line 280, in execute
    method(env)
  File "/var/lib/ambari-agent/cache/common-services/AMBARI_METRICS/0.1.0/package/scripts/metrics_collector.py", line 46, in start
    self.configure(env, action = 'start') # for security
  File "/var/lib/ambari-agent/cache/common-services/AMBARI_METRICS/0.1.0/package/scripts/metrics_collector.py", line 41, in configure
    hbase('master', action)
  File "/usr/lib/python2.6/site-packages/ambari_commons/os_family_impl.py", line 89, in thunk
    return fn(*args, **kwargs)
  File "/var/lib/ambari-agent/cache/common-services/AMBARI_METRICS/0.1.0/package/scripts/hbase.py", line 105, in hbase
    recursive_ownership = True,
  File "/usr/lib/python2.6/site-packages/resource_management/core/base.py", line 155, in __init__
    self.env.run()
  File "/usr/lib/python2.6/site-packages/resource_management/core/environment.py", line 160, in run
    self.run_action(resource, action)
  File "/usr/lib/python2.6/site-packages/resource_management/core/environment.py", line 124, in run_action
    provider_action()
  File "/usr/lib/python2.6/site-packages/resource_management/core/providers/system.py", line 199, in action_create
    recursion_follow_links=self.resource.recursion_follow_links, safemode_folders=self.resource.safemode_folders)
  File "/usr/lib/python2.6/site-packages/resource_management/core/providers/system.py", line 73, in _ensure_metadata
    sudo.chown_recursive(path, _user_entity, _group_entity, recursion_follow_links)
  File "/usr/lib/python2.6/site-packages/resource_management/core/sudo.py", line 53, in chown_recursive
    os.lchown(os.path.join(root, name), uid, gid)
OSError: [Errno 2] No such file or directory: '/var/lib/ambari-metrics-collector/hbase-tmp/Jetty_0_0_0_0_61310_master____36m3iw/.active'

Is this a known issue?

8 REPLIES 8

Re: Ambari Metrics Collector not starting on Hortonworks Sandbox HDP 2.5

Expert Contributor

Hi Michael,

Can you try deleting the contents of "/var/lib/ambari-metrics-collector/" and retrying?

Re: Ambari Metrics Collector not starting on Hortonworks Sandbox HDP 2.5

I connected to the docker instance running on the sandbox. Here is what I see:

[root@sandbox ambari-metrics-collector]# ls -atlr
total 8
drwxr-xr-x 1 root root   4096 Sep 15 11:34 ..
drwxr-xr-x 1 root root     51 Sep 15 12:34 .
drwxr-xr-x 1 ams  hadoop 4096 Sep 19 18:51 checkpoint
drwxr-xr-x 1 ams  root     97 Sep 19 18:51 hbase-tmp
drwxr-xr-x 1 ams  root    109 Sep 19 18:51 hbase

When I try to delete everything here, I see the following:

[root@sandbox ambari-metrics-collector]# rm -rf *
rm: cannot remove `checkpoint': Directory not empty
rm: cannot remove `hbase/.tmp/data': Directory not empty
rm: cannot remove `hbase/MasterProcWALs': Directory not empty
rm: cannot remove `hbase/WALs': Directory not empty
rm: cannot remove `hbase/data/default/CONTAINER_METRICS/.tabledesc': Directory not empty
rm: cannot remove `hbase/data/default/CONTAINER_METRICS/61b906a9604de438b14ad773b0726295/recovered.edits': Directory not empty
rm: cannot remove `hbase/data/default/HOSTED_APPS_METADATA/.tabledesc': Directory not empty
rm: cannot remove `hbase/data/default/HOSTED_APPS_METADATA/9167374b809c0ae903e6d8867bf2c796/0': Directory not empty
rm: cannot remove `hbase/data/default/HOSTED_APPS_METADATA/9167374b809c0ae903e6d8867bf2c796/recovered.edits': Directory not empty
rm: cannot remove `hbase/data/default/METRICS_METADATA/.tabledesc': Directory not empty
rm: cannot remove `hbase/data/default/METRICS_METADATA/b9c89b14de1c813bb21aebcaa55ca5c1/0': Directory not empty
rm: cannot remove `hbase/data/default/METRICS_METADATA/b9c89b14de1c813bb21aebcaa55ca5c1/recovered.edits': Directory not empty

Which is odd, as I'm running this as root and forcing the delete with -f.

Re: Ambari Metrics Collector not starting on Hortonworks Sandbox HDP 2.5

New Contributor

I have the same problem with the sandbox.

,

same here. some of the files have ???????? as owner and group

Re: Ambari Metrics Collector not starting on Hortonworks Sandbox HDP 2.5

Expert Contributor

Can you guys change ownership of all files within /var/lib/ambari-metrics-collector to ams:hadoop and retry?

Re: Ambari Metrics Collector not starting on Hortonworks Sandbox HDP 2.5

New Contributor

I am faced with this same issue. Was a solution ever found? Deleting contents of the folder (as suggested in the link) did not work - failed for the same reasons given. Changing ownership on the ambari-metrics-collector files as suggested also did not work.

Re: Ambari Metrics Collector not starting on Hortonworks Sandbox HDP 2.5

Explorer

Hi,

Has anyone found a fix for this? I am noticing same issues

Traceback (most recent call last):
  File "/var/lib/ambari-agent/cache/common-services/AMBARI_METRICS/0.1.0/package/scripts/metrics_collector.py", line 150, in <module>
    AmsCollector().execute()
  File "/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py", line 313, in execute
    method(env)
  File "/var/lib/ambari-agent/cache/common-services/AMBARI_METRICS/0.1.0/package/scripts/metrics_collector.py", line 48, in start
    self.configure(env, action = 'start') # for security
  File "/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py", line 116, in locking_configure
    original_configure(obj, *args, **kw)
  File "/var/lib/ambari-agent/cache/common-services/AMBARI_METRICS/0.1.0/package/scripts/metrics_collector.py", line 43, in configure
    hbase('master', action)
  File "/usr/lib/python2.6/site-packages/ambari_commons/os_family_impl.py", line 89, in thunk
    return fn(*args, **kwargs)
  File "/var/lib/ambari-agent/cache/common-services/AMBARI_METRICS/0.1.0/package/scripts/hbase.py", line 244, in hbase
    recursive_ownership = True
  File "/usr/lib/python2.6/site-packages/resource_management/core/base.py", line 155, in __init__
    self.env.run()
  File "/usr/lib/python2.6/site-packages/resource_management/core/environment.py", line 160, in run
    self.run_action(resource, action)
  File "/usr/lib/python2.6/site-packages/resource_management/core/environment.py", line 124, in run_action
    provider_action()
  File "/usr/lib/python2.6/site-packages/resource_management/core/providers/system.py", line 199, in action_create
    recursion_follow_links=self.resource.recursion_follow_links, safemode_folders=self.resource.safemode_folders)
  File "/usr/lib/python2.6/site-packages/resource_management/core/providers/system.py", line 73, in _ensure_metadata
    sudo.chown_recursive(path, _user_entity, _group_entity, recursion_follow_links)
  File "/usr/lib/python2.6/site-packages/resource_management/core/sudo.py", line 53, in chown_recursive
    os.lchown(os.path.join(root, name), uid, gid)
OSError: [Errno 2] No such file or directory: '/var/lib/ambari-metrics-collector/hbase/data/default/METRIC_RECORD/e71dde671eea1c7b89dc851965d74348/0/9a18f23dada64e92b3455e73376a8fdb'

[root@hdp26clmn 0]# ls -l ls: cannot access 9a18f23dada64e92b3455e73376a8fdb: No such file or directory total 0 ?????????? ? ? ? ? ? 9a18f23dada64e92b3455e73376a8fdb [root@hdp26clmn 0]#pwd /var/lib/ambari-metrics-collector/hbase/data/default/METRIC_RECORD/e71dde671eea1c7b89dc851965d74348/0 [ams@hdp26clmn 0]

Re: Ambari Metrics Collector not starting on Hortonworks Sandbox HDP 2.5

Expert Contributor
2017-05-15 06:12:42,406 - The hadoop conf dir /usr/hdp/current/hadoop-client/conf exists, will call conf-select on it for version 2.5.0.0-1245
2017-05-15 06:12:42,406 - Checking if need to create versioned conf dir /etc/hadoop/2.5.0.0-1245/0
2017-05-15 06:12:42,406 - call[('ambari-python-wrap', '/usr/bin/conf-select', 'create-conf-dir', '--package', 'hadoop', '--stack-version', '2.5.0.0-1245', '--conf-version', '0')] {'logoutput': False, 'sudo': True, 'quiet': False, 'stderr': -1}
2017-05-15 06:12:42,436 - call returned (1, '/etc/hadoop/2.5.0.0-1245/0 exist already', '')
2017-05-15 06:12:42,437 - checked_call[('ambari-python-wrap', '/usr/bin/conf-select', 'set-conf-dir', '--package', 'hadoop', '--stack-version', '2.5.0.0-1245', '--conf-version', '0')] {'logoutput': False, 'sudo': True, 'quiet': False}
2017-05-15 06:12:42,466 - checked_call returned (0, '')
2017-05-15 06:12:42,466 - Ensuring that hadoop has the correct symlink structure
2017-05-15 06:12:42,466 - Using hadoop conf dir: /usr/hdp/current/hadoop-client/conf
2017-05-15 06:12:42,572 - The hadoop conf dir /usr/hdp/current/hadoop-client/conf exists, will call conf-select on it for version 2.5.0.0-1245
2017-05-15 06:12:42,572 - Checking if need to create versioned conf dir /etc/hadoop/2.5.0.0-1245/0
2017-05-15 06:12:42,572 - call[('ambari-python-wrap', '/usr/bin/conf-select', 'create-conf-dir', '--package', 'hadoop', '--stack-version', '2.5.0.0-1245', '--conf-version', '0')] {'logoutput': False, 'sudo': True, 'quiet': False, 'stderr': -1}
2017-05-15 06:12:42,601 - call returned (1, '/etc/hadoop/2.5.0.0-1245/0 exist already', '')
2017-05-15 06:12:42,602 - checked_call[('ambari-python-wrap', '/usr/bin/conf-select', 'set-conf-dir', '--package', 'hadoop', '--stack-version', '2.5.0.0-1245', '--conf-version', '0')] {'logoutput': False, 'sudo': True, 'quiet': False}
2017-05-15 06:12:42,631 - checked_call returned (0, '')
2017-05-15 06:12:42,632 - Ensuring that hadoop has the correct symlink structure
2017-05-15 06:12:42,632 - Using hadoop conf dir: /usr/hdp/current/hadoop-client/conf
2017-05-15 06:12:42,633 - Group['livy'] {}
2017-05-15 06:12:42,635 - Group['spark'] {}
2017-05-15 06:12:42,635 - Group['ranger'] {}
2017-05-15 06:12:42,636 - Group['zeppelin'] {}
2017-05-15 06:12:42,636 - Group['hadoop'] {}
2017-05-15 06:12:42,636 - Group['users'] {}
2017-05-15 06:12:42,636 - Group['knox'] {}
2017-05-15 06:12:42,636 - User['hive'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': ['hadoop']}
2017-05-15 06:12:42,638 - User['storm'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': ['hadoop']}
2017-05-15 06:12:42,639 - User['zookeeper'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': ['hadoop']}
2017-05-15 06:12:42,639 - User['infra-solr'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': ['hadoop']}
2017-05-15 06:12:42,640 - User['oozie'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': ['users']}
2017-05-15 06:12:42,640 - User['atlas'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': ['hadoop']}
2017-05-15 06:12:42,641 - User['ams'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': ['hadoop']}
2017-05-15 06:12:42,641 - User['falcon'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': ['users']}
2017-05-15 06:12:42,642 - User['ranger'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': ['ranger']}
2017-05-15 06:12:42,642 - User['tez'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': ['users']}
2017-05-15 06:12:42,643 - User['zeppelin'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': ['hadoop']}
2017-05-15 06:12:42,643 - User['livy'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': ['hadoop']}
2017-05-15 06:12:42,644 - User['spark'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': ['hadoop']}
2017-05-15 06:12:42,644 - User['ambari-qa'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': ['users']}
2017-05-15 06:12:42,645 - User['flume'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': ['hadoop']}
2017-05-15 06:12:42,645 - User['kafka'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': ['hadoop']}
2017-05-15 06:12:42,646 - User['hdfs'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': ['hadoop']}
2017-05-15 06:12:42,647 - User['sqoop'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': ['hadoop']}
2017-05-15 06:12:42,648 - User['yarn'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': ['hadoop']}
2017-05-15 06:12:42,649 - User['mapred'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': ['hadoop']}
2017-05-15 06:12:42,649 - User['hbase'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': ['hadoop']}
2017-05-15 06:12:42,650 - User['knox'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': ['hadoop']}
2017-05-15 06:12:42,651 - User['hcat'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': ['hadoop']}
2017-05-15 06:12:42,651 - File['/var/lib/ambari-agent/tmp/changeUid.sh'] {'content': StaticFile('changeToSecureUid.sh'), 'mode': 0555}
2017-05-15 06:12:42,654 - Execute['/var/lib/ambari-agent/tmp/changeUid.sh ambari-qa /tmp/hadoop-ambari-qa,/tmp/hsperfdata_ambari-qa,/home/ambari-qa,/tmp/ambari-qa,/tmp/sqoop-ambari-qa'] {'not_if': '(test $(id -u ambari-qa) -gt 1000) || (false)'}
2017-05-15 06:12:42,671 - Skipping Execute['/var/lib/ambari-agent/tmp/changeUid.sh ambari-qa /tmp/hadoop-ambari-qa,/tmp/hsperfdata_ambari-qa,/home/ambari-qa,/tmp/ambari-qa,/tmp/sqoop-ambari-qa'] due to not_if
2017-05-15 06:12:42,671 - Directory['/tmp/hbase-hbase'] {'owner': 'hbase', 'create_parents': True, 'mode': 0775, 'cd_access': 'a'}
2017-05-15 06:12:42,673 - File['/var/lib/ambari-agent/tmp/changeUid.sh'] {'content': StaticFile('changeToSecureUid.sh'), 'mode': 0555}
2017-05-15 06:12:42,674 - Execute['/var/lib/ambari-agent/tmp/changeUid.sh hbase /home/hbase,/tmp/hbase,/usr/bin/hbase,/var/log/hbase,/tmp/hbase-hbase'] {'not_if': '(test $(id -u hbase) -gt 1000) || (false)'}
2017-05-15 06:12:42,686 - Skipping Execute['/var/lib/ambari-agent/tmp/changeUid.sh hbase /home/hbase,/tmp/hbase,/usr/bin/hbase,/var/log/hbase,/tmp/hbase-hbase'] due to not_if
2017-05-15 06:12:42,687 - Group['hdfs'] {}
2017-05-15 06:12:42,687 - User['hdfs'] {'fetch_nonlocal_groups': True, 'groups': ['hadoop', 'hdfs']}
2017-05-15 06:12:42,688 - FS Type: 
2017-05-15 06:12:42,688 - Directory['/etc/hadoop'] {'mode': 0755}
2017-05-15 06:12:42,701 - File['/usr/hdp/current/hadoop-client/conf/hadoop-env.sh'] {'content': InlineTemplate(...), 'owner': 'hdfs', 'group': 'hadoop'}
2017-05-15 06:12:42,702 - Directory['/var/lib/ambari-agent/tmp/hadoop_java_io_tmpdir'] {'owner': 'hdfs', 'group': 'hadoop', 'mode': 01777}
2017-05-15 06:12:42,719 - Execute[('setenforce', '0')] {'not_if': '(! which getenforce ) || (which getenforce && getenforce | grep -q Disabled)', 'sudo': True, 'only_if': 'test -f /selinux/enforce'}
2017-05-15 06:12:42,734 - Skipping Execute[('setenforce', '0')] due to not_if
2017-05-15 06:12:42,735 - Directory['/var/log/hadoop'] {'owner': 'root', 'create_parents': True, 'group': 'hadoop', 'mode': 0775, 'cd_access': 'a'}
2017-05-15 06:12:42,737 - Directory['/var/run/hadoop'] {'owner': 'root', 'create_parents': True, 'group': 'root', 'cd_access': 'a'}
2017-05-15 06:12:42,737 - Directory['/tmp/hadoop-hdfs'] {'owner': 'hdfs', 'create_parents': True, 'cd_access': 'a'}
2017-05-15 06:12:42,745 - File['/usr/hdp/current/hadoop-client/conf/commons-logging.properties'] {'content': Template('commons-logging.properties.j2'), 'owner': 'hdfs'}
2017-05-15 06:12:42,747 - File['/usr/hdp/current/hadoop-client/conf/health_check'] {'content': Template('health_check.j2'), 'owner': 'hdfs'}
2017-05-15 06:12:42,748 - File['/usr/hdp/current/hadoop-client/conf/log4j.properties'] {'content': ..., 'owner': 'hdfs', 'group': 'hadoop', 'mode': 0644}
2017-05-15 06:12:42,759 - File['/usr/hdp/current/hadoop-client/conf/hadoop-metrics2.properties'] {'content': Template('hadoop-metrics2.properties.j2'), 'owner': 'hdfs', 'group': 'hadoop'}
2017-05-15 06:12:42,760 - File['/usr/hdp/current/hadoop-client/conf/task-log4j.properties'] {'content': StaticFile('task-log4j.properties'), 'mode': 0755}
2017-05-15 06:12:42,762 - File['/usr/hdp/current/hadoop-client/conf/configuration.xsl'] {'owner': 'hdfs', 'group': 'hadoop'}
2017-05-15 06:12:42,766 - File['/etc/hadoop/conf/topology_mappings.data'] {'owner': 'hdfs', 'content': Template('topology_mappings.data.j2'), 'only_if': 'test -d /etc/hadoop/conf', 'group': 'hadoop'}
2017-05-15 06:12:42,776 - File['/etc/hadoop/conf/topology_script.py'] {'content': StaticFile('topology_script.py'), 'only_if': 'test -d /etc/hadoop/conf', 'mode': 0755}
2017-05-15 06:12:42,959 - The hadoop conf dir /usr/hdp/current/hadoop-client/conf exists, will call conf-select on it for version 2.5.0.0-1245
2017-05-15 06:12:42,959 - Checking if need to create versioned conf dir /etc/hadoop/2.5.0.0-1245/0
2017-05-15 06:12:42,959 - call[('ambari-python-wrap', '/usr/bin/conf-select', 'create-conf-dir', '--package', 'hadoop', '--stack-version', '2.5.0.0-1245', '--conf-version', '0')] {'logoutput': False, 'sudo': True, 'quiet': False, 'stderr': -1}
2017-05-15 06:12:42,988 - call returned (1, '/etc/hadoop/2.5.0.0-1245/0 exist already', '')
2017-05-15 06:12:42,988 - checked_call[('ambari-python-wrap', '/usr/bin/conf-select', 'set-conf-dir', '--package', 'hadoop', '--stack-version', '2.5.0.0-1245', '--conf-version', '0')] {'logoutput': False, 'sudo': True, 'quiet': False}
2017-05-15 06:12:43,013 - checked_call returned (0, '')
2017-05-15 06:12:43,014 - Ensuring that hadoop has the correct symlink structure
2017-05-15 06:12:43,014 - Using hadoop conf dir: /usr/hdp/current/hadoop-client/conf
2017-05-15 06:12:43,018 - checked_call['hostid'] {}
2017-05-15 06:12:43,029 - checked_call returned (0, '11ac0200')
2017-05-15 06:12:43,031 - Directory['/etc/ams-hbase/conf'] {'owner': 'ams', 'group': 'hadoop', 'create_parents': True, 'recursive_ownership': True}
2017-05-15 06:12:43,036 - Directory['/var/lib/ambari-metrics-collector/hbase-tmp'] {'owner': 'ams', 'create_parents': True, 'recursive_ownership': True, 'cd_access': 'a'}
2017-05-15 06:12:43,043 - Directory['/var/lib/ambari-metrics-collector/hbase-tmp/local/jars'] {'owner': 'ams', 'group': 'hadoop', 'create_parents': True, 'mode': 0775, 'cd_access': 'a'}
2017-05-15 06:12:43,044 - File['/etc/ams-hbase/conf/core-site.xml'] {'owner': 'ams', 'action': ['delete']}
2017-05-15 06:12:43,044 - File['/etc/ams-hbase/conf/hdfs-site.xml'] {'owner': 'ams', 'action': ['delete']}
2017-05-15 06:12:43,044 - XmlConfig['hbase-site.xml'] {'owner': 'ams', 'group': 'hadoop', 'conf_dir': '/etc/ams-hbase/conf', 'configuration_attributes': {'final': {'hbase.zookeeper.quorum': 'true'}, 'hbase.zookeeper.quorum': {'final': 'true'}}, 'configurations': ...}
2017-05-15 06:12:43,056 - Generating config: /etc/ams-hbase/conf/hbase-site.xml
2017-05-15 06:12:43,056 - File['/etc/ams-hbase/conf/hbase-site.xml'] {'owner': 'ams', 'content': InlineTemplate(...), 'group': 'hadoop', 'mode': None, 'encoding': 'UTF-8'}
2017-05-15 06:12:43,084 - XmlConfig['hbase-policy.xml'] {'owner': 'ams', 'group': 'hadoop', 'conf_dir': '/etc/ams-hbase/conf', 'configuration_attributes': {}, 'configurations': {'security.masterregion.protocol.acl': '*', 'security.admin.protocol.acl': '*', 'security.client.protocol.acl': '*'}}
2017-05-15 06:12:43,091 - Generating config: /etc/ams-hbase/conf/hbase-policy.xml
2017-05-15 06:12:43,091 - File['/etc/ams-hbase/conf/hbase-policy.xml'] {'owner': 'ams', 'content': InlineTemplate(...), 'group': 'hadoop', 'mode': None, 'encoding': 'UTF-8'}
2017-05-15 06:12:43,100 - File['/etc/ams-hbase/conf/hbase-env.sh'] {'content': InlineTemplate(...), 'owner': 'ams'}
2017-05-15 06:12:43,104 - File['/etc/ams-hbase/conf/hadoop-metrics2-hbase.properties'] {'content': Template('hadoop-metrics2-hbase.properties.j2'), 'owner': 'ams', 'group': 'hadoop'}
2017-05-15 06:12:43,105 - TemplateConfig['/etc/ams-hbase/conf/regionservers'] {'owner': 'ams', 'template_tag': None}
2017-05-15 06:12:43,107 - File['/etc/ams-hbase/conf/regionservers'] {'content': Template('regionservers.j2'), 'owner': 'ams', 'group': None, 'mode': None}
2017-05-15 06:12:43,108 - Directory['/var/run/ambari-metrics-collector/'] {'owner': 'ams', 'create_parents': True, 'mode': 0755, 'cd_access': 'a'}
2017-05-15 06:12:43,108 - Directory['/var/log/ambari-metrics-collector'] {'owner': 'ams', 'create_parents': True, 'mode': 0755, 'cd_access': 'a'}
2017-05-15 06:12:43,109 - Directory['/var/lib/ambari-metrics-collector/hbase'] {'owner': 'ams', 'create_parents': True, 'recursive_ownership': True, 'cd_access': 'a'}
2017-05-15 06:12:43,159 - File['/var/run/ambari-metrics-collector//distributed_mode'] {'owner': 'ams', 'action': ['delete']}
2017-05-15 06:12:43,159 - File['/etc/ams-hbase/conf/log4j.properties'] {'content': ..., 'owner': 'ams', 'group': 'hadoop', 'mode': 0644}
2017-05-15 06:12:43,160 - Directory['/etc/ams-hbase/conf'] {'owner': 'ams', 'group': 'hadoop', 'create_parents': True, 'recursive_ownership': True}
2017-05-15 06:12:43,161 - Directory['/var/lib/ambari-metrics-collector/hbase-tmp'] {'owner': 'ams', 'create_parents': True, 'recursive_ownership': True, 'cd_access': 'a'}
2017-05-15 06:12:43,161 - Directory['/var/lib/ambari-metrics-collector/hbase-tmp/local/jars'] {'owner': 'ams', 'group': 'hadoop', 'create_parents': True, 'mode': 0775, 'cd_access': 'a'}
2017-05-15 06:12:43,162 - File['/etc/ams-hbase/conf/core-site.xml'] {'owner': 'ams', 'action': ['delete']}
2017-05-15 06:12:43,162 - File['/etc/ams-hbase/conf/hdfs-site.xml'] {'owner': 'ams', 'action': ['delete']}
2017-05-15 06:12:43,162 - XmlConfig['hbase-site.xml'] {'owner': 'ams', 'group': 'hadoop', 'conf_dir': '/etc/ams-hbase/conf', 'configuration_attributes': {'final': {'hbase.zookeeper.quorum': 'true'}, 'hbase.zookeeper.quorum': {'final': 'true'}}, 'configurations': ...}
2017-05-15 06:12:43,169 - Generating config: /etc/ams-hbase/conf/hbase-site.xml
2017-05-15 06:12:43,169 - File['/etc/ams-hbase/conf/hbase-site.xml'] {'owner': 'ams', 'content': InlineTemplate(...), 'group': 'hadoop', 'mode': None, 'encoding': 'UTF-8'}
2017-05-15 06:12:43,196 - XmlConfig['hbase-policy.xml'] {'owner': 'ams', 'group': 'hadoop', 'conf_dir': '/etc/ams-hbase/conf', 'configuration_attributes': {}, 'configurations': {'security.masterregion.protocol.acl': '*', 'security.admin.protocol.acl': '*', 'security.client.protocol.acl': '*'}}
2017-05-15 06:12:43,202 - Generating config: /etc/ams-hbase/conf/hbase-policy.xml
2017-05-15 06:12:43,202 - File['/etc/ams-hbase/conf/hbase-policy.xml'] {'owner': 'ams', 'content': InlineTemplate(...), 'group': 'hadoop', 'mode': None, 'encoding': 'UTF-8'}
2017-05-15 06:12:43,210 - File['/etc/ams-hbase/conf/hbase-env.sh'] {'content': InlineTemplate(...), 'owner': 'ams'}
2017-05-15 06:12:43,214 - File['/etc/ams-hbase/conf/hadoop-metrics2-hbase.properties'] {'content': Template('hadoop-metrics2-hbase.properties.j2'), 'owner': 'ams', 'group': 'hadoop'}
2017-05-15 06:12:43,214 - TemplateConfig['/etc/ams-hbase/conf/regionservers'] {'owner': 'ams', 'template_tag': None}
2017-05-15 06:12:43,216 - File['/etc/ams-hbase/conf/regionservers'] {'content': Template('regionservers.j2'), 'owner': 'ams', 'group': None, 'mode': None}
2017-05-15 06:12:43,216 - Directory['/var/run/ambari-metrics-collector/'] {'owner': 'ams', 'create_parents': True, 'mode': 0755, 'cd_access': 'a'}
2017-05-15 06:12:43,216 - Directory['/var/log/ambari-metrics-collector'] {'owner': 'ams', 'create_parents': True, 'mode': 0755, 'cd_access': 'a'}
2017-05-15 06:12:43,217 - File['/etc/ams-hbase/conf/log4j.properties'] {'content': ..., 'owner': 'ams', 'group': 'hadoop', 'mode': 0644}
2017-05-15 06:12:43,218 - Directory['/etc/ambari-metrics-collector/conf'] {'owner': 'ams', 'group': 'hadoop', 'create_parents': True, 'recursive_ownership': True}
2017-05-15 06:12:43,218 - Directory['/var/lib/ambari-metrics-collector/checkpoint'] {'owner': 'ams', 'group': 'hadoop', 'create_parents': True, 'recursive_ownership': True, 'cd_access': 'a'}
2017-05-15 06:12:43,219 - XmlConfig['ams-site.xml'] {'owner': 'ams', 'group': 'hadoop', 'conf_dir': '/etc/ambari-metrics-collector/conf', 'configuration_attributes': {}, 'configurations': ...}
2017-05-15 06:12:43,228 - Generating config: /etc/ambari-metrics-collector/conf/ams-site.xml
2017-05-15 06:12:43,229 - File['/etc/ambari-metrics-collector/conf/ams-site.xml'] {'owner': 'ams', 'content': InlineTemplate(...), 'group': 'hadoop', 'mode': None, 'encoding': 'UTF-8'}
2017-05-15 06:12:43,288 - XmlConfig['ssl-server.xml'] {'owner': 'ams', 'group': 'hadoop', 'conf_dir': '/etc/ambari-metrics-collector/conf', 'configuration_attributes': {}, 'configurations': ...}
2017-05-15 06:12:43,295 - Generating config: /etc/ambari-metrics-collector/conf/ssl-server.xml
2017-05-15 06:12:43,295 - File['/etc/ambari-metrics-collector/conf/ssl-server.xml'] {'owner': 'ams', 'content': InlineTemplate(...), 'group': 'hadoop', 'mode': None, 'encoding': 'UTF-8'}
2017-05-15 06:12:43,300 - XmlConfig['hbase-site.xml'] {'owner': 'ams', 'group': 'hadoop', 'conf_dir': '/etc/ambari-metrics-collector/conf', 'configuration_attributes': {'final': {'hbase.zookeeper.quorum': 'true'}, 'hbase.zookeeper.quorum': {'final': 'true'}}, 'configurations': ...}
2017-05-15 06:12:43,308 - Generating config: /etc/ambari-metrics-collector/conf/hbase-site.xml
2017-05-15 06:12:43,308 - File['/etc/ambari-metrics-collector/conf/hbase-site.xml'] {'owner': 'ams', 'content': InlineTemplate(...), 'group': 'hadoop', 'mode': None, 'encoding': 'UTF-8'}
2017-05-15 06:12:43,339 - File['/etc/ambari-metrics-collector/conf/log4j.properties'] {'content': ..., 'owner': 'ams', 'group': 'hadoop', 'mode': 0644}
2017-05-15 06:12:43,342 - File['/etc/ambari-metrics-collector/conf/ams-env.sh'] {'content': InlineTemplate(...), 'owner': 'ams'}
2017-05-15 06:12:43,343 - Directory['/var/log/ambari-metrics-collector'] {'owner': 'ams', 'group': 'hadoop', 'create_parents': True, 'mode': 0755, 'cd_access': 'a'}
2017-05-15 06:12:43,343 - Directory['/var/run/ambari-metrics-collector'] {'owner': 'ams', 'group': 'hadoop', 'create_parents': True, 'mode': 0755, 'cd_access': 'a'}
2017-05-15 06:12:43,343 - File['/usr/lib/ams-hbase/bin/hadoop'] {'owner': 'ams', 'mode': 0755}
2017-05-15 06:12:43,344 - Directory['/etc/security/limits.d'] {'owner': 'root', 'create_parents': True, 'group': 'root'}
2017-05-15 06:12:43,345 - File['/etc/security/limits.d/ams.conf'] {'content': Template('ams.conf.j2'), 'owner': 'root', 'group': 'root', 'mode': 0644}
2017-05-15 06:12:43,347 - Execute['/usr/sbin/ambari-metrics-collector --config /etc/ambari-metrics-collector/conf stop'] {'user': 'ams'}
2017-05-15 06:12:48,498 - Execute['ambari-sudo.sh rm -rf /var/lib/ambari-metrics-collector/hbase-tmp/*.tmp'] {}
2017-05-15 06:12:48,515 - File['/etc/ambari-metrics-collector/conf/core-site.xml'] {'owner': 'ams', 'action': ['delete']}
2017-05-15 06:12:48,516 - File['/etc/ambari-metrics-collector/conf/hdfs-site.xml'] {'owner': 'ams', 'action': ['delete']}
2017-05-15 06:12:48,517 - Execute['/usr/sbin/ambari-metrics-collector --config /etc/ambari-metrics-collector/conf start'] {'user': 'ams'}

Command completed successfully!

need info..like memory allocated for HDP Sandbox @ VMs.

Re: Ambari Metrics Collector not starting on Hortonworks Sandbox HDP 2.5

Expert Contributor

@Santoshkumar Hiremath Can you attach the following?

/etc/ambari-metrics-collector/conf/ams-site.xml

/etc/ams-hbase/conf/hbase-site.xml

/var/log/ambari-metrics-collector/ambari-metrics-collector.log

/var/log/ambari-metrics-collector/hbase-ams-*.log