Support Questions

Find answers, ask questions, and share your expertise
Announcements
Now Live: Explore expert insights and technical deep dives on the new Cloudera Community BlogsRead the Announcement

i'm installing ambari server with HDP 2.2.8.0 with ambari 2.1.2.1

avatar
Rising Star

Hi,everyone.

I have a problem While summarising the cluster in Ambari server , the Ambari metrics server is constantly throwing this warning and aborting in the middle.

Below is the log generated by the service while aborting.

stderr: 

Command aborted. Aborted by user
 stdout:
2016-04-19 12:28:16,359 - Group['hadoop'] {}
2016-04-19 12:28:16,360 - Group['users'] {}
2016-04-19 12:28:16,361 - Group['knox'] {}
2016-04-19 12:28:16,361 - Group['spark'] {}
2016-04-19 12:28:16,361 - User['oozie'] {'gid': 'hadoop', 'groups': ['users']}
2016-04-19 12:28:16,362 - User['hive'] {'gid': 'hadoop', 'groups': ['hadoop']}
2016-04-19 12:28:16,363 - User['ambari-qa'] {'gid': 'hadoop', 'groups': ['users']}
2016-04-19 12:28:16,363 - User['flume'] {'gid': 'hadoop', 'groups': ['hadoop']}
2016-04-19 12:28:16,364 - User['hdfs'] {'gid': 'hadoop', 'groups': ['hadoop']}
2016-04-19 12:28:16,365 - User['knox'] {'gid': 'hadoop', 'groups': ['hadoop']}
2016-04-19 12:28:16,366 - User['storm'] {'gid': 'hadoop', 'groups': ['hadoop']}
2016-04-19 12:28:16,367 - User['spark'] {'gid': 'hadoop', 'groups': ['hadoop']}
2016-04-19 12:28:16,367 - User['mapred'] {'gid': 'hadoop', 'groups': ['hadoop']}
2016-04-19 12:28:16,368 - User['hbase'] {'gid': 'hadoop', 'groups': ['hadoop']}
2016-04-19 12:28:16,369 - User['tez'] {'gid': 'hadoop', 'groups': ['users']}
2016-04-19 12:28:16,369 - User['zookeeper'] {'gid': 'hadoop', 'groups': ['hadoop']}
2016-04-19 12:28:16,370 - User['kafka'] {'gid': 'hadoop', 'groups': ['hadoop']}
2016-04-19 12:28:16,371 - User['falcon'] {'gid': 'hadoop', 'groups': ['users']}
2016-04-19 12:28:16,372 - User['sqoop'] {'gid': 'hadoop', 'groups': ['hadoop']}
2016-04-19 12:28:16,372 - User['yarn'] {'gid': 'hadoop', 'groups': ['hadoop']}
2016-04-19 12:28:16,373 - User['hcat'] {'gid': 'hadoop', 'groups': ['hadoop']}
2016-04-19 12:28:16,374 - User['ams'] {'gid': 'hadoop', 'groups': ['hadoop']}
2016-04-19 12:28:16,375 - File['/var/lib/ambari-agent/tmp/changeUid.sh'] {'content': StaticFile('changeToSecureUid.sh'), 'mode': 0555}
2016-04-19 12:28:16,376 - Execute['/var/lib/ambari-agent/tmp/changeUid.sh ambari-qa /tmp/hadoop-ambari-qa,/tmp/hsperfdata_ambari-qa,/home/ambari-qa,/tmp/ambari-qa,/tmp/sqoop-ambari-qa'] {'not_if': '(test $(id -u ambari-qa) -gt 1000) || (false)'}
2016-04-19 12:28:16,384 - Skipping Execute['/var/lib/ambari-agent/tmp/changeUid.sh ambari-qa /tmp/hadoop-ambari-qa,/tmp/hsperfdata_ambari-qa,/home/ambari-qa,/tmp/ambari-qa,/tmp/sqoop-ambari-qa'] due to not_if
2016-04-19 12:28:16,384 - Directory['/tmp/hbase-hbase'] {'owner': 'hbase', 'recursive': True, 'mode': 0775, 'cd_access': 'a'}
2016-04-19 12:28:16,391 - File['/var/lib/ambari-agent/tmp/changeUid.sh'] {'content': StaticFile('changeToSecureUid.sh'), 'mode': 0555}
2016-04-19 12:28:16,393 - Execute['/var/lib/ambari-agent/tmp/changeUid.sh hbase /home/hbase,/tmp/hbase,/usr/bin/hbase,/var/log/hbase,/tmp/hbase-hbase'] {'not_if': '(test $(id -u hbase) -gt 1000) || (false)'}
2016-04-19 12:28:16,401 - Skipping Execute['/var/lib/ambari-agent/tmp/changeUid.sh hbase /home/hbase,/tmp/hbase,/usr/bin/hbase,/var/log/hbase,/tmp/hbase-hbase'] due to not_if
2016-04-19 12:28:16,402 - Group['hdfs'] {'ignore_failures': False}
2016-04-19 12:28:16,402 - User['hdfs'] {'ignore_failures': False, 'groups': ['hadoop', 'hdfs']}
2016-04-19 12:28:16,404 - Directory['/etc/hadoop'] {'mode': 0755}
2016-04-19 12:28:16,406 - Directory['/var/lib/ambari-agent/tmp/hadoop_java_io_tmpdir'] {'owner': 'hdfs', 'group': 'hadoop', 'mode': 0777}
2016-04-19 12:28:16,420 - Execute[('setenforce', '0')] {'not_if': '(! which getenforce ) || (which getenforce && getenforce | grep -q Disabled)', 'sudo': True, 'only_if': 'test -f /selinux/enforce'}
2016-04-19 12:28:16,461 - Directory['/var/log/hadoop'] {'owner': 'root', 'mode': 0775, 'group': 'hadoop', 'recursive': True, 'cd_access': 'a'}
2016-04-19 12:28:16,464 - Directory['/var/run/hadoop'] {'owner': 'root', 'group': 'root', 'recursive': True, 'cd_access': 'a'}
2016-04-19 12:28:16,465 - Directory['/tmp/hadoop-hdfs'] {'owner': 'hdfs', 'recursive': True, 'cd_access': 'a'}
2016-04-19 12:28:16,475 - File['/etc/hadoop/conf/topology_mappings.data'] {'owner': 'hdfs', 'content': Template('topology_mappings.data.j2'), 'only_if': 'test -d /etc/hadoop/conf', 'group': 'hadoop'}
2016-04-19 12:28:16,482 - File['/etc/hadoop/conf/topology_script.py'] {'content': StaticFile('topology_script.py'), 'only_if': 'test -d /etc/hadoop/conf', 'mode': 0755}
2016-04-19 12:28:16,664 - Directory['/etc/ams-hbase/conf'] {'owner': 'ams', 'group': 'hadoop', 'recursive': True}
2016-04-19 12:28:16,666 - Directory['/var/lib/ambari-metrics-collector/hbase-tmp'] {'owner': 'ams', 'recursive': True, 'cd_access': 'a'}
2016-04-19 12:28:16,667 - Directory['/var/lib/ambari-metrics-collector/hbase-tmp/local/jars'] {'owner': 'ams', 'cd_access': 'a', 'group': 'hadoop', 'mode': 0775, 'recursive': True}
2016-04-19 12:28:16,668 - XmlConfig['hbase-site.xml'] {'owner': 'ams', 'group': 'hadoop', 'conf_dir': '/etc/ams-hbase/conf', 'configuration_attributes': {}, 'configurations': ...}
2016-04-19 12:28:16,682 - Generating config: /etc/ams-hbase/conf/hbase-site.xml
2016-04-19 12:28:16,682 - File['/etc/ams-hbase/conf/hbase-site.xml'] {'owner': 'ams', 'content': InlineTemplate(...), 'group': 'hadoop', 'mode': None, 'encoding': 'UTF-8'}
2016-04-19 12:28:16,711 - XmlConfig['hbase-policy.xml'] {'owner': 'ams', 'group': 'hadoop', 'conf_dir': '/etc/ams-hbase/conf', 'configuration_attributes': {}, 'configurations': {'security.admin.protocol.acl': '*', 'security.masterregion.protocol.acl': '*', 'security.client.protocol.acl': '*'}}
2016-04-19 12:28:16,721 - Generating config: /etc/ams-hbase/conf/hbase-policy.xml
2016-04-19 12:28:16,722 - File['/etc/ams-hbase/conf/hbase-policy.xml'] {'owner': 'ams', 'content': InlineTemplate(...), 'group': 'hadoop', 'mode': None, 'encoding': 'UTF-8'}
2016-04-19 12:28:16,735 - File['/etc/ams-hbase/conf/hbase-env.sh'] {'content': InlineTemplate(...), 'owner': 'ams'}
2016-04-19 12:28:16,741 - File['/etc/ams-hbase/conf/hadoop-metrics2-hbase.properties'] {'content': Template('hadoop-metrics2-hbase.properties.j2'), 'owner': 'ams', 'group': 'hadoop'}
2016-04-19 12:28:16,742 - TemplateConfig['/etc/ams-hbase/conf/regionservers'] {'owner': 'ams', 'template_tag': None}
2016-04-19 12:28:16,744 - File['/etc/ams-hbase/conf/regionservers'] {'content': Template('regionservers.j2'), 'owner': 'ams', 'group': None, 'mode': None}
2016-04-19 12:28:16,745 - Directory['/var/run/ambari-metrics-collector/'] {'owner': 'ams', 'recursive': True}
2016-04-19 12:28:16,745 - Directory['/var/log/ambari-metrics-collector'] {'owner': 'ams', 'recursive': True}
2016-04-19 12:28:16,745 - Directory['/var/lib/ambari-metrics-collector/hbase'] {'owner': 'ams', 'recursive': True, 'cd_access': 'a'}
2016-04-19 12:28:16,746 - File['/var/run/ambari-metrics-collector//distributed_mode'] {'owner': 'ams', 'action': ['delete']}
2016-04-19 12:28:16,746 - File['/etc/ams-hbase/conf/log4j.properties'] {'content': ..., 'owner': 'ams', 'group': 'hadoop', 'mode': 0644}
2016-04-19 12:28:16,747 - Directory['/etc/ams-hbase/conf'] {'owner': 'ams', 'group': 'hadoop', 'recursive': True}
2016-04-19 12:28:16,747 - Directory['/var/lib/ambari-metrics-collector/hbase-tmp'] {'owner': 'ams', 'recursive': True, 'cd_access': 'a'}
2016-04-19 12:28:16,748 - Directory['/var/lib/ambari-metrics-collector/hbase-tmp/local/jars'] {'owner': 'ams', 'cd_access': 'a', 'group': 'hadoop', 'mode': 0775, 'recursive': True}
2016-04-19 12:28:16,748 - XmlConfig['hbase-site.xml'] {'owner': 'ams', 'group': 'hadoop', 'conf_dir': '/etc/ams-hbase/conf', 'configuration_attributes': {}, 'configurations': ...}
2016-04-19 12:28:16,759 - Generating config: /etc/ams-hbase/conf/hbase-site.xml
2016-04-19 12:28:16,759 - File['/etc/ams-hbase/conf/hbase-site.xml'] {'owner': 'ams', 'content': InlineTemplate(...), 'group': 'hadoop', 'mode': None, 'encoding': 'UTF-8'}
2016-04-19 12:28:16,792 - XmlConfig['hbase-policy.xml'] {'owner': 'ams', 'group': 'hadoop', 'conf_dir': '/etc/ams-hbase/conf', 'configuration_attributes': {}, 'configurations': {'security.admin.protocol.acl': '*', 'security.masterregion.protocol.acl': '*', 'security.client.protocol.acl': '*'}}
2016-04-19 12:28:16,803 - Generating config: /etc/ams-hbase/conf/hbase-policy.xml
2016-04-19 12:28:16,804 - File['/etc/ams-hbase/conf/hbase-policy.xml'] {'owner': 'ams', 'content': InlineTemplate(...), 'group': 'hadoop', 'mode': None, 'encoding': 'UTF-8'}
2016-04-19 12:28:16,818 - File['/etc/ams-hbase/conf/hbase-env.sh'] {'content': InlineTemplate(...), 'owner': 'ams'}
2016-04-19 12:28:16,822 - File['/etc/ams-hbase/conf/hadoop-metrics2-hbase.properties'] {'content': Template('hadoop-metrics2-hbase.properties.j2'), 'owner': 'ams', 'group': 'hadoop'}
2016-04-19 12:28:16,822 - TemplateConfig['/etc/ams-hbase/conf/regionservers'] {'owner': 'ams', 'template_tag': None}
2016-04-19 12:28:16,824 - File['/etc/ams-hbase/conf/regionservers'] {'content': Template('regionservers.j2'), 'owner': 'ams', 'group': None, 'mode': None}
2016-04-19 12:28:16,825 - Directory['/var/run/ambari-metrics-collector/'] {'owner': 'ams', 'recursive': True}
2016-04-19 12:28:16,825 - Directory['/var/log/ambari-metrics-collector'] {'owner': 'ams', 'recursive': True}
2016-04-19 12:28:16,826 - File['/etc/ams-hbase/conf/log4j.properties'] {'content': ..., 'owner': 'ams', 'group': 'hadoop', 'mode': 0644}
2016-04-19 12:28:16,827 - Directory['/etc/ambari-metrics-collector/conf'] {'owner': 'ams', 'group': 'hadoop', 'recursive': True}
2016-04-19 12:28:16,827 - Directory['/var/lib/ambari-metrics-collector/checkpoint'] {'owner': 'ams', 'group': 'hadoop', 'recursive': True, 'cd_access': 'a'}
2016-04-19 12:28:16,827 - XmlConfig['ams-site.xml'] {'owner': 'ams', 'group': 'hadoop', 'conf_dir': '/etc/ambari-metrics-collector/conf', 'configuration_attributes': {}, 'configurations': ...}
2016-04-19 12:28:16,837 - Generating config: /etc/ambari-metrics-collector/conf/ams-site.xml
2016-04-19 12:28:16,838 - File['/etc/ambari-metrics-collector/conf/ams-site.xml'] {'owner': 'ams', 'content': InlineTemplate(...), 'group': 'hadoop', 'mode': None, 'encoding': 'UTF-8'}
2016-04-19 12:28:16,871 - XmlConfig['hbase-site.xml'] {'owner': 'ams', 'group': 'hadoop', 'conf_dir': '/etc/ambari-metrics-collector/conf', 'configuration_attributes': {}, 'configurations': ...}
2016-04-19 12:28:16,881 - Generating config: /etc/ambari-metrics-collector/conf/hbase-site.xml
2016-04-19 12:28:16,881 - File['/etc/ambari-metrics-collector/conf/hbase-site.xml'] {'owner': 'ams', 'content': InlineTemplate(...), 'group': 'hadoop', 'mode': None, 'encoding': 'UTF-8'}
2016-04-19 12:28:16,910 - File['/etc/ambari-metrics-collector/conf/log4j.properties'] {'content': ..., 'owner': 'ams', 'group': 'hadoop', 'mode': 0644}
2016-04-19 12:28:16,914 - File['/etc/ambari-metrics-collector/conf/ams-env.sh'] {'content': InlineTemplate(...), 'owner': 'ams'}
2016-04-19 12:28:16,915 - Directory['/var/log/ambari-metrics-collector'] {'owner': 'ams', 'group': 'hadoop', 'recursive': True, 'cd_access': 'a'}
2016-04-19 12:28:16,915 - Directory['/var/run/ambari-metrics-collector'] {'owner': 'ams', 'group': 'hadoop', 'recursive': True, 'cd_access': 'a'}
2016-04-19 12:28:16,916 - File['/usr/lib/ams-hbase/bin/hadoop'] {'owner': 'ams', 'mode': 0755}
2016-04-19 12:28:16,916 - Directory['/etc/security/limits.d'] {'owner': 'root', 'group': 'root', 'recursive': True}
2016-04-19 12:28:16,918 - File['/etc/security/limits.d/ams.conf'] {'content': Template('ams.conf.j2'), 'owner': 'root', 'group': 'root', 'mode': 0644}
2016-04-19 12:28:16,919 - Execute['ambari-sudo.sh rm -rf /var/lib/ambari-metrics-collector/hbase-tmp/*.tmp'] {}
2016-04-19 12:28:16,929 - Execute['/usr/sbin/ambari-metrics-collector --config /etc/ambari-metrics-collector/conf start'] {'user': 'ams'}
Command aborted. Aborted by user

2. And Oozie is shutting down on its own. I had to start it for every two minutes every time manually.

Any useful suggestion can be helpful.

Thanks in advance

1 ACCEPTED SOLUTION

avatar
Super Collaborator
3 REPLIES 3

avatar
Expert Contributor

Hi @karthik sai,

what do you see in ambari-mertrics-log (Default path /var/log/ambari-metrics-collector/)?

Because it seems that you have stopped from user, there must be another reason.

avatar
Rising Star

And what can you say about the oozie server? Why is it shutting down on its own?

avatar
Super Collaborator