Support Questions
Find answers, ask questions, and share your expertise
cancel
Turn on suggestions
Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.
Showing results for 
Search instead for 
Did you mean: 
Advanced Search
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

how to solve the following errors when we start apache metron

Highlighted

how to solve the following errors when we start apache metron

Labels:
habtamuwubneh5
Explorer

Created ‎07-23-2019 01:11 PM 

Traceback (most recent call last):
  File "/var/lib/ambari-agent/cache/common-services/METRON/0.7.1.1.9.1.0/package/scripts/enrichment_master.py", line 121, in <module>
    Enrichment().execute()
  File "/usr/lib/ambari-agent/lib/resource_management/libraries/script/script.py", line 375, in execute
    method(env)
  File "/var/lib/ambari-agent/cache/common-services/METRON/0.7.1.1.9.1.0/package/scripts/enrichment_master.py", line 62, in start
    self.configure(env)
  File "/usr/lib/ambari-agent/lib/resource_management/libraries/script/script.py", line 120, in locking_configure
    original_configure(obj, *args, **kw)
  File "/var/lib/ambari-agent/cache/common-services/METRON/0.7.1.1.9.1.0/package/scripts/enrichment_master.py", line 52, in configure
    metron_service.init_zk_config(params)
  File "/var/lib/ambari-agent/cache/common-services/METRON/0.7.1.1.9.1.0/package/scripts/metron_service.py", line 43, in init_zk_config
    path=ambari_format("{java_home}/bin")
  File "/usr/lib/ambari-agent/lib/resource_management/core/base.py", line 166, in __init__
    self.env.run()
  File "/usr/lib/ambari-agent/lib/resource_management/core/environment.py", line 160, in run
    self.run_action(resource, action)
  File "/usr/lib/ambari-agent/lib/resource_management/core/environment.py", line 124, in run_action
    provider_action()
  File "/usr/lib/ambari-agent/lib/resource_management/core/providers/system.py", line 262, in action_run
    tries=self.resource.tries, try_sleep=self.resource.try_sleep)
  File "/usr/lib/ambari-agent/lib/resource_management/core/shell.py", line 72, in inner
    result = function(command, **kwargs)
  File "/usr/lib/ambari-agent/lib/resource_management/core/shell.py", line 102, in checked_call
    tries=tries, try_sleep=try_sleep, timeout_kill_strategy=timeout_kill_strategy)
  File "/usr/lib/ambari-agent/lib/resource_management/core/shell.py", line 150, in _call_wrapper
    result = _call(command, **kwargs_copy)
  File "/usr/lib/ambari-agent/lib/resource_management/core/shell.py", line 303, in _call
    raise ExecutionFailed(err_msg, code, out, err)
resource_management.core.exceptions.ExecutionFailed: Execution of '/usr/hcp/1.9.1.0-6/metron/bin/zk_load_configs.sh --zk_quorum master.sip.com:2181,worker1.sip.com:2181,worker2.sip.com:2181 --mode PUSH --input_dir /usr/hcp/1.9.1.0-6/metron/config/zookeeper' returned 127. /bin/bash: /usr/hcp/1.9.1.0-6/metron/bin/zk_load_configs.sh: No such file or directory


Tasks

Copy OpenMetron Enrichment Start


stderr: /var/lib/ambari-agent/data/errors-685.txt

Traceback (most recent call last):
  File "/var/lib/ambari-agent/cache/common-services/METRON/0.7.1.1.9.1.0/package/scripts/enrichment_master.py", line 121, in <module>
    Enrichment().execute()
  File "/usr/lib/ambari-agent/lib/resource_management/libraries/script/script.py", line 375, in execute
    method(env)
  File "/var/lib/ambari-agent/cache/common-services/METRON/0.7.1.1.9.1.0/package/scripts/enrichment_master.py", line 62, in start
    self.configure(env)
  File "/usr/lib/ambari-agent/lib/resource_management/libraries/script/script.py", line 120, in locking_configure
    original_configure(obj, *args, **kw)
  File "/var/lib/ambari-agent/cache/common-services/METRON/0.7.1.1.9.1.0/package/scripts/enrichment_master.py", line 52, in configure
    metron_service.init_zk_config(params)
  File "/var/lib/ambari-agent/cache/common-services/METRON/0.7.1.1.9.1.0/package/scripts/metron_service.py", line 43, in init_zk_config
    path=ambari_format("{java_home}/bin")
  File "/usr/lib/ambari-agent/lib/resource_management/core/base.py", line 166, in __init__
    self.env.run()
  File "/usr/lib/ambari-agent/lib/resource_management/core/environment.py", line 160, in run
    self.run_action(resource, action)
  File "/usr/lib/ambari-agent/lib/resource_management/core/environment.py", line 124, in run_action
    provider_action()
  File "/usr/lib/ambari-agent/lib/resource_management/core/providers/system.py", line 262, in action_run
    tries=self.resource.tries, try_sleep=self.resource.try_sleep)
  File "/usr/lib/ambari-agent/lib/resource_management/core/shell.py", line 72, in inner
    result = function(command, **kwargs)
  File "/usr/lib/ambari-agent/lib/resource_management/core/shell.py", line 102, in checked_call
    tries=tries, try_sleep=try_sleep, timeout_kill_strategy=timeout_kill_strategy)
  File "/usr/lib/ambari-agent/lib/resource_management/core/shell.py", line 150, in _call_wrapper
    result = _call(command, **kwargs_copy)
  File "/usr/lib/ambari-agent/lib/resource_management/core/shell.py", line 303, in _call
    raise ExecutionFailed(err_msg, code, out, err)
resource_management.core.exceptions.ExecutionFailed: Execution of '/usr/hcp/1.9.1.0-6/metron/bin/zk_load_configs.sh --zk_quorum master.sip.com:2181,worker1.sip.com:2181,worker2.sip.com:2181 --mode PUSH --input_dir /usr/hcp/1.9.1.0-6/metron/config/zookeeper' returned 127. /bin/bash: /usr/hcp/1.9.1.0-6/metron/bin/zk_load_configs.sh: No such file or directory


Tasks

Copy OpenMetron Enrichment Start


stderr: /var/lib/ambari-agent/data/errors-685.txt

Traceback (most recent call last):
  File "/var/lib/ambari-agent/cache/common-services/METRON/0.7.1.1.9.1.0/package/scripts/enrichment_master.py", line 121, in <module>
    Enrichment().execute()
  File "/usr/lib/ambari-agent/lib/resource_management/libraries/script/script.py", line 375, in execute
    method(env)
  File "/var/lib/ambari-agent/cache/common-services/METRON/0.7.1.1.9.1.0/package/scripts/enrichment_master.py", line 62, in start
    self.configure(env)
  File "/usr/lib/ambari-agent/lib/resource_management/libraries/script/script.py", line 120, in locking_configure
    original_configure(obj, *args, **kw)
  File "/var/lib/ambari-agent/cache/common-services/METRON/0.7.1.1.9.1.0/package/scripts/enrichment_master.py", line 52, in configure
    metron_service.init_zk_config(params)
  File "/var/lib/ambari-agent/cache/common-services/METRON/0.7.1.1.9.1.0/package/scripts/metron_service.py", line 43, in init_zk_config
    path=ambari_format("{java_home}/bin")
  File "/usr/lib/ambari-agent/lib/resource_management/core/base.py", line 166, in __init__
    self.env.run()
  File "/usr/lib/ambari-agent/lib/resource_management/core/environment.py", line 160, in run
    self.run_action(resource, action)
  File "/usr/lib/ambari-agent/lib/resource_management/core/environment.py", line 124, in run_action
    provider_action()
  File "/usr/lib/ambari-agent/lib/resource_management/core/providers/system.py", line 262, in action_run
    tries=self.resource.tries, try_sleep=self.resource.try_sleep)
  File "/usr/lib/ambari-agent/lib/resource_management/core/shell.py", line 72, in inner
    result = function(command, **kwargs)
  File "/usr/lib/ambari-agent/lib/resource_management/core/shell.py", line 102, in checked_call
    tries=tries, try_sleep=try_sleep, timeout_kill_strategy=timeout_kill_strategy)
  File "/usr/lib/ambari-agent/lib/resource_management/core/shell.py", line 150, in _call_wrapper
    result = _call(command, **kwargs_copy)
  File "/usr/lib/ambari-agent/lib/resource_management/core/shell.py", line 303, in _call
    raise ExecutionFailed(err_msg, code, out, err)
resource_management.core.exceptions.ExecutionFailed: Execution of '/usr/hcp/1.9.1.0-6/metron/bin/zk_load_configs.sh --zk_quorum master.sip.com:2181,worker1.sip.com:2181,worker2.sip.com:2181 --mode PUSH --input_dir /usr/hcp/1.9.1.0-6/metron/config/zookeeper' returned 127. /bin/bash: /usr/hcp/1.9.1.0-6/metron/bin/zk_load_configs.sh: No such file or directory

stdout: /var/lib/ambari-agent/data/output-685.txt

2019-07-23 01:38:49,282 - Stack Feature Version Info: Cluster Stack=2.6, Command Stack=None, Command Version=2.6.5.1175-1 -> 2.6.5.1175-1
2019-07-23 01:38:49,315 - Using hadoop conf dir: /usr/hdp/2.6.5.1175-1/hadoop/conf
2019-07-23 01:38:49,754 - Stack Feature Version Info: Cluster Stack=2.6, Command Stack=None, Command Version=2.6.5.1175-1 -> 2.6.5.1175-1
2019-07-23 01:38:49,767 - Using hadoop conf dir: /usr/hdp/2.6.5.1175-1/hadoop/conf
2019-07-23 01:38:49,770 - Group['metron'] {}
2019-07-23 01:38:49,772 - Group['elasticsearch'] {}
2019-07-23 01:38:49,773 - Group['nifiregistry'] {}
2019-07-23 01:38:49,773 - Group['hdfs'] {}
2019-07-23 01:38:49,774 - Group['zeppelin'] {}
2019-07-23 01:38:49,774 - Group['hadoop'] {}
2019-07-23 01:38:49,775 - Group['kibana'] {}
2019-07-23 01:38:49,775 - Group['nifi'] {}
2019-07-23 01:38:49,776 - Group['users'] {}
2019-07-23 01:38:49,778 - User['hive'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': [u'hadoop'], 'uid': None}
2019-07-23 01:38:49,780 - User['storm'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': [u'hadoop'], 'uid': None}
2019-07-23 01:38:49,782 - User['zookeeper'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': [u'hadoop'], 'uid': None}
2019-07-23 01:38:49,785 - User['ams'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': [u'hadoop'], 'uid': None}
2019-07-23 01:38:49,787 - User['tez'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': [u'users'], 'uid': None}
2019-07-23 01:38:49,789 - User['nifiregistry'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': ['nifiregistry'], 'uid': None}
2019-07-23 01:38:49,791 - User['zeppelin'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': [u'zeppelin', u'hadoop'], 'uid': None}
2019-07-23 01:38:49,794 - User['nifi'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': ['nifi'], 'uid': None}
2019-07-23 01:38:49,796 - User['metron'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': [u'hadoop'], 'uid': None}
2019-07-23 01:38:49,798 - User['elasticsearch'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': [u'hadoop'], 'uid': None}
2019-07-23 01:38:49,800 - User['ambari-qa'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': [u'users'], 'uid': None}
2019-07-23 01:38:49,803 - User['kafka'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': [u'hadoop'], 'uid': None}
2019-07-23 01:38:49,805 - User['hdfs'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': ['hdfs'], 'uid': None}
2019-07-23 01:38:49,807 - User['yarn'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': [u'hadoop'], 'uid': None}
2019-07-23 01:38:49,809 - User['kibana'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': [u'hadoop'], 'uid': None}
2019-07-23 01:38:49,812 - User['mapred'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': [u'hadoop'], 'uid': None}
2019-07-23 01:38:49,814 - User['hbase'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': [u'hadoop'], 'uid': None}
2019-07-23 01:38:49,816 - User['hcat'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': [u'hadoop'], 'uid': None}
2019-07-23 01:38:49,818 - File['/var/lib/ambari-agent/tmp/changeUid.sh'] {'content': StaticFile('changeToSecureUid.sh'), 'mode': 0555}
2019-07-23 01:38:49,821 - Execute['/var/lib/ambari-agent/tmp/changeUid.sh ambari-qa /tmp/hadoop-ambari-qa,/tmp/hsperfdata_ambari-qa,/home/ambari-qa,/tmp/ambari-qa,/tmp/sqoop-ambari-qa 0'] {'not_if': '(test $(id -u ambari-qa) -gt 1000) || (false)'}
2019-07-23 01:38:49,835 - Skipping Execute['/var/lib/ambari-agent/tmp/changeUid.sh ambari-qa /tmp/hadoop-ambari-qa,/tmp/hsperfdata_ambari-qa,/home/ambari-qa,/tmp/ambari-qa,/tmp/sqoop-ambari-qa 0'] due to not_if
2019-07-23 01:38:49,836 - Directory['/tmp/hbase-hbase'] {'owner': 'hbase', 'create_parents': True, 'mode': 0775, 'cd_access': 'a'}
2019-07-23 01:38:49,838 - File['/var/lib/ambari-agent/tmp/changeUid.sh'] {'content': StaticFile('changeToSecureUid.sh'), 'mode': 0555}
2019-07-23 01:38:49,842 - File['/var/lib/ambari-agent/tmp/changeUid.sh'] {'content': StaticFile('changeToSecureUid.sh'), 'mode': 0555}
2019-07-23 01:38:49,844 - call['/var/lib/ambari-agent/tmp/changeUid.sh hbase'] {}
2019-07-23 01:38:49,863 - call returned (0, '1009')
2019-07-23 01:38:49,865 - Execute['/var/lib/ambari-agent/tmp/changeUid.sh hbase /home/hbase,/tmp/hbase,/usr/bin/hbase,/var/log/hbase,/tmp/hbase-hbase 1009'] {'not_if': '(test $(id -u hbase) -gt 1000) || (false)'}
2019-07-23 01:38:49,877 - Skipping Execute['/var/lib/ambari-agent/tmp/changeUid.sh hbase /home/hbase,/tmp/hbase,/usr/bin/hbase,/var/log/hbase,/tmp/hbase-hbase 1009'] due to not_if
2019-07-23 01:38:49,878 - Group['hdfs'] {}
2019-07-23 01:38:49,879 - User['hdfs'] {'fetch_nonlocal_groups': True, 'groups': ['hdfs', u'hdfs']}
2019-07-23 01:38:49,881 - FS Type: 
2019-07-23 01:38:49,881 - Directory['/etc/hadoop'] {'mode': 0755}
2019-07-23 01:38:49,915 - File['/usr/hdp/2.6.5.1175-1/hadoop/conf/hadoop-env.sh'] {'content': InlineTemplate(...), 'owner': 'hdfs', 'group': 'hadoop'}
2019-07-23 01:38:49,917 - Directory['/var/lib/ambari-agent/tmp/hadoop_java_io_tmpdir'] {'owner': 'hdfs', 'group': 'hadoop', 'mode': 01777}
2019-07-23 01:38:49,954 - Execute[('setenforce', '0')] {'not_if': '(! which getenforce ) || (which getenforce && getenforce | grep -q Disabled)', 'sudo': True, 'only_if': 'test -f /selinux/enforce'}
2019-07-23 01:38:49,970 - Skipping Execute[('setenforce', '0')] due to not_if
2019-07-23 01:38:49,971 - Directory['/var/log/hadoop'] {'owner': 'root', 'create_parents': True, 'group': 'hadoop', 'mode': 0775, 'cd_access': 'a'}
2019-07-23 01:38:49,976 - Directory['/var/run/hadoop'] {'owner': 'root', 'create_parents': True, 'group': 'root', 'cd_access': 'a'}
2019-07-23 01:38:49,977 - Directory['/tmp/hadoop-hdfs'] {'owner': 'hdfs', 'create_parents': True, 'cd_access': 'a'}
2019-07-23 01:38:49,986 - File['/usr/hdp/2.6.5.1175-1/hadoop/conf/commons-logging.properties'] {'content': Template('commons-logging.properties.j2'), 'owner': 'hdfs'}
2019-07-23 01:38:49,991 - File['/usr/hdp/2.6.5.1175-1/hadoop/conf/health_check'] {'content': Template('health_check.j2'), 'owner': 'hdfs'}
2019-07-23 01:38:50,004 - File['/usr/hdp/2.6.5.1175-1/hadoop/conf/log4j.properties'] {'content': InlineTemplate(...), 'owner': 'hdfs', 'group': 'hadoop', 'mode': 0644}
2019-07-23 01:38:50,026 - File['/usr/hdp/2.6.5.1175-1/hadoop/conf/hadoop-metrics2.properties'] {'content': InlineTemplate(...), 'owner': 'hdfs', 'group': 'hadoop'}
2019-07-23 01:38:50,028 - File['/usr/hdp/2.6.5.1175-1/hadoop/conf/task-log4j.properties'] {'content': StaticFile('task-log4j.properties'), 'mode': 0755}
2019-07-23 01:38:50,030 - File['/usr/hdp/2.6.5.1175-1/hadoop/conf/configuration.xsl'] {'owner': 'hdfs', 'group': 'hadoop'}
2019-07-23 01:38:50,039 - File['/etc/hadoop/conf/topology_mappings.data'] {'owner': 'hdfs', 'content': Template('topology_mappings.data.j2'), 'only_if': 'test -d /etc/hadoop/conf', 'group': 'hadoop', 'mode': 0644}
2019-07-23 01:38:50,049 - File['/etc/hadoop/conf/topology_script.py'] {'content': StaticFile('topology_script.py'), 'only_if': 'test -d /etc/hadoop/conf', 'mode': 0755}
2019-07-23 01:38:50,078 - Skipping stack-select on METRON because it does not exist in the stack-select package structure.
2019-07-23 01:38:50,602 - Using hadoop conf dir: /usr/hdp/2.6.5.1175-1/hadoop/conf
2019-07-23 01:38:50,610 - Running enrichment configure
2019-07-23 01:38:50,627 - File['/usr/hcp/1.9.1.0-6/metron/config/enrichment-splitjoin.properties'] {'owner': 'metron', 'content': Template('enrichment-splitjoin.properties.j2'), 'group': 'metron'}
2019-07-23 01:38:50,641 - File['/usr/hcp/1.9.1.0-6/metron/config/enrichment-unified.properties'] {'owner': 'metron', 'content': Template('enrichment-unified.properties.j2'), 'group': 'metron'}
2019-07-23 01:38:50,643 - Loading ALL Metron config into ZooKeeper - this command should ONLY be executed by Ambari on initial install.
2019-07-23 01:38:50,643 - Execute['/usr/hcp/1.9.1.0-6/metron/bin/zk_load_configs.sh --zk_quorum master.sip.com:2181,worker1.sip.com:2181,worker2.sip.com:2181 --mode PUSH --input_dir /usr/hcp/1.9.1.0-6/metron/config/zookeeper'] {'path': [u'/usr/jdk64/jdk1.8.0_112/bin']}
2019-07-23 01:38:50,669 - Skipping stack-select on METRON because it does not exist in the stack-select package structure.

Command failed after 1 tries
Reply
112 Views
0 Kudos
Don't have an account?
Register
Coming from Hortonworks? Activate your account here