Support Questions

Find answers, ask questions, and share your expertise
Announcements
Check out our newest addition to the community, the Cloudera Data Analytics (CDA) group hub.

Apache Metron Mpack installation fails for single node

Explorer

metron-mpack-0710.tar.gz .

I am using Ubuntu 14 ,HDP -2.6.5.0-292,Ambari 2.7.3 version using https://github.com/apache/metron/tree/master/metron-deployment/packaging/ambari/metron-mpack. I skipped step 6 as I am using only one node and I am getting the below error. Can someone help to fix this error.

Traceback (most recent call last):

File "/var/lib/ambari-server/resources/scripts/stack_advisor.py", line 190, i$

main(sys.argv)

File "/var/lib/ambari-server/resources/scripts/stack_advisor.py", line 122, i$

result = stackAdvisor.validateComponentLayout(services, hosts)

File "/var/lib/ambari-server/resources/scripts/../stacks/stack_advisor.py", l$

validationItems = self.getComponentLayoutValidations(services, hosts)

File "/var/lib/ambari-server/resources/scripts/../stacks/HDP/2.5/services/sta$

parentItems = super(HDP25StackAdvisor, self).getComponentLayoutValidations($

File "/var/lib/ambari-server/resources/scripts/../stacks/HDP/2.0.6/services/s$

items = super(HDP206StackAdvisor, self).getComponentLayoutValidations(servi$

File "/var/lib/ambari-server/resources/scripts/../stacks/stack_advisor.py", l$

items.extend(serviceAdvisor.getServiceComponentLayoutValidations(services, $

File "/var/lib/ambari-server/resources/common-services/METRON/0.7.1/service_a$

metronParsersHost = self.getHosts(componentsList, "METRON_PARSERS")[0]

IndexError: list index out of range
6 REPLIES 6

Super Collaborator

It looks like you are trying this with HDP 3.x -- which is not supported as yet by HCP. Can you try with HDP 2.6.5.0 ?

Explorer

i used HDP -2.6.5.0-292 only . Somehow the hostname was not able to get .Fixed the issue by hardcoding the hostname

Explorer

I am using HDP 2.6.5 only

Explorer

@asubramanian I am using HDP 2.6.5.0.292 only. I fixed the above issue and when I was about to install datanode and other components with three nodes set up ,I am getting the below error

stderr: 
Traceback (most recent call last):
  File "/var/lib/ambari-agent/cache/stack-hooks/before-ANY/scripts/hook.py", line 38, in 
    BeforeAnyHook().execute()
  File "/usr/lib/ambari-agent/lib/resource_management/libraries/script/script.py", line 352, in execute
    method(env)
  File "/var/lib/ambari-agent/cache/stack-hooks/before-ANY/scripts/hook.py", line 31, in hook
    setup_users()
  File "/var/lib/ambari-agent/cache/stack-hooks/before-ANY/scripts/shared_initialization.py", line 50, in setup_users
    groups = params.user_to_groups_dict[user],
KeyError: u'metron'
Error: Error: Unable to run the custom hook script ['/usr/bin/python', '/var/lib/ambari-agent/cache/stack-hooks/before-ANY/scripts/hook.py', 'ANY', '/var/lib/ambari-agent/data/command-1001.json', '/var/lib/ambari-agent/cache/stack-hooks/before-ANY', '/var/lib/ambari-agent/data/structured-out-1001.json', 'INFO', '/var/lib/ambari-agent/tmp', 'PROTOCOL_TLSv1', '']2019-01-28 20:59:11,683 - Reporting component version failed
Traceback (most recent call last):
  File "/usr/lib/ambari-agent/lib/resource_management/libraries/script/script.py", line 363, in execute
    self.save_component_version_to_structured_out(self.command_name)
  File "/usr/lib/ambari-agent/lib/resource_management/libraries/script/script.py", line 223, in save_component_version_to_structured_out
    stack_select_package_name = stack_select.get_package_name()
  File "/usr/lib/ambari-agent/lib/resource_management/libraries/functions/stack_select.py", line 109, in get_package_name
    package = get_packages(PACKAGE_SCOPE_STACK_SELECT, service_name, component_name)
  File "/usr/lib/ambari-agent/lib/resource_management/libraries/functions/stack_select.py", line 223, in get_packages
    supported_packages = get_supported_packages()
  File "/usr/lib/ambari-agent/lib/resource_management/libraries/functions/stack_select.py", line 147, in get_supported_packages
    raise Fail("Unable to query for supported packages using {0}".format(stack_selector_path))
Fail: Unable to query for supported packages using /usr/bin/hdp-select
 stdout:
2019-01-28 20:59:11,645 - Stack Feature Version Info: Cluster Stack=2.6, Command Stack=None, Command Version=None -> 2.6
2019-01-28 20:59:11,649 - Using hadoop conf dir: /usr/hdp/current/hadoop-client/conf
2019-01-28 20:59:11,651 - Group['metron'] {}
2019-01-28 20:59:11,651 - Group['hdfs'] {}
2019-01-28 20:59:11,651 - Group['zeppelin'] {}
2019-01-28 20:59:11,652 - Group['hadoop'] {}
2019-01-28 20:59:11,652 - Group['users'] {}
Error: Error: Unable to run the custom hook script ['/usr/bin/python', '/var/lib/ambari-agent/cache/stack-hooks/before-ANY/scripts/hook.py', 'ANY', '/var/lib/ambari-agent/data/command-1001.json', '/var/lib/ambari-agent/cache/stack-hooks/before-ANY', '/var/lib/ambari-agent/data/structured-out-1001.json', 'INFO', '/var/lib/ambari-agent/tmp', 'PROTOCOL_TLSv1', '']
2019-01-28 20:59:11,683 - Reporting component version failed
Traceback (most recent call last):
  File "/usr/lib/ambari-agent/lib/resource_management/libraries/script/script.py", line 363, in execute
    self.save_component_version_to_structured_out(self.command_name)
  File "/usr/lib/ambari-agent/lib/resource_management/libraries/script/script.py", line 223, in save_component_version_to_structured_out
    stack_select_package_name = stack_select.get_package_name()
  File "/usr/lib/ambari-agent/lib/resource_management/libraries/functions/stack_select.py", line 109, in get_package_name
    package = get_packages(PACKAGE_SCOPE_STACK_SELECT, service_name, component_name)
  File "/usr/lib/ambari-agent/lib/resource_management/libraries/functions/stack_select.py", line 223, in get_packages
    supported_packages = get_supported_packages()
  File "/usr/lib/ambari-agent/lib/resource_management/libraries/functions/stack_select.py", line 147, in get_supported_packages
    raise Fail("Unable to query for supported packages using {0}".format(stack_selector_path))
Fail: Unable to query for supported packages using /usr/bin/hdp-select

Super Collaborator

Hi @Hemamalini Nithyanandam , can you tell me the steps that fixed the problem for you?

Explorer

Hi @asubramanian i hard coded the host in var/lib/ambari-server/resources/common-services/METRON/0.7.1/service

metronParsersHost = "hostname"
Take a Tour of the Community
Don't have an account?
Your experience may be limited. Sign in to explore more.