Support Questions

Find answers, ask questions, and share your expertise

Getting error while installing "YARN+MAPREDUCE"

Explorer

@Jay Kumar SenSharma @Geoffrey Shelton Okot

I installed laterversion of HDP 3.0 and Ambari 2.7

Please help on this error.

stderr:

Traceback (most recent call last):
  File "/var/lib/ambari-agent/cache/stack-hooks/before-ANY/scripts/hook.py", line 35, in 
    BeforeAnyHook().execute()
  File "/usr/lib/ambari-agent/lib/resource_management/libraries/script/script.py", line 353, in execute
    method(env)
  File "/var/lib/ambari-agent/cache/stack-hooks/before-ANY/scripts/hook.py", line 29, in hook
    setup_users()
  File "/var/lib/ambari-agent/cache/stack-hooks/before-ANY/scripts/shared_initialization.py", line 51, in setup_users
    fetch_nonlocal_groups = params.fetch_nonlocal_groups,
  File "/usr/lib/ambari-agent/lib/resource_management/core/base.py", line 166, in __init__
    self.env.run()
  File "/usr/lib/ambari-agent/lib/resource_management/core/environment.py", line 160, in run
    self.run_action(resource, action)
  File "/usr/lib/ambari-agent/lib/resource_management/core/environment.py", line 124, in run_action
    provider_action()
  File "/usr/lib/ambari-agent/lib/resource_management/core/providers/accounts.py", line 90, in action_create
    shell.checked_call(command, sudo=True)
  File "/usr/lib/ambari-agent/lib/resource_management/core/shell.py", line 72, in inner
    result = function(command, **kwargs)
  File "/usr/lib/ambari-agent/lib/resource_management/core/shell.py", line 102, in checked_call
    tries=tries, try_sleep=try_sleep, timeout_kill_strategy=timeout_kill_strategy, returns=returns)
  File "/usr/lib/ambari-agent/lib/resource_management/core/shell.py", line 150, in _call_wrapper
    result = _call(command, **kwargs_copy)
  File "/usr/lib/ambari-agent/lib/resource_management/core/shell.py", line 314, in _call
    raise ExecutionFailed(err_msg, code, out, err)
resource_management.core.exceptions.ExecutionFailed: Execution of 'useradd -m -G hadoop -g hadoop yarn-ats' returned 1. useradd: existing lock file /etc/passwd.lock without a PID
useradd: cannot lock /etc/passwd; try again later.
Error: Error: Unable to run the custom hook script ['/usr/bin/python', '/var/lib/ambari-agent/cache/stack-hooks/before-ANY/scripts/hook.py', 'ANY', '/var/lib/ambari-agent/data/command-198.json', '/var/lib/ambari-agent/cache/stack-hooks/before-ANY', '/var/lib/ambari-agent/data/structured-out-198.json', 'INFO', '/var/lib/ambari-agent/tmp', 'PROTOCOL_TLSv1_2', '']
 stdout:
2018-08-01 10:49:04,734 - Stack Feature Version Info: Cluster Stack=3.0, Command Stack=None, Command Version=None -> 3.0
2018-08-01 10:49:04,760 - Using hadoop conf dir: /usr/hdp/3.0.0.0-1634/hadoop/conf
2018-08-01 10:49:04,762 - Group['hdfs'] {}
2018-08-01 10:49:04,764 - Group['hadoop'] {}
2018-08-01 10:49:04,765 - Group['users'] {}
2018-08-01 10:49:04,765 - User['yarn-ats'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': ['hadoop'], 'uid': None}
2018-08-01 10:49:04,766 - Adding user User['yarn-ats']
Error: Error: Unable to run the custom hook script ['/usr/bin/python', '/var/lib/ambari-agent/cache/stack-hooks/before-ANY/scripts/hook.py', 'ANY', '/var/lib/ambari-agent/data/command-198.json', '/var/lib/ambari-agent/cache/stack-hooks/before-ANY', '/var/lib/ambari-agent/data/structured-out-198.json', 'INFO', '/var/lib/ambari-agent/tmp', 'PROTOCOL_TLSv1_2', '']
2018-08-01 10:49:04,811 - The repository with version 3.0.0.0-1634 for this command has been marked as resolved. It will be used to report the version of the component which was installed

Command failed after 1 tries
8 REPLIES 8

Mentor

@Lokesh Mukku

Have you totally failed to install all the components of new HDP3.0 or only YARN and MR?
Please, can you elaborate OS, whether a fresh installation or upgrade etc.

Explorer

Thanks for you replying..!!

Yesterday I installed ambari 3.0 version and HDP 2.7 on centos 7.

Cluster size is 5 nodes (2 master nodes & 3 salves)

Today i started to add a service MR+YARN getting error " Unable to Unable to run the custom hook script "

Till i did not added any service

Explorer

Fresh Installation on Centos 7

Explorer

Please check below

85467-hdpca-error.png

Explorer

@Geoffrey Shelton Okot Hello Sir any update???

Mentor

@Lokesh Mukku

Can you share the error stack trace click for details on "Failure encountered" on master2? What components did you install previously?

Explorer

Please check all attachments

85468-timelineserver.png

85469-error-1.png

85470-error-2.png

Explorer

Did u find any solution?