Execution of 'source /usr/hdp/current/oozie-server/conf/oozie-env.sh ; oozie admin -oozie http://my-server:11000/oozie -status' returned 127​

[#1]

stderr: /var/lib/ambari-agent/data/errors-1156.txt

Traceback (most recent call last):
  File "/var/lib/ambari-agent/cache/common-services/OOZIE/4.0.0.2.0/package/scripts/oozie_server.py", line 215, in <module>
    OozieServer().execute()
  File "/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py", line 280, in execute
    method(env)
  File "/var/lib/ambari-agent/cache/common-services/OOZIE/4.0.0.2.0/package/scripts/oozie_server.py", line 88, in start
    self.configure(env)
  File "/var/lib/ambari-agent/cache/common-services/OOZIE/4.0.0.2.0/package/scripts/oozie_server.py", line 82, in configure
    oozie(is_server=True)
  File "/usr/lib/python2.6/site-packages/ambari_commons/os_family_impl.py", line 89, in thunk
    return fn(*args, **kwargs)
  File "/u01/bdcsce/var/lib/ambari-agent/cache/common-services/OOZIE/4.0.0.2.0/package/scripts/oozie.py", line 185, in oozie
    oozie_server_specific()
  File "/u01/bdcsce/var/lib/ambari-agent/cache/common-services/OOZIE/4.0.0.2.0/package/scripts/oozie.py", line 240, in oozie_server_specific
    sudo = True,
  File "/usr/lib/python2.6/site-packages/resource_management/core/base.py", line 155, in __init__
    self.env.run()
  File "/usr/lib/python2.6/site-packages/resource_management/core/environment.py", line 160, in run
    self.run_action(resource, action)
  File "/usr/lib/python2.6/site-packages/resource_management/core/environment.py", line 124, in run_action
    provider_action()
  File "/usr/lib/python2.6/site-packages/resource_management/core/providers/system.py", line 273, in action_run
    tries=self.resource.tries, try_sleep=self.resource.try_sleep)
  File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", line 70, in inner
    result = function(command, **kwargs)
  File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", line 92, in checked_call
    tries=tries, try_sleep=try_sleep)
  File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", line 140, in _call_wrapper
    result = _call(command, **kwargs_copy)
  File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", line 293, in _call
    raise ExecutionFailed(err_msg, code, out, err)
resource_management.core.exceptions.ExecutionFailed: Execution of 'tar -xvf /usr/hdp/current/oozie-server/oozie-sharelib.tar.gz -C /usr/hdp/current/oozie-server' returned 2. tar: /usr/hdp/current/oozie-server/oozie-sharelib.tar.gz: Cannot open: No such file or directory
tar: Error is not recoverable: exiting now

stdout: /var/lib/ambari-agent/data/output-1156.txt

2018-10-03 17:41:32,837 - The hadoop conf dir /usr/hdp/current/hadoop-client/conf exists, will call conf-select on it for version 2.4.2.0-258
2018-10-03 17:41:32,838 - Checking if need to create versioned conf dir /etc/hadoop/2.4.2.0-258/0
2018-10-03 17:41:32,838 - call[('ambari-python-wrap', '/usr/bin/conf-select', 'create-conf-dir', '--package', 'hadoop', '--stack-version', '2.4.2.0-258', '--conf-version', '0')] {'logoutput': False, 'sudo': True, 'quiet': False, 'stderr': -1}
2018-10-03 17:41:32,861 - call returned (1, '/etc/hadoop/2.4.2.0-258/0 exist already', '')
2018-10-03 17:41:32,861 - checked_call[('ambari-python-wrap', '/usr/bin/conf-select', 'set-conf-dir', '--package', 'hadoop', '--stack-version', '2.4.2.0-258', '--conf-version', '0')] {'logoutput': False, 'sudo': True, 'quiet': False}
2018-10-03 17:41:32,884 - checked_call returned (0, '')
2018-10-03 17:41:32,884 - Ensuring that hadoop has the correct symlink structure
2018-10-03 17:41:32,884 - Using hadoop conf dir: /usr/hdp/current/hadoop-client/conf
2018-10-03 17:41:33,007 - The hadoop conf dir /usr/hdp/current/hadoop-client/conf exists, will call conf-select on it for version 2.4.2.0-258
2018-10-03 17:41:33,008 - Checking if need to create versioned conf dir /etc/hadoop/2.4.2.0-258/0
2018-10-03 17:41:33,008 - call[('ambari-python-wrap', '/usr/bin/conf-select', 'create-conf-dir', '--package', 'hadoop', '--stack-version', '2.4.2.0-258', '--conf-version', '0')] {'logoutput': False, 'sudo': True, 'quiet': False, 'stderr': -1}
2018-10-03 17:41:33,031 - call returned (1, '/etc/hadoop/2.4.2.0-258/0 exist already', '')
2018-10-03 17:41:33,031 - checked_call[('ambari-python-wrap', '/usr/bin/conf-select', 'set-conf-dir', '--package', 'hadoop', '--stack-version', '2.4.2.0-258', '--conf-version', '0')] {'logoutput': False, 'sudo': True, 'quiet': False}
2018-10-03 17:41:33,053 - checked_call returned (0, '')
2018-10-03 17:41:33,054 - Ensuring that hadoop has the correct symlink structure
2018-10-03 17:41:33,054 - Using hadoop conf dir: /usr/hdp/current/hadoop-client/conf
2018-10-03 17:41:33,055 - Skipping creation of User and Group as host is sys prepped or ignore_groupsusers_create flag is on
2018-10-03 17:41:33,055 - Skipping setting dfs cluster admin and tez view acls as host is sys prepped
2018-10-03 17:41:33,055 - FS Type: 
2018-10-03 17:41:33,055 - Directory['/etc/hadoop'] {'mode': 0755}
2018-10-03 17:41:33,071 - File['/usr/hdp/current/hadoop-client/conf/hadoop-env.sh'] {'content': InlineTemplate(...), 'owner': 'hdfs', 'group': 'hadoop'}
2018-10-03 17:41:33,072 - Directory['/var/lib/ambari-agent/tmp/hadoop_java_io_tmpdir'] {'owner': 'hdfs', 'group': 'hadoop', 'mode': 01777}
2018-10-03 17:41:33,087 - Execute[('setenforce', '0')] {'not_if': '(! which getenforce ) || (which getenforce && getenforce | grep -q Disabled)', 'sudo': True, 'only_if': 'test -f /selinux/enforce'}
2018-10-03 17:41:33,093 - Skipping Execute[('setenforce', '0')] due to not_if
2018-10-03 17:41:33,094 - Directory['/data/var/log/hadoop'] {'owner': 'root', 'create_parents': True, 'group': 'hadoop', 'mode': 0775, 'cd_access': 'a'}
2018-10-03 17:41:33,096 - Directory['/var/run/hadoop'] {'owner': 'root', 'create_parents': True, 'group': 'root', 'cd_access': 'a'}
2018-10-03 17:41:33,096 - Directory['/tmp/hadoop-hdfs'] {'owner': 'hdfs', 'create_parents': True, 'cd_access': 'a'}
Skipping copying of fast-hdfs-resource.jar as host is sys prepped
2018-10-03 17:41:33,100 - File['/usr/hdp/current/hadoop-client/conf/commons-logging.properties'] {'content': Template('commons-logging.properties.j2'), 'owner': 'hdfs'}
2018-10-03 17:41:33,102 - File['/usr/hdp/current/hadoop-client/conf/health_check'] {'content': Template('health_check.j2'), 'owner': 'hdfs'}
2018-10-03 17:41:33,103 - File['/usr/hdp/current/hadoop-client/conf/log4j.properties'] {'content': ..., 'owner': 'hdfs', 'group': 'hadoop', 'mode': 0644}
2018-10-03 17:41:33,116 - File['/usr/hdp/current/hadoop-client/conf/hadoop-metrics2.properties'] {'content': Template('hadoop-metrics2.properties.j2'), 'owner': 'hdfs', 'group': 'hadoop'}
2018-10-03 17:41:33,117 - File['/usr/hdp/current/hadoop-client/conf/task-log4j.properties'] {'content': StaticFile('task-log4j.properties'), 'mode': 0755}
2018-10-03 17:41:33,121 - File['/etc/hadoop/conf/topology_mappings.data'] {'owner': 'hdfs', 'content': Template('topology_mappings.data.j2'), 'only_if': 'test -d /etc/hadoop/conf', 'group': 'hadoop'}
2018-10-03 17:41:33,125 - File['/etc/hadoop/conf/topology_script.py'] {'content': StaticFile('topology_script.py'), 'only_if': 'test -d /etc/hadoop/conf', 'mode': 0755}
2018-10-03 17:41:33,364 - The hadoop conf dir /usr/hdp/current/hadoop-client/conf exists, will call conf-select on it for version 2.4.2.0-258
2018-10-03 17:41:33,364 - Checking if need to create versioned conf dir /etc/hadoop/2.4.2.0-258/0
2018-10-03 17:41:33,365 - call[('ambari-python-wrap', '/usr/bin/conf-select', 'create-conf-dir', '--package', 'hadoop', '--stack-version', '2.4.2.0-258', '--conf-version', '0')] {'logoutput': False, 'sudo': True, 'quiet': False, 'stderr': -1}
2018-10-03 17:41:33,417 - call returned (1, '/etc/hadoop/2.4.2.0-258/0 exist already', '')
2018-10-03 17:41:33,417 - checked_call[('ambari-python-wrap', '/usr/bin/conf-select', 'set-conf-dir', '--package', 'hadoop', '--stack-version', '2.4.2.0-258', '--conf-version', '0')] {'logoutput': False, 'sudo': True, 'quiet': False}
2018-10-03 17:41:33,439 - checked_call returned (0, '')
2018-10-03 17:41:33,440 - Ensuring that hadoop has the correct symlink structure
2018-10-03 17:41:33,440 - Using hadoop conf dir: /usr/hdp/current/hadoop-client/conf
2018-10-03 17:41:33,455 - checked_call['rpm -q --queryformat '%{version}-%{release}' hdp-select | sed -e 's/\.el[0-9]//g''] {'stderr': -1}
2018-10-03 17:41:33,502 - checked_call returned (0, 'package hdp-select is not installed', '')
2018-10-03 17:41:33,506 - HdfsResource['/user/oozie'] {'security_enabled': False, 'hadoop_bin_dir': '/usr/hdp/current/hadoop-client/bin', 'keytab': [EMPTY], 'dfs_type': '', 'default_fs': 'hdfs://bigdatatest-bdcsce-1.compute-590737110.oraclecloud.internal:8020', 'hdfs_resource_ignore_file': '/var/lib/ambari-agent/data/.hdfs_resource_ignore', 'hdfs_site': ..., 'kinit_path_local': '/usr/bin/kinit', 'principal_name': [EMPTY], 'user': 'hdfs', 'owner': 'oozie', 'hadoop_conf_dir': '/usr/hdp/current/hadoop-client/conf', 'type': 'directory', 'action': ['create_on_execute'], 'immutable_paths': [u'/data/app-logs', u'/apps/hive/warehouse', u'/mr-history/done', u'/tmp'], 'mode': 0775}
2018-10-03 17:41:33,508 - call['ambari-sudo.sh su hdfs -l -s /bin/bash -c 'curl -sS -L -w '"'"'%{http_code}'"'"' -X GET '"'"'http://bigdatatest-bdcsce-1.compute-590737110.oraclecloud.internal:50070/webhdfs/v1/user/oozie?op=GETFILESTATUS&user.name=hdfs'"'"' 1>/tmp/tmpNLhu2a 2>/tmp/tmpZxgVZV''] {'logoutput': None, 'quiet': False}
2018-10-03 17:41:33,548 - call returned (0, '')
2018-10-03 17:41:33,550 - HdfsResource[None] {'security_enabled': False, 'hadoop_bin_dir': '/usr/hdp/current/hadoop-client/bin', 'keytab': [EMPTY], 'dfs_type': '', 'default_fs': 'hdfs://bigdatatest-bdcsce-1.compute-590737110.oraclecloud.internal:8020', 'hdfs_resource_ignore_file': '/var/lib/ambari-agent/data/.hdfs_resource_ignore', 'hdfs_site': ..., 'kinit_path_local': '/usr/bin/kinit', 'principal_name': [EMPTY], 'user': 'hdfs', 'action': ['execute'], 'hadoop_conf_dir': '/usr/hdp/current/hadoop-client/conf', 'immutable_paths': [u'/data/app-logs', u'/apps/hive/warehouse', u'/mr-history/done', u'/tmp']}
2018-10-03 17:41:33,551 - Directory['/usr/hdp/current/oozie-server/conf'] {'owner': 'oozie', 'create_parents': True, 'group': 'hadoop'}
2018-10-03 17:41:33,552 - XmlConfig['oozie-site.xml'] {'group': 'hadoop', 'conf_dir': '/usr/hdp/current/oozie-server/conf', 'mode': 0664, 'configuration_attributes': {}, 'owner': 'oozie', 'configurations': ...}
2018-10-03 17:41:33,563 - Generating config: /usr/hdp/current/oozie-server/conf/oozie-site.xml
2018-10-03 17:41:33,564 - File['/usr/hdp/current/oozie-server/conf/oozie-site.xml'] {'owner': 'oozie', 'content': InlineTemplate(...), 'group': 'hadoop', 'mode': 0664, 'encoding': 'UTF-8'}
2018-10-03 17:41:33,581 - File['/usr/hdp/current/oozie-server/conf/oozie-env.sh'] {'content': InlineTemplate(...), 'owner': 'oozie', 'group': 'hadoop'}
2018-10-03 17:41:33,581 - Writing File['/usr/hdp/current/oozie-server/conf/oozie-env.sh'] because contents don't match
2018-10-03 17:41:33,582 - Directory['/etc/security/limits.d'] {'owner': 'root', 'create_parents': True, 'group': 'root'}
2018-10-03 17:41:33,585 - File['/etc/security/limits.d/oozie.conf'] {'content': Template('oozie.conf.j2'), 'owner': 'root', 'group': 'root', 'mode': 0644}
2018-10-03 17:41:33,586 - File['/usr/hdp/current/oozie-server/conf/oozie-log4j.properties'] {'content': ..., 'owner': 'oozie', 'group': 'hadoop', 'mode': 0644}
2018-10-03 17:41:33,589 - File['/usr/hdp/current/oozie-server/conf/adminusers.txt'] {'content': Template('adminusers.txt.j2'), 'owner': 'oozie', 'group': 'hadoop', 'mode': 0644}
2018-10-03 17:41:33,590 - File['/usr/hdp/current/oozie-server/conf/hadoop-config.xml'] {'owner': 'oozie', 'group': 'hadoop'}
2018-10-03 17:41:33,590 - File['/usr/hdp/current/oozie-server/conf/oozie-default.xml'] {'owner': 'oozie', 'group': 'hadoop'}
2018-10-03 17:41:33,591 - Directory['/usr/hdp/current/oozie-server/conf/action-conf'] {'owner': 'oozie', 'group': 'hadoop'}
2018-10-03 17:41:33,591 - File['/usr/hdp/current/oozie-server/conf/action-conf/hive.xml'] {'owner': 'oozie', 'group': 'hadoop'}
2018-10-03 17:41:33,592 - File['/var/run/oozie/oozie.pid'] {'action': ['delete'], 'not_if': "ambari-sudo.sh su oozie -l -s /bin/bash -c 'ls /var/run/oozie/oozie.pid >/dev/null 2>&1 && ps -p `cat /var/run/oozie/oozie.pid` >/dev/null 2>&1'"}
2018-10-03 17:41:33,621 - Directory['/usr/hdp/current/oozie-server//var/tmp/oozie'] {'owner': 'oozie', 'create_parents': True, 'group': 'hadoop', 'mode': 0755, 'cd_access': 'a'}
2018-10-03 17:41:33,623 - Directory['/var/run/oozie'] {'owner': 'oozie', 'create_parents': True, 'group': 'hadoop', 'mode': 0755, 'cd_access': 'a'}
2018-10-03 17:41:33,624 - Directory['/var/log/oozie'] {'owner': 'oozie', 'create_parents': True, 'group': 'hadoop', 'mode': 0755, 'cd_access': 'a'}
2018-10-03 17:41:33,625 - Directory['/var/tmp/oozie'] {'owner': 'oozie', 'create_parents': True, 'group': 'hadoop', 'mode': 0755, 'cd_access': 'a'}
2018-10-03 17:41:33,626 - Directory['/u01/app/oracle/tools/hadoop/oozie/data'] {'owner': 'oozie', 'create_parents': True, 'group': 'hadoop', 'mode': 0755, 'cd_access': 'a'}
2018-10-03 17:41:33,627 - Directory['/usr/hdp/current/oozie-server'] {'owner': 'oozie', 'create_parents': True, 'group': 'hadoop', 'mode': 0755, 'cd_access': 'a'}
2018-10-03 17:41:33,628 - Directory['/usr/hdp/current/oozie-server/oozie-server/webapps'] {'owner': 'oozie', 'create_parents': True, 'group': 'hadoop', 'mode': 0755, 'cd_access': 'a'}
2018-10-03 17:41:33,629 - Directory['/usr/hdp/current/oozie-server/oozie-server/conf'] {'owner': 'oozie', 'create_parents': True, 'group': 'hadoop', 'mode': 0755, 'cd_access': 'a'}
2018-10-03 17:41:33,630 - Directory['/usr/hdp/current/oozie-server/oozie-server'] {'owner': 'oozie', 'group': 'hadoop', 'create_parents': True, 'mode': 0755, 'cd_access': 'a'}
2018-10-03 17:41:33,631 - Directory['/usr/hdp/current/oozie-server/libext'] {'create_parents': True}
2018-10-03 17:41:33,632 - Execute[('tar', '-xvf', '/usr/hdp/current/oozie-server/oozie-sharelib.tar.gz', '-C', '/usr/hdp/current/oozie-server')] {'not_if': "ambari-sudo.sh su oozie -l -s /bin/bash -c 'ls /var/run/oozie/oozie.pid >/dev/null 2>&1 && ps -p `cat /var/run/oozie/oozie.pid` >/dev/null 2>&1' || test -f /usr/hdp/current/oozie-server/.hashcode && test -d /usr/hdp/current/oozie-server/share", 'sudo': True}

Command failed after 1 tries

[#2]

@jose teran

- Can you please check if the following TAR exist on your oozie host? If the follopwing file does not exist in your file system then it indicates that your Oozie installation might not be done properly. Please try Reinstalling Oozie in that case.

# ls -l /usr/hdp/current/oozie-server/oozie-sharelib.tar.gz
-rw-r--r--. 1 root root 407386409 Apr 12 07:50 /usr/hdp/current/oozie-server/oozie-sharelib.tar.gz

.

- If the above file exist but still if you see the mentioned error then can you please check if you have setup Oozie Sharedlib as mentioned in the following doc?

https://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.4.2/bk_upgrading_hdp_manually/content/start-ooz...

# cd /usr/hdp/2.4.2.0-258/oozie
# tar xzvf /usr/hdp/2.4.2.0-258/oozie/oozie-sharelib.tar.gz
# su - hdfs -c "hdfs dfs -mkdir -p /user/oozie"
# su - hdfs -c "hdfs dfs -copyFromLocal /usr/hdp/current/oozie/share /user/oozie/."

.

OR in later versions

>>>> Extract share-lib.
# /usr/hdp/current/oozie/bin/oozie-setup.sh sharelib create -fs  hdfs://<namenode>:8020

>>>> To verify that the sharelibs extracted correctly, run the following command:
# oozie admin -oozie http://<oozie server host address>:11000/oozie -shareliblist

.

[#3]

The file oozie-sharelib.tar.gz is not on my file system. I am running the add service from ambari UI.