I am trying to install oozie 4.2.0.2.4 on version HDP 2.4.2.0 cluster. I am following the steps mentioned on Hortonworks documentation. When running the following command: /usr/hdp/current/oozie-server/bin/ooziedb.sh create -sqlfile /tmp/oozie.sql -run I get the following error: Validate DB Connection SLF4J: Class path contains multiple SLF4J bindings. SLF4J: Found binding in [jar:file:/u01/bdcsce/usr/hdp/2.4.2.0-258/oozie/libserver/slf4j-log4j12-1.6.6.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: Found binding in [jar:file:/u01/bdcsce/usr/hdp/2.4.2.0-258/oozie/lib/slf4j-simple-1.6.6.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation. SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory] Error: Could not connect to the database: java.lang.NullPointerException Stack trace for the error was (for debug purposes): -------------------------------------- java.lang.Exception: Could not connect to the database: java.lang.NullPointerException at org.apache.oozie.tools.OozieDBCLI.validateConnection(OozieDBCLI.java:955) at org.apache.oozie.tools.OozieDBCLI.createDB(OozieDBCLI.java:190) at org.apache.oozie.tools.OozieDBCLI.run(OozieDBCLI.java:128) at org.apache.oozie.tools.OozieDBCLI.main(OozieDBCLI.java:79) Caused by: java.lang.NullPointerException at org.apache.hadoop.hdfs.DFSClient.getLocalInterfaceAddrs(DFSClient.java:738) at org.apache.hadoop.hdfs.DFSClient.<init>(DFSClient.java:686) at org.apache.hadoop.hdfs.DFSClient.<init>(DFSClient.java:619) at org.apache.hadoop.hdfs.DistributedFileSystem.initialize(DistributedFileSystem.java:150) at org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:2653) at org.apache.hadoop.fs.FileSystem.access$200(FileSystem.java:92) at org.apache.hadoop.fs.FileSystem$Cache.getInternal(FileSystem.java:2687) at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:2669) at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:371) at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:362) at org.apache.hadoop.fs.Path.getFileSystem(Path.java:295) at org.apache.hadoop.security.alias.JavaKeyStoreProvider.initFileSystem(JavaKeyStoreProvider.java:89) at org.apache.hadoop.security.alias.AbstractJavaKeyStoreProvider.<init>(AbstractJavaKeyStoreProvider.java:84) at org.apache.hadoop.security.alias.JavaKeyStoreProvider.<init>(JavaKeyStoreProvider.java:49) at org.apache.hadoop.security.alias.JavaKeyStoreProvider.<init>(JavaKeyStoreProvider.java:41) at org.apache.hadoop.security.alias.JavaKeyStoreProvider$Factory.createProvider(JavaKeyStoreProvider.java:100) at org.apache.hadoop.security.alias.CredentialProviderFactory.getProviders(CredentialProviderFactory.java:58) at org.apache.hadoop.conf.Configuration.getPasswordFromCredentialProviders(Configuration.java:1946) at org.apache.hadoop.conf.Configuration.getPassword(Configuration.java:1926) at org.apache.oozie.service.HadoopAccessorService.getPasswordFromHadoopConf(HadoopAccessorService.java:426) at org.apache.oozie.tools.OozieDBCLI.getJdbcConf(OozieDBCLI.java:178) at org.apache.oozie.tools.OozieDBCLI.createConnection(OozieDBCLI.java:943) at org.apache.oozie.tools.OozieDBCLI.validateConnection(OozieDBCLI.java:951) ... 3 more -------------------------------------- ... View more

stderr: /var/lib/ambari-agent/data/errors-1156.txt Traceback (most recent call last): File "/var/lib/ambari-agent/cache/common-services/OOZIE/4.0.0.2.0/package/scripts/oozie_server.py", line 215, in <module> OozieServer().execute() File "/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py", line 280, in execute method(env) File "/var/lib/ambari-agent/cache/common-services/OOZIE/4.0.0.2.0/package/scripts/oozie_server.py", line 88, in start self.configure(env) File "/var/lib/ambari-agent/cache/common-services/OOZIE/4.0.0.2.0/package/scripts/oozie_server.py", line 82, in configure oozie(is_server=True) File "/usr/lib/python2.6/site-packages/ambari_commons/os_family_impl.py", line 89, in thunk return fn(*args, **kwargs) File "/u01/bdcsce/var/lib/ambari-agent/cache/common-services/OOZIE/4.0.0.2.0/package/scripts/oozie.py", line 185, in oozie oozie_server_specific() File "/u01/bdcsce/var/lib/ambari-agent/cache/common-services/OOZIE/4.0.0.2.0/package/scripts/oozie.py", line 240, in oozie_server_specific sudo = True, File "/usr/lib/python2.6/site-packages/resource_management/core/base.py", line 155, in __init__ self.env.run() File "/usr/lib/python2.6/site-packages/resource_management/core/environment.py", line 160, in run self.run_action(resource, action) File "/usr/lib/python2.6/site-packages/resource_management/core/environment.py", line 124, in run_action provider_action() File "/usr/lib/python2.6/site-packages/resource_management/core/providers/system.py", line 273, in action_run tries=self.resource.tries, try_sleep=self.resource.try_sleep) File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", line 70, in inner result = function(command, **kwargs) File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", line 92, in checked_call tries=tries, try_sleep=try_sleep) File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", line 140, in _call_wrapper result = _call(command, **kwargs_copy) File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", line 293, in _call raise ExecutionFailed(err_msg, code, out, err) resource_management.core.exceptions.ExecutionFailed: Execution of 'tar -xvf /usr/hdp/current/oozie-server/oozie-sharelib.tar.gz -C /usr/hdp/current/oozie-server' returned 2. tar: /usr/hdp/current/oozie-server/oozie-sharelib.tar.gz: Cannot open: No such file or directory tar: Error is not recoverable: exiting now stdout: /var/lib/ambari-agent/data/output-1156.txt 2018-10-03 17:41:32,837 - The hadoop conf dir /usr/hdp/current/hadoop-client/conf exists, will call conf-select on it for version 2.4.2.0-258 2018-10-03 17:41:32,838 - Checking if need to create versioned conf dir /etc/hadoop/2.4.2.0-258/0 2018-10-03 17:41:32,838 - call[('ambari-python-wrap', '/usr/bin/conf-select', 'create-conf-dir', '--package', 'hadoop', '--stack-version', '2.4.2.0-258', '--conf-version', '0')] {'logoutput': False, 'sudo': True, 'quiet': False, 'stderr': -1} 2018-10-03 17:41:32,861 - call returned (1, '/etc/hadoop/2.4.2.0-258/0 exist already', '') 2018-10-03 17:41:32,861 - checked_call[('ambari-python-wrap', '/usr/bin/conf-select', 'set-conf-dir', '--package', 'hadoop', '--stack-version', '2.4.2.0-258', '--conf-version', '0')] {'logoutput': False, 'sudo': True, 'quiet': False} 2018-10-03 17:41:32,884 - checked_call returned (0, '') 2018-10-03 17:41:32,884 - Ensuring that hadoop has the correct symlink structure 2018-10-03 17:41:32,884 - Using hadoop conf dir: /usr/hdp/current/hadoop-client/conf 2018-10-03 17:41:33,007 - The hadoop conf dir /usr/hdp/current/hadoop-client/conf exists, will call conf-select on it for version 2.4.2.0-258 2018-10-03 17:41:33,008 - Checking if need to create versioned conf dir /etc/hadoop/2.4.2.0-258/0 2018-10-03 17:41:33,008 - call[('ambari-python-wrap', '/usr/bin/conf-select', 'create-conf-dir', '--package', 'hadoop', '--stack-version', '2.4.2.0-258', '--conf-version', '0')] {'logoutput': False, 'sudo': True, 'quiet': False, 'stderr': -1} 2018-10-03 17:41:33,031 - call returned (1, '/etc/hadoop/2.4.2.0-258/0 exist already', '') 2018-10-03 17:41:33,031 - checked_call[('ambari-python-wrap', '/usr/bin/conf-select', 'set-conf-dir', '--package', 'hadoop', '--stack-version', '2.4.2.0-258', '--conf-version', '0')] {'logoutput': False, 'sudo': True, 'quiet': False} 2018-10-03 17:41:33,053 - checked_call returned (0, '') 2018-10-03 17:41:33,054 - Ensuring that hadoop has the correct symlink structure 2018-10-03 17:41:33,054 - Using hadoop conf dir: /usr/hdp/current/hadoop-client/conf 2018-10-03 17:41:33,055 - Skipping creation of User and Group as host is sys prepped or ignore_groupsusers_create flag is on 2018-10-03 17:41:33,055 - Skipping setting dfs cluster admin and tez view acls as host is sys prepped 2018-10-03 17:41:33,055 - FS Type: 2018-10-03 17:41:33,055 - Directory['/etc/hadoop'] {'mode': 0755} 2018-10-03 17:41:33,071 - File['/usr/hdp/current/hadoop-client/conf/hadoop-env.sh'] {'content': InlineTemplate(...), 'owner': 'hdfs', 'group': 'hadoop'} 2018-10-03 17:41:33,072 - Directory['/var/lib/ambari-agent/tmp/hadoop_java_io_tmpdir'] {'owner': 'hdfs', 'group': 'hadoop', 'mode': 01777} 2018-10-03 17:41:33,087 - Execute[('setenforce', '0')] {'not_if': '(! which getenforce ) || (which getenforce && getenforce | grep -q Disabled)', 'sudo': True, 'only_if': 'test -f /selinux/enforce'} 2018-10-03 17:41:33,093 - Skipping Execute[('setenforce', '0')] due to not_if 2018-10-03 17:41:33,094 - Directory['/data/var/log/hadoop'] {'owner': 'root', 'create_parents': True, 'group': 'hadoop', 'mode': 0775, 'cd_access': 'a'} 2018-10-03 17:41:33,096 - Directory['/var/run/hadoop'] {'owner': 'root', 'create_parents': True, 'group': 'root', 'cd_access': 'a'} 2018-10-03 17:41:33,096 - Directory['/tmp/hadoop-hdfs'] {'owner': 'hdfs', 'create_parents': True, 'cd_access': 'a'} Skipping copying of fast-hdfs-resource.jar as host is sys prepped 2018-10-03 17:41:33,100 - File['/usr/hdp/current/hadoop-client/conf/commons-logging.properties'] {'content': Template('commons-logging.properties.j2'), 'owner': 'hdfs'} 2018-10-03 17:41:33,102 - File['/usr/hdp/current/hadoop-client/conf/health_check'] {'content': Template('health_check.j2'), 'owner': 'hdfs'} 2018-10-03 17:41:33,103 - File['/usr/hdp/current/hadoop-client/conf/log4j.properties'] {'content': ..., 'owner': 'hdfs', 'group': 'hadoop', 'mode': 0644} 2018-10-03 17:41:33,116 - File['/usr/hdp/current/hadoop-client/conf/hadoop-metrics2.properties'] {'content': Template('hadoop-metrics2.properties.j2'), 'owner': 'hdfs', 'group': 'hadoop'} 2018-10-03 17:41:33,117 - File['/usr/hdp/current/hadoop-client/conf/task-log4j.properties'] {'content': StaticFile('task-log4j.properties'), 'mode': 0755} 2018-10-03 17:41:33,121 - File['/etc/hadoop/conf/topology_mappings.data'] {'owner': 'hdfs', 'content': Template('topology_mappings.data.j2'), 'only_if': 'test -d /etc/hadoop/conf', 'group': 'hadoop'} 2018-10-03 17:41:33,125 - File['/etc/hadoop/conf/topology_script.py'] {'content': StaticFile('topology_script.py'), 'only_if': 'test -d /etc/hadoop/conf', 'mode': 0755} 2018-10-03 17:41:33,364 - The hadoop conf dir /usr/hdp/current/hadoop-client/conf exists, will call conf-select on it for version 2.4.2.0-258 2018-10-03 17:41:33,364 - Checking if need to create versioned conf dir /etc/hadoop/2.4.2.0-258/0 2018-10-03 17:41:33,365 - call[('ambari-python-wrap', '/usr/bin/conf-select', 'create-conf-dir', '--package', 'hadoop', '--stack-version', '2.4.2.0-258', '--conf-version', '0')] {'logoutput': False, 'sudo': True, 'quiet': False, 'stderr': -1} 2018-10-03 17:41:33,417 - call returned (1, '/etc/hadoop/2.4.2.0-258/0 exist already', '') 2018-10-03 17:41:33,417 - checked_call[('ambari-python-wrap', '/usr/bin/conf-select', 'set-conf-dir', '--package', 'hadoop', '--stack-version', '2.4.2.0-258', '--conf-version', '0')] {'logoutput': False, 'sudo': True, 'quiet': False} 2018-10-03 17:41:33,439 - checked_call returned (0, '') 2018-10-03 17:41:33,440 - Ensuring that hadoop has the correct symlink structure 2018-10-03 17:41:33,440 - Using hadoop conf dir: /usr/hdp/current/hadoop-client/conf 2018-10-03 17:41:33,455 - checked_call['rpm -q --queryformat '%{version}-%{release}' hdp-select | sed -e 's/\.el[0-9]//g''] {'stderr': -1} 2018-10-03 17:41:33,502 - checked_call returned (0, 'package hdp-select is not installed', '') 2018-10-03 17:41:33,506 - HdfsResource['/user/oozie'] {'security_enabled': False, 'hadoop_bin_dir': '/usr/hdp/current/hadoop-client/bin', 'keytab': [EMPTY], 'dfs_type': '', 'default_fs': 'hdfs://bigdatatest-bdcsce-1.compute-590737110.oraclecloud.internal:8020', 'hdfs_resource_ignore_file': '/var/lib/ambari-agent/data/.hdfs_resource_ignore', 'hdfs_site': ..., 'kinit_path_local': '/usr/bin/kinit', 'principal_name': [EMPTY], 'user': 'hdfs', 'owner': 'oozie', 'hadoop_conf_dir': '/usr/hdp/current/hadoop-client/conf', 'type': 'directory', 'action': ['create_on_execute'], 'immutable_paths': [u'/data/app-logs', u'/apps/hive/warehouse', u'/mr-history/done', u'/tmp'], 'mode': 0775} 2018-10-03 17:41:33,508 - call['ambari-sudo.sh su hdfs -l -s /bin/bash -c 'curl -sS -L -w '"'"'%{http_code}'"'"' -X GET '"'"'http://bigdatatest-bdcsce-1.compute-590737110.oraclecloud.internal:50070/webhdfs/v1/user/oozie?op=GETFILESTATUS&user.name=hdfs'"'"' 1>/tmp/tmpNLhu2a 2>/tmp/tmpZxgVZV''] {'logoutput': None, 'quiet': False} 2018-10-03 17:41:33,548 - call returned (0, '') 2018-10-03 17:41:33,550 - HdfsResource[None] {'security_enabled': False, 'hadoop_bin_dir': '/usr/hdp/current/hadoop-client/bin', 'keytab': [EMPTY], 'dfs_type': '', 'default_fs': 'hdfs://bigdatatest-bdcsce-1.compute-590737110.oraclecloud.internal:8020', 'hdfs_resource_ignore_file': '/var/lib/ambari-agent/data/.hdfs_resource_ignore', 'hdfs_site': ..., 'kinit_path_local': '/usr/bin/kinit', 'principal_name': [EMPTY], 'user': 'hdfs', 'action': ['execute'], 'hadoop_conf_dir': '/usr/hdp/current/hadoop-client/conf', 'immutable_paths': [u'/data/app-logs', u'/apps/hive/warehouse', u'/mr-history/done', u'/tmp']} 2018-10-03 17:41:33,551 - Directory['/usr/hdp/current/oozie-server/conf'] {'owner': 'oozie', 'create_parents': True, 'group': 'hadoop'} 2018-10-03 17:41:33,552 - XmlConfig['oozie-site.xml'] {'group': 'hadoop', 'conf_dir': '/usr/hdp/current/oozie-server/conf', 'mode': 0664, 'configuration_attributes': {}, 'owner': 'oozie', 'configurations': ...} 2018-10-03 17:41:33,563 - Generating config: /usr/hdp/current/oozie-server/conf/oozie-site.xml 2018-10-03 17:41:33,564 - File['/usr/hdp/current/oozie-server/conf/oozie-site.xml'] {'owner': 'oozie', 'content': InlineTemplate(...), 'group': 'hadoop', 'mode': 0664, 'encoding': 'UTF-8'} 2018-10-03 17:41:33,581 - File['/usr/hdp/current/oozie-server/conf/oozie-env.sh'] {'content': InlineTemplate(...), 'owner': 'oozie', 'group': 'hadoop'} 2018-10-03 17:41:33,581 - Writing File['/usr/hdp/current/oozie-server/conf/oozie-env.sh'] because contents don't match 2018-10-03 17:41:33,582 - Directory['/etc/security/limits.d'] {'owner': 'root', 'create_parents': True, 'group': 'root'} 2018-10-03 17:41:33,585 - File['/etc/security/limits.d/oozie.conf'] {'content': Template('oozie.conf.j2'), 'owner': 'root', 'group': 'root', 'mode': 0644} 2018-10-03 17:41:33,586 - File['/usr/hdp/current/oozie-server/conf/oozie-log4j.properties'] {'content': ..., 'owner': 'oozie', 'group': 'hadoop', 'mode': 0644} 2018-10-03 17:41:33,589 - File['/usr/hdp/current/oozie-server/conf/adminusers.txt'] {'content': Template('adminusers.txt.j2'), 'owner': 'oozie', 'group': 'hadoop', 'mode': 0644} 2018-10-03 17:41:33,590 - File['/usr/hdp/current/oozie-server/conf/hadoop-config.xml'] {'owner': 'oozie', 'group': 'hadoop'} 2018-10-03 17:41:33,590 - File['/usr/hdp/current/oozie-server/conf/oozie-default.xml'] {'owner': 'oozie', 'group': 'hadoop'} 2018-10-03 17:41:33,591 - Directory['/usr/hdp/current/oozie-server/conf/action-conf'] {'owner': 'oozie', 'group': 'hadoop'} 2018-10-03 17:41:33,591 - File['/usr/hdp/current/oozie-server/conf/action-conf/hive.xml'] {'owner': 'oozie', 'group': 'hadoop'} 2018-10-03 17:41:33,592 - File['/var/run/oozie/oozie.pid'] {'action': ['delete'], 'not_if': "ambari-sudo.sh su oozie -l -s /bin/bash -c 'ls /var/run/oozie/oozie.pid >/dev/null 2>&1 && ps -p `cat /var/run/oozie/oozie.pid` >/dev/null 2>&1'"} 2018-10-03 17:41:33,621 - Directory['/usr/hdp/current/oozie-server//var/tmp/oozie'] {'owner': 'oozie', 'create_parents': True, 'group': 'hadoop', 'mode': 0755, 'cd_access': 'a'} 2018-10-03 17:41:33,623 - Directory['/var/run/oozie'] {'owner': 'oozie', 'create_parents': True, 'group': 'hadoop', 'mode': 0755, 'cd_access': 'a'} 2018-10-03 17:41:33,624 - Directory['/var/log/oozie'] {'owner': 'oozie', 'create_parents': True, 'group': 'hadoop', 'mode': 0755, 'cd_access': 'a'} 2018-10-03 17:41:33,625 - Directory['/var/tmp/oozie'] {'owner': 'oozie', 'create_parents': True, 'group': 'hadoop', 'mode': 0755, 'cd_access': 'a'} 2018-10-03 17:41:33,626 - Directory['/u01/app/oracle/tools/hadoop/oozie/data'] {'owner': 'oozie', 'create_parents': True, 'group': 'hadoop', 'mode': 0755, 'cd_access': 'a'} 2018-10-03 17:41:33,627 - Directory['/usr/hdp/current/oozie-server'] {'owner': 'oozie', 'create_parents': True, 'group': 'hadoop', 'mode': 0755, 'cd_access': 'a'} 2018-10-03 17:41:33,628 - Directory['/usr/hdp/current/oozie-server/oozie-server/webapps'] {'owner': 'oozie', 'create_parents': True, 'group': 'hadoop', 'mode': 0755, 'cd_access': 'a'} 2018-10-03 17:41:33,629 - Directory['/usr/hdp/current/oozie-server/oozie-server/conf'] {'owner': 'oozie', 'create_parents': True, 'group': 'hadoop', 'mode': 0755, 'cd_access': 'a'} 2018-10-03 17:41:33,630 - Directory['/usr/hdp/current/oozie-server/oozie-server'] {'owner': 'oozie', 'group': 'hadoop', 'create_parents': True, 'mode': 0755, 'cd_access': 'a'} 2018-10-03 17:41:33,631 - Directory['/usr/hdp/current/oozie-server/libext'] {'create_parents': True} 2018-10-03 17:41:33,632 - Execute[('tar', '-xvf', '/usr/hdp/current/oozie-server/oozie-sharelib.tar.gz', '-C', '/usr/hdp/current/oozie-server')] {'not_if': "ambari-sudo.sh su oozie -l -s /bin/bash -c 'ls /var/run/oozie/oozie.pid >/dev/null 2>&1 && ps -p `cat /var/run/oozie/oozie.pid` >/dev/null 2>&1' || test -f /usr/hdp/current/oozie-server/.hashcode && test -d /usr/hdp/current/oozie-server/share", 'sudo': True} Command failed after 1 tries ... View more

03 Oct 2018 21:23:16,265 ERROR [main] DBAccessorImpl:109 - Error while creating database accessor java.lang.ClassNotFoundException: com.mysql.jdbc.Driver ... View more