Created 08-13-2018 06:52 PM
I was upgrading to HDP 3.0 and keep getting a timeout error when trying to start Ranger:
Python script has been killed due to timeout after waiting 600 secs stdout: 2018-08-06 19:21:53,314 - Stack Feature Version Info: Cluster Stack=3.0, Command Stack=None, Command Version=3.0.0.0-1634, Upgrade Direction=upgrade -> 3.0.0.0-1634 2018-08-06 19:21:53,336 - Using hadoop conf dir: /usr/hdp/3.0.0.0-1634/hadoop/conf 2018-08-06 19:21:53,679 - Stack Feature Version Info: Cluster Stack=3.0, Command Stack=None, Command Version=3.0.0.0-1634, Upgrade Direction=upgrade -> 3.0.0.0-1634 2018-08-06 19:21:53,688 - Using hadoop conf dir: /usr/hdp/3.0.0.0-1634/hadoop/conf 2018-08-06 19:21:53,690 - Group['ranger'] {} 2018-08-06 19:21:53,692 - Group['hdfs'] {} 2018-08-06 19:21:53,692 - Group['hadoop'] {} 2018-08-06 19:21:53,693 - Group['users'] {} 2018-08-06 19:21:53,694 - User['yarn-ats'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': ['hadoop'], 'uid': None} 2018-08-06 19:21:53,697 - User['infra-solr'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': ['hadoop'], 'uid': None} 2018-08-06 19:21:53,699 - User['zookeeper'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': ['hadoop'], 'uid': None} 2018-08-06 19:21:53,700 - User['atlas'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': ['hadoop'], 'uid': None} 2018-08-06 19:21:53,702 - User['ams'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': ['hadoop'], 'uid': None} 2018-08-06 19:21:53,703 - User['ranger'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': ['ranger', 'hadoop'], 'uid': None} 2018-08-06 19:21:53,705 - User['logsearch'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': ['hadoop'], 'uid': None} 2018-08-06 19:21:53,706 - User['ambari-qa'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': ['hadoop', 'users'], 'uid': None} 2018-08-06 19:21:53,707 - User['kafka'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': ['hadoop'], 'uid': None} 2018-08-06 19:21:53,709 - User['hdfs'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': ['hdfs', 'hadoop'], 'uid': None} 2018-08-06 19:21:53,710 - Modifying user hdfs 2018-08-06 19:21:53,732 - User['yarn'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': ['hadoop'], 'uid': None} 2018-08-06 19:21:53,735 - User['mapred'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': ['hadoop'], 'uid': None} 2018-08-06 19:21:53,737 - User['hbase'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': ['hadoop'], 'uid': None} 2018-08-06 19:21:53,739 - File['/var/lib/ambari-agent/tmp/changeUid.sh'] {'content': StaticFile('changeToSecureUid.sh'), 'mode': 0555} 2018-08-06 19:21:53,742 - Execute['/var/lib/ambari-agent/tmp/changeUid.sh ambari-qa /tmp/hadoop-ambari-qa,/tmp/hsperfdata_ambari-qa,/home/ambari-qa,/tmp/ambari-qa,/tmp/sqoop-ambari-qa 0'] {'not_if': '(test $(id -u ambari-qa) -gt 1000) || (false)'} 2018-08-06 19:21:53,751 - Skipping Execute['/var/lib/ambari-agent/tmp/changeUid.sh ambari-qa /tmp/hadoop-ambari-qa,/tmp/hsperfdata_ambari-qa,/home/ambari-qa,/tmp/ambari-qa,/tmp/sqoop-ambari-qa 0'] due to not_if 2018-08-06 19:21:53,752 - Directory['/tmp/hbase-hbase'] {'owner': 'hbase', 'create_parents': True, 'mode': 0775, 'cd_access': 'a'} 2018-08-06 19:21:53,754 - File['/var/lib/ambari-agent/tmp/changeUid.sh'] {'content': StaticFile('changeToSecureUid.sh'), 'mode': 0555} 2018-08-06 19:21:53,756 - File['/var/lib/ambari-agent/tmp/changeUid.sh'] {'content': StaticFile('changeToSecureUid.sh'), 'mode': 0555} 2018-08-06 19:21:53,758 - call['/var/lib/ambari-agent/tmp/changeUid.sh hbase'] {} 2018-08-06 19:21:53,772 - call returned (0, '65549') 2018-08-06 19:21:53,773 - Execute['/var/lib/ambari-agent/tmp/changeUid.sh hbase /home/hbase,/tmp/hbase,/usr/bin/hbase,/var/log/hbase,/tmp/hbase-hbase 65549'] {'not_if': '(test $(id -u hbase) -gt 1000) || (false)'} 2018-08-06 19:21:53,782 - Skipping Execute['/var/lib/ambari-agent/tmp/changeUid.sh hbase /home/hbase,/tmp/hbase,/usr/bin/hbase,/var/log/hbase,/tmp/hbase-hbase 65549'] due to not_if 2018-08-06 19:21:53,783 - Group['hdfs'] {} 2018-08-06 19:21:53,783 - User['hdfs'] {'fetch_nonlocal_groups': True, 'groups': ['hdfs', 'hadoop', 'hadoop', u'hdfs']} 2018-08-06 19:21:53,784 - Modifying user hdfs 2018-08-06 19:21:53,800 - FS Type: HDFS 2018-08-06 19:21:53,801 - Directory['/etc/hadoop'] {'mode': 0755} 2018-08-06 19:21:53,829 - File['/usr/hdp/3.0.0.0-1634/hadoop/conf/hadoop-env.sh'] {'content': InlineTemplate(...), 'owner': 'hdfs', 'group': 'hadoop'} 2018-08-06 19:21:53,830 - Directory['/var/lib/ambari-agent/tmp/hadoop_java_io_tmpdir'] {'owner': 'hdfs', 'group': 'hadoop', 'mode': 01777} 2018-08-06 19:21:53,859 - Execute[('setenforce', '0')] {'not_if': '(! which getenforce ) || (which getenforce && getenforce | grep -q Disabled)', 'sudo': True, 'only_if': 'test -f /selinux/enforce'} 2018-08-06 19:21:53,875 - Skipping Execute[('setenforce', '0')] due to only_if 2018-08-06 19:21:53,876 - Directory['/var/log/hadoop'] {'owner': 'root', 'create_parents': True, 'group': 'hadoop', 'mode': 0775, 'cd_access': 'a'} 2018-08-06 19:21:53,880 - Directory['/var/run/hadoop'] {'owner': 'root', 'create_parents': True, 'group': 'root', 'cd_access': 'a'} 2018-08-06 19:21:53,881 - Directory['/var/run/hadoop/hdfs'] {'owner': 'hdfs', 'cd_access': 'a'} 2018-08-06 19:21:53,882 - Directory['/tmp/hadoop-hdfs'] {'owner': 'hdfs', 'create_parents': True, 'cd_access': 'a'} 2018-08-06 19:21:53,889 - File['/usr/hdp/3.0.0.0-1634/hadoop/conf/commons-logging.properties'] {'content': Template('commons-logging.properties.j2'), 'owner': 'hdfs'} 2018-08-06 19:21:53,892 - File['/usr/hdp/3.0.0.0-1634/hadoop/conf/health_check'] {'content': Template('health_check.j2'), 'owner': 'hdfs'} 2018-08-06 19:21:53,902 - File['/usr/hdp/3.0.0.0-1634/hadoop/conf/log4j.properties'] {'content': InlineTemplate(...), 'owner': 'hdfs', 'group': 'hadoop', 'mode': 0644} 2018-08-06 19:21:53,918 - File['/usr/hdp/3.0.0.0-1634/hadoop/conf/hadoop-metrics2.properties'] {'content': Template('hadoop-metrics2.properties.j2'), 'owner': 'hdfs', 'group': 'hadoop'} 2018-08-06 19:21:53,920 - File['/usr/hdp/3.0.0.0-1634/hadoop/conf/task-log4j.properties'] {'content': StaticFile('task-log4j.properties'), 'mode': 0755} 2018-08-06 19:21:53,921 - File['/usr/hdp/3.0.0.0-1634/hadoop/conf/configuration.xsl'] {'owner': 'hdfs', 'group': 'hadoop'} 2018-08-06 19:21:53,927 - File['/etc/hadoop/conf/topology_mappings.data'] {'owner': 'hdfs', 'content': Template('topology_mappings.data.j2'), 'only_if': 'test -d /etc/hadoop/conf', 'group': 'hadoop', 'mode': 0644} 2018-08-06 19:21:53,932 - File['/etc/hadoop/conf/topology_script.py'] {'content': StaticFile('topology_script.py'), 'only_if': 'test -d /etc/hadoop/conf', 'mode': 0755} 2018-08-06 19:21:53,937 - Skipping unlimited key JCE policy check and setup since the Java VM is not managed by Ambari 2018-08-06 19:21:54,340 - Stack Feature Version Info: Cluster Stack=3.0, Command Stack=None, Command Version=3.0.0.0-1634, Upgrade Direction=upgrade -> 3.0.0.0-1634 2018-08-06 19:21:54,393 - File['/var/lib/ambari-agent/tmp/mysql-jdbc-driver.jar'] {'content': DownloadSource('http://r7u07.thanos.gotgdt.net:8080/resources/mysql-jdbc-driver.jar'), 'mode': 0644} 2018-08-06 19:21:54,394 - Not downloading the file from http://r7u07.thanos.gotgdt.net:8080/resources/mysql-jdbc-driver.jar, because /var/lib/ambari-agent/tmp/mysql-jdbc-driver.jar already exists 2018-08-06 19:21:54,395 - Execute[('cp', '--remove-destination', u'/var/lib/ambari-agent/tmp/mysql-jdbc-driver.jar', u'/usr/hdp/current/ranger-admin/ews/lib')] {'path': ['/bin', '/usr/bin/'], 'sudo': True} 2018-08-06 19:21:54,407 - File['/usr/hdp/current/ranger-admin/ews/lib/mysql-jdbc-driver.jar'] {'mode': 0644} 2018-08-06 19:21:54,407 - Changing permission for /usr/hdp/current/ranger-admin/ews/lib/mysql-jdbc-driver.jar from 600 to 644 2018-08-06 19:21:54,408 - ModifyPropertiesFile['/usr/hdp/current/ranger-admin/install.properties'] {'owner': 'ranger', 'properties': ...} 2018-08-06 19:21:54,409 - Modifying existing properties file: /usr/hdp/current/ranger-admin/install.properties 2018-08-06 19:21:54,419 - File['/usr/hdp/current/ranger-admin/install.properties'] {'owner': 'ranger', 'content': ..., 'group': None, 'mode': None, 'encoding': 'utf-8'} 2018-08-06 19:21:54,420 - Writing File['/usr/hdp/current/ranger-admin/install.properties'] because contents don't match 2018-08-06 19:21:54,421 - ModifyPropertiesFile['/usr/hdp/current/ranger-admin/install.properties'] {'owner': 'ranger', 'properties': {'SQL_CONNECTOR_JAR': u'/usr/hdp/current/ranger-admin/ews/lib/mysql-jdbc-driver.jar'}} 2018-08-06 19:21:54,421 - Modifying existing properties file: /usr/hdp/current/ranger-admin/install.properties 2018-08-06 19:21:54,422 - File['/usr/hdp/current/ranger-admin/install.properties'] {'owner': 'ranger', 'content': ..., 'group': None, 'mode': None, 'encoding': 'utf-8'} 2018-08-06 19:21:54,423 - ModifyPropertiesFile['/usr/hdp/current/ranger-admin/install.properties'] {'owner': 'ranger', 'properties': {'audit_store': u'solr'}} 2018-08-06 19:21:54,423 - Modifying existing properties file: /usr/hdp/current/ranger-admin/install.properties 2018-08-06 19:21:54,425 - File['/usr/hdp/current/ranger-admin/install.properties'] {'owner': 'ranger', 'content': ..., 'group': None, 'mode': None, 'encoding': 'utf-8'} 2018-08-06 19:21:54,425 - Setting up Ranger DB and DB User 2018-08-06 19:21:54,425 - Execute['ambari-python-wrap /usr/hdp/current/ranger-admin/dba_script.py -q'] {'logoutput': True, 'environment': {'RANGER_ADMIN_HOME': u'/usr/hdp/current/ranger-admin', 'JAVA_HOME': u'/usr/java/default'}, 'user': 'ranger'} 2018-08-06 19:21:54,643 [I] Running DBA setup script. QuiteMode:True 2018-08-06 19:21:54,643 [I] Using Java:/usr/java/default/bin/java 2018-08-06 19:21:54,643 [I] DB FLAVOR:MYSQL 2018-08-06 19:21:54,643 [I] DB Host:r7u07.thanos.gotgdt.net 2018-08-06 19:21:54,643 [I] ---------- Verifying DB root password ---------- 2018-08-06 19:21:54,644 [I] DBA root user password validated 2018-08-06 19:21:54,644 [I] ---------- Verifying Ranger Admin db user password ---------- 2018-08-06 19:21:54,644 [I] admin user password validated 2018-08-06 19:21:54,644 [I] ---------- Creating Ranger Admin db user ---------- 2018-08-06 19:21:54,644 [JISQL] /usr/java/default/bin/java -cp /usr/hdp/current/ranger-admin/ews/lib/mysql-jdbc-driver.jar:/usr/hdp/current/ranger-admin/jisql/lib/* org.apache.util.sql.Jisql -driver mysqlconj -cstring jdbc:mysql://r7u07.thanos.gotgdt.net/mysql -u root -p '********' -noheader -trim -c \; -query "SELECT version();" 2018-08-06 19:21:55,093 [I] Verifying user rangeradmin for Host % 2018-08-06 19:21:55,093 [JISQL] /usr/java/default/bin/java -cp /usr/hdp/current/ranger-admin/ews/lib/mysql-jdbc-driver.jar:/usr/hdp/current/ranger-admin/jisql/lib/* org.apache.util.sql.Jisql -driver mysqlconj -cstring jdbc:mysql://r7u07.thanos.gotgdt.net/mysql -u root -p '********' -noheader -trim -c \; -query "select user from mysql.user where user='rangeradmin' and host='%';" 2018-08-06 19:21:55,528 [I] MySQL user rangeradmin already exists for host % 2018-08-06 19:21:55,528 [I] Verifying user rangeradmin for Host localhost 2018-08-06 19:21:55,528 [JISQL] /usr/java/default/bin/java -cp /usr/hdp/current/ranger-admin/ews/lib/mysql-jdbc-driver.jar:/usr/hdp/current/ranger-admin/jisql/lib/* org.apache.util.sql.Jisql -driver mysqlconj -cstring jdbc:mysql://r7u07.thanos.gotgdt.net/mysql -u root -p '********' -noheader -trim -c \; -query "select user from mysql.user where user='rangeradmin' and host='localhost';" 2018-08-06 19:21:55,992 [I] MySQL user rangeradmin already exists for host localhost 2018-08-06 19:21:55,993 [I] Verifying user rangeradmin for Host r7u07.thanos.gotgdt.net 2018-08-06 19:21:55,993 [JISQL] /usr/java/default/bin/java -cp /usr/hdp/current/ranger-admin/ews/lib/mysql-jdbc-driver.jar:/usr/hdp/current/ranger-admin/jisql/lib/* org.apache.util.sql.Jisql -driver mysqlconj -cstring jdbc:mysql://r7u07.thanos.gotgdt.net/mysql -u root -p '********' -noheader -trim -c \; -query "select user from mysql.user where user='rangeradmin' and host='r7u07.thanos.gotgdt.net';" 2018-08-06 19:21:56,429 [I] MySQL user rangeradmin already exists for host r7u07.thanos.gotgdt.net 2018-08-06 19:21:56,430 [I] ---------- Creating Ranger Admin database ---------- 2018-08-06 19:21:56,430 [I] Verifying database ranger 2018-08-06 19:21:56,430 [JISQL] /usr/java/default/bin/java -cp /usr/hdp/current/ranger-admin/ews/lib/mysql-jdbc-driver.jar:/usr/hdp/current/ranger-admin/jisql/lib/* org.apache.util.sql.Jisql -driver mysqlconj -cstring jdbc:mysql://r7u07.thanos.gotgdt.net/mysql -u root -p '********' -noheader -trim -c \; -query "show databases like 'ranger';" 2018-08-06 19:21:56,888 [I] Database ranger already exists. 2018-08-06 19:21:56,889 [I] ---------- Granting permission to Ranger Admin db user ---------- 2018-08-06 19:21:56,889 [I] ---------- Granting privileges TO user 'rangeradmin'@'%' on db 'ranger'---------- 2018-08-06 19:21:56,889 [JISQL] /usr/java/default/bin/java -cp /usr/hdp/current/ranger-admin/ews/lib/mysql-jdbc-driver.jar:/usr/hdp/current/ranger-admin/jisql/lib/* org.apache.util.sql.Jisql -driver mysqlconj -cstring jdbc:mysql://r7u07.thanos.gotgdt.net/mysql -u root -p '********' -noheader -trim -c \; -query "grant all privileges on ranger.* to 'rangeradmin'@'%' with grant option;" 2018-08-06 19:21:57,337 [I] ---------- FLUSH PRIVILEGES ---------- 2018-08-06 19:21:57,338 [JISQL] /usr/java/default/bin/java -cp /usr/hdp/current/ranger-admin/ews/lib/mysql-jdbc-driver.jar:/usr/hdp/current/ranger-admin/jisql/lib/* org.apache.util.sql.Jisql -driver mysqlconj -cstring jdbc:mysql://r7u07.thanos.gotgdt.net/mysql -u root -p '********' -noheader -trim -c \; -query "FLUSH PRIVILEGES;" 2018-08-06 19:21:57,820 [I] Privileges granted to 'rangeradmin' on 'ranger' 2018-08-06 19:21:57,820 [I] ---------- Granting privileges TO user 'rangeradmin'@'localhost' on db 'ranger'---------- 2018-08-06 19:21:57,821 [JISQL] /usr/java/default/bin/java -cp /usr/hdp/current/ranger-admin/ews/lib/mysql-jdbc-driver.jar:/usr/hdp/current/ranger-admin/jisql/lib/* org.apache.util.sql.Jisql -driver mysqlconj -cstring jdbc:mysql://r7u07.thanos.gotgdt.net/mysql -u root -p '********' -noheader -trim -c \; -query "grant all privileges on ranger.* to 'rangeradmin'@'localhost' with grant option;" 2018-08-06 19:21:58,267 [I] ---------- FLUSH PRIVILEGES ---------- 2018-08-06 19:21:58,267 [JISQL] /usr/java/default/bin/java -cp /usr/hdp/current/ranger-admin/ews/lib/mysql-jdbc-driver.jar:/usr/hdp/current/ranger-admin/jisql/lib/* org.apache.util.sql.Jisql -driver mysqlconj -cstring jdbc:mysql://r7u07.thanos.gotgdt.net/mysql -u root -p '********' -noheader -trim -c \; -query "FLUSH PRIVILEGES;" 2018-08-06 19:21:58,715 [I] Privileges granted to 'rangeradmin' on 'ranger' 2018-08-06 19:21:58,715 [I] ---------- Granting privileges TO user 'rangeradmin'@'r7u07.thanos.gotgdt.net' on db 'ranger'---------- 2018-08-06 19:21:58,716 [JISQL] /usr/java/default/bin/java -cp /usr/hdp/current/ranger-admin/ews/lib/mysql-jdbc-driver.jar:/usr/hdp/current/ranger-admin/jisql/lib/* org.apache.util.sql.Jisql -driver mysqlconj -cstring jdbc:mysql://r7u07.thanos.gotgdt.net/mysql -u root -p '********' -noheader -trim -c \; -query "grant all privileges on ranger.* to 'rangeradmin'@'r7u07.thanos.gotgdt.net' with grant option;" 2018-08-06 19:21:59,197 [I] ---------- FLUSH PRIVILEGES ---------- 2018-08-06 19:21:59,197 [JISQL] /usr/java/default/bin/java -cp /usr/hdp/current/ranger-admin/ews/lib/mysql-jdbc-driver.jar:/usr/hdp/current/ranger-admin/jisql/lib/* org.apache.util.sql.Jisql -driver mysqlconj -cstring jdbc:mysql://r7u07.thanos.gotgdt.net/mysql -u root -p '********' -noheader -trim -c \; -query "FLUSH PRIVILEGES;" 2018-08-06 19:21:59,642 [I] Privileges granted to 'rangeradmin' on 'ranger' 2018-08-06 19:21:59,642 [I] ---------- Ranger Policy Manager DB and User Creation Process Completed.. ---------- 2018-08-06 19:21:59,660 - Execute['ambari-python-wrap /usr/hdp/current/ranger-admin/db_setup.py'] {'logoutput': True, 'environment': {'PATH': '/usr/sbin:/sbin:/usr/lib/ambari-server/*:/usr/lib64/qt-3.3/bin:/opt/anaconda/bin:/usr/local/sbin:/sbin:/bin:/usr/sbin:/usr/bin::/opt/bro/bin:/root/bin:/var/lib/ambari-agent', 'RANGER_ADMIN_HOME': u'/usr/hdp/current/ranger-admin', 'JAVA_HOME': u'/usr/java/default'}, 'user': 'ranger'} 2018-08-06 19:22:00,135 [I] DB FLAVOR :MYSQL 2018-08-06 19:22:00,136 [I] --------- Verifying Ranger DB connection --------- 2018-08-06 19:22:00,136 [I] Checking connection.. 2018-08-06 19:22:00,136 [JISQL] /usr/java/default/bin/java -cp /usr/hdp/current/ranger-admin/ews/lib/mysql-jdbc-driver.jar:/usr/hdp/current/ranger-admin/jisql/lib/* org.apache.util.sql.Jisql -driver mysqlconj -cstring jdbc:mysql://r7u07.thanos.gotgdt.net/ranger -u 'rangeradmin' -p '********' -noheader -trim -c \; -query "SELECT version();" 2018-08-06 19:22:00,744 [I] Checking connection passed. 2018-08-06 19:22:00,744 [I] --------- Verifying version history table --------- 2018-08-06 19:22:00,745 [JISQL] /usr/java/default/bin/java -cp /usr/hdp/current/ranger-admin/ews/lib/mysql-jdbc-driver.jar:/usr/hdp/current/ranger-admin/jisql/lib/* org.apache.util.sql.Jisql -driver mysqlconj -cstring jdbc:mysql://r7u07.thanos.gotgdt.net/ranger -u 'rangeradmin' -p '********' -noheader -trim -c \; -query "show tables like 'x_db_version_h';" 2018-08-06 19:22:01,203 [I] Table x_db_version_h already exists in database 'ranger' 2018-08-06 19:22:01,203 [I] --------- Importing Ranger Core DB Schema --------- 2018-08-06 19:22:01,203 [JISQL] /usr/java/default/bin/java -cp /usr/hdp/current/ranger-admin/ews/lib/mysql-jdbc-driver.jar:/usr/hdp/current/ranger-admin/jisql/lib/* org.apache.util.sql.Jisql -driver mysqlconj -cstring jdbc:mysql://r7u07.thanos.gotgdt.net/ranger -u 'rangeradmin' -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';" 2018-08-06 19:22:01,666 [I] CORE_DB_SCHEMA is already imported 2018-08-06 19:22:01,666 [JISQL] /usr/java/default/bin/java -cp /usr/hdp/current/ranger-admin/ews/lib/mysql-jdbc-driver.jar:/usr/hdp/current/ranger-admin/jisql/lib/* org.apache.util.sql.Jisql -driver mysqlconj -cstring jdbc:mysql://r7u07.thanos.gotgdt.net/ranger -u 'rangeradmin' -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 1.1.0.3.0.0.0-1634' and active='Y';" 2018-08-06 19:22:02,097 [I] --------- Applying Ranger DB patches --------- 2018-08-06 19:22:02,097 [I] Executing patch on ranger from file: 001-groupsource.sql 2018-08-06 19:22:02,098 [JISQL] /usr/java/default/bin/java -cp /usr/hdp/current/ranger-admin/ews/lib/mysql-jdbc-driver.jar:/usr/hdp/current/ranger-admin/jisql/lib/* org.apache.util.sql.Jisql -driver mysqlconj -cstring jdbc:mysql://r7u07.thanos.gotgdt.net/ranger -u 'rangeradmin' -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = '001' and active = 'Y';" 2018-08-06 19:22:02,519 [I] Patch 001-groupsource.sql is already applied 2018-08-06 19:22:02,520 [I] Executing patch on ranger from file: 002-policyname.sql 2018-08-06 19:22:02,520 [JISQL] /usr/java/default/bin/java -cp /usr/hdp/current/ranger-admin/ews/lib/mysql-jdbc-driver.jar:/usr/hdp/current/ranger-admin/jisql/lib/* org.apache.util.sql.Jisql -driver mysqlconj -cstring jdbc:mysql://r7u07.thanos.gotgdt.net/ranger -u 'rangeradmin' -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = '002' and active = 'Y';" 2018-08-06 19:22:02,943 [I] Patch 002-policyname.sql is already applied 2018-08-06 19:22:02,943 [I] Executing patch on ranger from file: 003-knoxrepo.sql 2018-08-06 19:22:02,943 [JISQL] /usr/java/default/bin/java -cp /usr/hdp/current/ranger-admin/ews/lib/mysql-jdbc-driver.jar:/usr/hdp/current/ranger-admin/jisql/lib/* org.apache.util.sql.Jisql -driver mysqlconj -cstring jdbc:mysql://r7u07.thanos.gotgdt.net/ranger -u 'rangeradmin' -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = '003' and active = 'Y';" 2018-08-06 19:22:03,407 [I] Patch 003-knoxrepo.sql is already applied 2018-08-06 19:22:03,408 [I] Executing patch on ranger from file: 004-assetconfigsize.sql 2018-08-06 19:22:03,408 [JISQL] /usr/java/default/bin/java -cp /usr/hdp/current/ranger-admin/ews/lib/mysql-jdbc-driver.jar:/usr/hdp/current/ranger-admin/jisql/lib/* org.apache.util.sql.Jisql -driver mysqlconj -cstring jdbc:mysql://r7u07.thanos.gotgdt.net/ranger -u 'rangeradmin' -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = '004' and active = 'Y';" 2018-08-06 19:22:03,836 [I] Patch 004-assetconfigsize.sql is already applied 2018-08-06 19:22:03,837 [I] Executing patch on ranger from file: 005-xtrxlogcolumnsize.sql 2018-08-06 19:22:03,837 [JISQL] /usr/java/default/bin/java -cp /usr/hdp/current/ranger-admin/ews/lib/mysql-jdbc-driver.jar:/usr/hdp/current/ranger-admin/jisql/lib/* org.apache.util.sql.Jisql -driver mysqlconj -cstring jdbc:mysql://r7u07.thanos.gotgdt.net/ranger -u 'rangeradmin' -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = '005' and active = 'Y';" 2018-08-06 19:22:04,258 [I] Patch 005-xtrxlogcolumnsize.sql is already applied 2018-08-06 19:22:04,259 [I] Executing patch on ranger from file: 006-createdefaultpublicgroup.sql 2018-08-06 19:22:04,259 [JISQL] /usr/java/default/bin/java -cp /usr/hdp/current/ranger-admin/ews/lib/mysql-jdbc-driver.jar:/usr/hdp/current/ranger-admin/jisql/lib/* org.apache.util.sql.Jisql -driver mysqlconj -cstring jdbc:mysql://r7u07.thanos.gotgdt.net/ranger -u 'rangeradmin' -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = '006' and active = 'Y';" 2018-08-06 19:22:04,689 [I] Patch 006-createdefaultpublicgroup.sql is already applied 2018-08-06 19:22:04,690 [I] Executing patch on ranger from file: 007-updateBlankPolicyName.sql 2018-08-06 19:22:04,690 [JISQL] /usr/java/default/bin/java -cp /usr/hdp/current/ranger-admin/ews/lib/mysql-jdbc-driver.jar:/usr/hdp/current/ranger-admin/jisql/lib/* org.apache.util.sql.Jisql -driver mysqlconj -cstring jdbc:mysql://r7u07.thanos.gotgdt.net/ranger -u 'rangeradmin' -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = '007' and active = 'Y';" 2018-08-06 19:22:05,134 [I] Patch 007-updateBlankPolicyName.sql is already applied 2018-08-06 19:22:05,134 [I] Executing patch on ranger from file: 008-removeTrailingSlash.sql 2018-08-06 19:22:05,134 [JISQL] /usr/java/default/bin/java -cp /usr/hdp/current/ranger-admin/ews/lib/mysql-jdbc-driver.jar:/usr/hdp/current/ranger-admin/jisql/lib/* org.apache.util.sql.Jisql -driver mysqlconj -cstring jdbc:mysql://r7u07.thanos.gotgdt.net/ranger -u 'rangeradmin' -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = '008' and active = 'Y';" 2018-08-06 19:22:05,590 [I] Patch 008-removeTrailingSlash.sql is already applied 2018-08-06 19:22:05,591 [I] Executing patch on ranger from file: 009-updated_schema.sql 2018-08-06 19:22:05,591 [JISQL] /usr/java/default/bin/java -cp /usr/hdp/current/ranger-admin/ews/lib/mysql-jdbc-driver.jar:/usr/hdp/current/ranger-admin/jisql/lib/* org.apache.util.sql.Jisql -driver mysqlconj -cstring jdbc:mysql://r7u07.thanos.gotgdt.net/ranger -u 'rangeradmin' -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = '009' and active = 'Y';" 2018-08-06 19:22:06,029 [I] Patch 009-updated_schema.sql is already applied 2018-08-06 19:22:06,030 [I] Executing patch on ranger from file: 010-users-and-groups-visibility.sql 2018-08-06 19:22:06,030 [JISQL] /usr/java/default/bin/java -cp /usr/hdp/current/ranger-admin/ews/lib/mysql-jdbc-driver.jar:/usr/hdp/current/ranger-admin/jisql/lib/* org.apache.util.sql.Jisql -driver mysqlconj -cstring jdbc:mysql://r7u07.thanos.gotgdt.net/ranger -u 'rangeradmin' -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = '010' and active = 'Y';" 2018-08-06 19:22:06,453 [I] Patch 010-users-and-groups-visibility.sql is already applied 2018-08-06 19:22:06,454 [I] Executing patch on ranger from file: 012-createusersyncuser.sql 2018-08-06 19:22:06,454 [JISQL] /usr/java/default/bin/java -cp /usr/hdp/current/ranger-admin/ews/lib/mysql-jdbc-driver.jar:/usr/hdp/current/ranger-admin/jisql/lib/* org.apache.util.sql.Jisql -driver mysqlconj -cstring jdbc:mysql://r7u07.thanos.gotgdt.net/ranger -u 'rangeradmin' -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = '012' and active = 'Y';" 2018-08-06 19:22:06,908 [I] Patch 012-createusersyncuser.sql is already applied 2018-08-06 19:22:06,909 [I] Executing patch on ranger from file: 013-permissionmodel.sql 2018-08-06 19:22:06,909 [JISQL] /usr/java/default/bin/java -cp /usr/hdp/current/ranger-admin/ews/lib/mysql-jdbc-driver.jar:/usr/hdp/current/ranger-admin/jisql/lib/* org.apache.util.sql.Jisql -driver mysqlconj -cstring jdbc:mysql://r7u07.thanos.gotgdt.net/ranger -u 'rangeradmin' -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = '013' and active = 'Y';" 2018-08-06 19:22:07,387 [I] Patch 013-permissionmodel.sql is already applied 2018-08-06 19:22:07,388 [I] Executing patch on ranger from file: 014-createkeyadmin.sql 2018-08-06 19:22:07,388 [JISQL] /usr/java/default/bin/java -cp /usr/hdp/current/ranger-admin/ews/lib/mysql-jdbc-driver.jar:/usr/hdp/current/ranger-admin/jisql/lib/* org.apache.util.sql.Jisql -driver mysqlconj -cstring jdbc:mysql://r7u07.thanos.gotgdt.net/ranger -u 'rangeradmin' -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = '014' and active = 'Y';" 2018-08-06 19:22:07,834 [I] Patch 014-createkeyadmin.sql is already applied 2018-08-06 19:22:07,835 [I] Executing patch on ranger from file: 016-updated-schema-for-tag-based-policy.sql 2018-08-06 19:22:07,835 [JISQL] /usr/java/default/bin/java -cp /usr/hdp/current/ranger-admin/ews/lib/mysql-jdbc-driver.jar:/usr/hdp/current/ranger-admin/jisql/lib/* org.apache.util.sql.Jisql -driver mysqlconj -cstring jdbc:mysql://r7u07.thanos.gotgdt.net/ranger -u 'rangeradmin' -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = '016' and active = 'Y';" 2018-08-06 19:22:08,310 [I] Patch 016-updated-schema-for-tag-based-policy.sql is already applied 2018-08-06 19:22:08,310 [I] Executing patch on ranger from file: 018-createtagsyncuser.sql 2018-08-06 19:22:08,311 [JISQL] /usr/java/default/bin/java -cp /usr/hdp/current/ranger-admin/ews/lib/mysql-jdbc-driver.jar:/usr/hdp/current/ranger-admin/jisql/lib/* org.apache.util.sql.Jisql -driver mysqlconj -cstring jdbc:mysql://r7u07.thanos.gotgdt.net/ranger -u 'rangeradmin' -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = '018' and active = 'Y';" 2018-08-06 19:22:08,764 [I] Patch 018-createtagsyncuser.sql is already applied 2018-08-06 19:22:08,765 [I] Executing patch on ranger from file: 019-create-indexes.sql 2018-08-06 19:22:08,765 [JISQL] /usr/java/default/bin/java -cp /usr/hdp/current/ranger-admin/ews/lib/mysql-jdbc-driver.jar:/usr/hdp/current/ranger-admin/jisql/lib/* org.apache.util.sql.Jisql -driver mysqlconj -cstring jdbc:mysql://r7u07.thanos.gotgdt.net/ranger -u 'rangeradmin' -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = '019' and active = 'Y';" 2018-08-06 19:22:09,264 [I] Patch 019-create-indexes.sql is already applied 2018-08-06 19:22:09,264 [I] Executing patch on ranger from file: 020-datamask-policy.sql 2018-08-06 19:22:09,265 [JISQL] /usr/java/default/bin/java -cp /usr/hdp/current/ranger-admin/ews/lib/mysql-jdbc-driver.jar:/usr/hdp/current/ranger-admin/jisql/lib/* org.apache.util.sql.Jisql -driver mysqlconj -cstring jdbc:mysql://r7u07.thanos.gotgdt.net/ranger -u 'rangeradmin' -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = '020' and active = 'Y';" 2018-08-06 19:22:09,716 [I] Patch 020-datamask-policy.sql is already applied 2018-08-06 19:22:09,717 [I] Executing patch on ranger from file: 021-update-tag-for-owner.sql 2018-08-06 19:22:09,717 [JISQL] /usr/java/default/bin/java -cp /usr/hdp/current/ranger-admin/ews/lib/mysql-jdbc-driver.jar:/usr/hdp/current/ranger-admin/jisql/lib/* org.apache.util.sql.Jisql -driver mysqlconj -cstring jdbc:mysql://r7u07.thanos.gotgdt.net/ranger -u 'rangeradmin' -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = '021' and active = 'Y';" 2018-08-06 19:22:10,142 [I] Patch 021-update-tag-for-owner.sql is already applied 2018-08-06 19:22:10,143 [I] Executing patch on ranger from file: 022-split-service-table.sql 2018-08-06 19:22:10,143 [JISQL] /usr/java/default/bin/java -cp /usr/hdp/current/ranger-admin/ews/lib/mysql-jdbc-driver.jar:/usr/hdp/current/ranger-admin/jisql/lib/* org.apache.util.sql.Jisql -driver mysqlconj -cstring jdbc:mysql://r7u07.thanos.gotgdt.net/ranger -u 'rangeradmin' -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = '022' and active = 'Y';" 2018-08-06 19:22:10,569 [I] Patch 022-split-service-table.sql is already applied 2018-08-06 19:22:10,570 [I] Executing patch on ranger from file: 023-add-unique-constraint-on-table-x_user.sql 2018-08-06 19:22:10,570 [JISQL] /usr/java/default/bin/java -cp /usr/hdp/current/ranger-admin/ews/lib/mysql-jdbc-driver.jar:/usr/hdp/current/ranger-admin/jisql/lib/* org.apache.util.sql.Jisql -driver mysqlconj -cstring jdbc:mysql://r7u07.thanos.gotgdt.net/ranger -u 'rangeradmin' -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = '023' and active = 'Y';" 2018-08-06 19:22:11,014 [I] Patch 023-add-unique-constraint-on-table-x_user.sql is already applied 2018-08-06 19:22:11,014 [I] Executing patch on ranger from file: 024-sortorder-column-size.sql 2018-08-06 19:22:11,015 [JISQL] /usr/java/default/bin/java -cp /usr/hdp/current/ranger-admin/ews/lib/mysql-jdbc-driver.jar:/usr/hdp/current/ranger-admin/jisql/lib/* org.apache.util.sql.Jisql -driver mysqlconj -cstring jdbc:mysql://r7u07.thanos.gotgdt.net/ranger -u 'rangeradmin' -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = '024' and active = 'Y';" 2018-08-06 19:22:11,447 [I] Patch 024-sortorder-column-size.sql is already applied 2018-08-06 19:22:11,448 [I] Executing patch on ranger from file: 025-create-schema-for-plugin-info.sql 2018-08-06 19:22:11,448 [JISQL] /usr/java/default/bin/java -cp /usr/hdp/current/ranger-admin/ews/lib/mysql-jdbc-driver.jar:/usr/hdp/current/ranger-admin/jisql/lib/* org.apache.util.sql.Jisql -driver mysqlconj -cstring jdbc:mysql://r7u07.thanos.gotgdt.net/ranger -u 'rangeradmin' -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = '025' and active = 'Y';" 2018-08-06 19:22:11,893 [I] Patch 025-create-schema-for-plugin-info.sql is already applied 2018-08-06 19:22:11,893 [I] Executing patch on ranger from file: 026-add-column-in-x_policy_export_audit.sql 2018-08-06 19:22:11,893 [JISQL] /usr/java/default/bin/java -cp /usr/hdp/current/ranger-admin/ews/lib/mysql-jdbc-driver.jar:/usr/hdp/current/ranger-admin/jisql/lib/* org.apache.util.sql.Jisql -driver mysqlconj -cstring jdbc:mysql://r7u07.thanos.gotgdt.net/ranger -u 'rangeradmin' -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = '026' and active = 'Y';" 2018-08-06 19:22:12,360 [I] Patch 026-add-column-in-x_policy_export_audit.sql is already applied 2018-08-06 19:22:12,360 [I] Executing patch on ranger from file: 027-sortorder-column-size.sql 2018-08-06 19:22:12,360 [JISQL] /usr/java/default/bin/java -cp /usr/hdp/current/ranger-admin/ews/lib/mysql-jdbc-driver.jar:/usr/hdp/current/ranger-admin/jisql/lib/* org.apache.util.sql.Jisql -driver mysqlconj -cstring jdbc:mysql://r7u07.thanos.gotgdt.net/ranger -u 'rangeradmin' -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = '027' and active = 'Y';" 2018-08-06 19:22:12,816 [I] Patch 027-sortorder-column-size.sql is already applied 2018-08-06 19:22:12,816 [I] Executing patch on ranger from file: 028-delete-xgroup-duplicate-references.sql 2018-08-06 19:22:12,816 [JISQL] /usr/java/default/bin/java -cp /usr/hdp/current/ranger-admin/ews/lib/mysql-jdbc-driver.jar:/usr/hdp/current/ranger-admin/jisql/lib/* org.apache.util.sql.Jisql -driver mysqlconj -cstring jdbc:mysql://r7u07.thanos.gotgdt.net/ranger -u 'rangeradmin' -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = '028' and active = 'Y';" 2018-08-06 19:22:13,299 [JISQL] /usr/java/default/bin/java -cp /usr/hdp/current/ranger-admin/ews/lib/mysql-jdbc-driver.jar:/usr/hdp/current/ranger-admin/jisql/lib/* org.apache.util.sql.Jisql -driver mysqlconj -cstring jdbc:mysql://r7u07.thanos.gotgdt.net/ranger -u 'rangeradmin' -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = '028' and active = 'N';" 2018-08-06 19:22:13,734 [I] Patch 028-delete-xgroup-duplicate-references.sql is being applied by some other process 2018-08-06 19:24:13,773 [JISQL] /usr/java/default/bin/java -cp /usr/hdp/current/ranger-admin/ews/lib/mysql-jdbc-driver.jar:/usr/hdp/current/ranger-admin/jisql/lib/* org.apache.util.sql.Jisql -driver mysqlconj -cstring jdbc:mysql://r7u07.thanos.gotgdt.net/ranger -u 'rangeradmin' -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = '028' and active = 'N';" 2018-08-06 19:24:14,236 [I] Patch 028-delete-xgroup-duplicate-references.sql is being applied by some other process 2018-08-06 19:26:14,332 [JISQL] /usr/java/default/bin/java -cp /usr/hdp/current/ranger-admin/ews/lib/mysql-jdbc-driver.jar:/usr/hdp/current/ranger-admin/jisql/lib/* org.apache.util.sql.Jisql -driver mysqlconj -cstring jdbc:mysql://r7u07.thanos.gotgdt.net/ranger -u 'rangeradmin' -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = '028' and active = 'N';" 2018-08-06 19:26:14,799 [I] Patch 028-delete-xgroup-duplicate-references.sql is being applied by some other process 2018-08-06 19:28:14,899 [JISQL] /usr/java/default/bin/java -cp /usr/hdp/current/ranger-admin/ews/lib/mysql-jdbc-driver.jar:/usr/hdp/current/ranger-admin/jisql/lib/* org.apache.util.sql.Jisql -driver mysqlconj -cstring jdbc:mysql://r7u07.thanos.gotgdt.net/ranger -u 'rangeradmin' -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = '028' and active = 'N';" 2018-08-06 19:28:15,402 [I] Patch 028-delete-xgroup-duplicate-references.sql is being applied by some other process 2018-08-06 19:30:15,482 [JISQL] /usr/java/default/bin/java -cp /usr/hdp/current/ranger-admin/ews/lib/mysql-jdbc-driver.jar:/usr/hdp/current/ranger-admin/jisql/lib/* org.apache.util.sql.Jisql -driver mysqlconj -cstring jdbc:mysql://r7u07.thanos.gotgdt.net/ranger -u 'rangeradmin' -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = '028' and active = 'N';" 2018-08-06 19:30:15,970 [I] Patch 028-delete-xgroup-duplicate-references.sql is being applied by some other process Command failed after 1 tries
Created 08-13-2018 07:03 PM
Was the upgrade performed from pre HDP 2.6.3? if so you might want to follow below document to remove duplicates from Ranger db.
HDP 2.6.3 introduces unique constraints on a few tables in Ranger DB. Depending upon your environment, Ranger DB may contain duplicate data in these tables prior to the upgrade. To make the upgrade faster, you can manually delete this duplicate data in Ranger DB before performing the upgrade.
These steps are optional, but recommended, and only needed for Ranger users. These should be performed after registering and installing the target HDP version but before actually performing the upgrade.
Created 08-16-2018 05:25 PM
@Aaron Bossert Please let me know if the above helps?