Member since
04-27-2017
9
Posts
0
Kudos Received
1
Solution
My Accepted Solutions
| Title | Views | Posted |
|---|---|---|
| 833 | 08-02-2018 04:46 PM |
03-28-2019
02:02 PM
@Renaud Manus, I have circled back to this and now am using cloudbreak 2.9.0. I am not even able to create a credential in cloudbreak now...neither v2 or v3 seems to work. I have confirmed that my openstack credentials work and are properly configured by using them with the openstack CLI (python client) on my Cloudbreak server. I am seeing error messages related to the URL being requested within the Openstack logs: 10.10.0.98 - - [27/Mar/2019:15:45:28 -0400] "POST /v3/tokens HTTP/1.1" 404 233 "-" "Jersey/2.26 (HttpUrlConnection 10.0.2)"
10.10.0.98 - - [27/Mar/2019:15:46:35 -0400] "POST /v3/tokens HTTP/1.1" 404 233 "-" "Jersey/2.26 (HttpUrlConnection 10.0.2)"
10.10.0.98 - - [27/Mar/2019:15:47:24 -0400] "POST /v3/auth/tokens HTTP/1.1" 201 6992 "-" "Jersey/2.26 (HttpUrlConnection 10.0.2)"
10.10.0.98 - - [27/Mar/2019:15:50:12 -0400] "POST /v3/auth/tokens HTTP/1.1" 201 6992 "-" "Jersey/2.26 (HttpUrlConnection 10.0.2)" It looks like when I try to create a v3 credential it is hitting the right URL, but is giving a fairly useless "NOT FOUND" error on the cloudbreak side. With the v2 credential, I get the same "NOT FOUND" error in the cloudbreak logs, but in the Openstack logs, it looks like the correct URL is getting hit (/v3/auth/tokens vs /v3/tokens). I am running out of things to try and hope someone can take a look at this to see what might be going on. Given that the first time around, @Renaud Manus seemed to be able to get it working with the V2 API, I am hoping that this can work...
... View more
10-12-2018
02:20 PM
@mmolnar, thanks for the suggestion...unfortunately, my private cloud does not seem to have the v2 credentials enabled as I get errors when trying to create a new credential as v2.
... View more
10-09-2018
08:57 PM
Thanks for the response...I have tried with the default images and the ones I imported...neither has worked. I get the error shown above when I use the default images...when I use the ones I uploaded, I get 401 errors. Also, given that Mitaka is 5 versions behind current and was EOL as of April of 2017 (more than a year ago), is there a date expected for support of newer versions of OpenStack? Unfortunately, I don't have control over the Openstack version and must use the one that is supplied on my private cluster/cloud.
... View more
10-05-2018
08:42 PM
I am working on a private cloud that has Openstack Rocky on it. I have tried multiple times to spin up clusters with both Cloudbreak 2.7.1 and 2.8TP with no luck. Installing either version of cloudbreak seems to work fine, but each time I try to create a cluster, I get an almost immediate failure. I have looked through the cloudbreak logs and have not found any helpful errors and am just about at my wits end with this. I have noticed that Cloudbreak does not seem to be able to retrieve the image catalog that I have locally...I had my Openstack admin upload the images as shown in the documentation, which I can see from my Openstack console/UI as expected...but in cloudbreak, when I look at the default cloudbreak image catalog, I see what is expected, but with my internal catalog, depending on which URL I use, I get either "multiple choices" errors or "401" errors. The urls I use are http://myopenstack:9292 or http://myopenstack:9292/v2/images. Apart from that, the only errors I am currently getting when I create a cluster is this: Error during stack creation flow:
cloudbreak_1 | org.openstack4j.api.exceptions.ServerResponseException: Internal Server Error
cloudbreak_1 | at org.openstack4j.core.transport.HttpExceptionHandler.mapException(HttpExceptionHandler.java:40)
cloudbreak_1 | at org.openstack4j.core.transport.HttpExceptionHandler.mapException(HttpExceptionHandler.java:23)
cloudbreak_1 | at org.openstack4j.core.transport.HttpEntityHandler.handle(HttpEntityHandler.java:51)
cloudbreak_1 | at org.openstack4j.core.transport.HttpEntityHandler.handle(HttpEntityHandler.java:24)
cloudbreak_1 | at org.openstack4j.connectors.jersey2.HttpResponseImpl.getEntity(HttpResponseImpl.java:63)
cloudbreak_1 | at org.openstack4j.openstack.internal.BaseOpenStackService$Invocation.execute(BaseOpenStackService.java:225)
cloudbreak_1 | at org.openstack4j.openstack.internal.BaseOpenStackService$Invocation.execute(BaseOpenStackService.java:207)
cloudbreak_1 | at org.openstack4j.openstack.heat.internal.StackServiceImpl.getStackByName(StackServiceImpl.java:91)
cloudbreak_1 | at com.sequenceiq.cloudbreak.cloud.openstack.common.OpenStackStackValidator.validate(OpenStackStackValidator.java:27)
cloudbreak_1 | at com.sequenceiq.cloudbreak.cloud.handler.ProvisionValidationHandler.accept(ProvisionValidationHandler.java:48)
cloudbreak_1 | at com.sequenceiq.cloudbreak.cloud.handler.ProvisionValidationHandler.accept(ProvisionValidationHandler.java:21)
cloudbreak_1 | at com.sequenceiq.cloudbreak.cloud.handler.ProvisionValidationHandler$$FastClassBySpringCGLIB$$5f1962a5.invoke(<generated>)
cloudbreak_1 | at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:204)
cloudbreak_1 | at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:746)
cloudbreak_1 | at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163)
cloudbreak_1 | at org.springframework.aop.framework.adapter.MethodBeforeAdviceInterceptor.invoke(MethodBeforeAdviceInterceptor.java:52)
cloudbreak_1 | at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:185)
cloudbreak_1 | at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:92)
cloudbreak_1 | at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:185)
cloudbreak_1 | at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:688)
cloudbreak_1 | at com.sequenceiq.cloudbreak.cloud.handler.ProvisionValidationHandler$$EnhancerBySpringCGLIB$$67d65420.accept(<generated>)
cloudbreak_1 | at reactor.bus.EventBus$3.accept(EventBus.java:317)
cloudbreak_1 | at reactor.bus.EventBus$3.accept(EventBus.java:310)
cloudbreak_1 | at reactor.bus.routing.ConsumerFilteringRouter.route(ConsumerFilteringRouter.java:72)
cloudbreak_1 | at reactor.bus.routing.TraceableDelegatingRouter.route(TraceableDelegatingRouter.java:51)
cloudbreak_1 | at reactor.bus.EventBus.accept(EventBus.java:591)
cloudbreak_1 | at reactor.bus.EventBus.accept(EventBus.java:63)
cloudbreak_1 | at reactor.core.dispatch.AbstractLifecycleDispatcher.route(AbstractLifecycleDispatcher.java:160)
cloudbreak_1 | at reactor.core.dispatch.MultiThreadDispatcher$MultiThreadTask.run(MultiThreadDispatcher.java:74)
cloudbreak_1 | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1135)
cloudbreak_1 | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
cloudbreak_1 | at java.base/java.lang.Thread.run(Thread.java:844)
... View more
Labels:
- Labels:
-
Hortonworks Cloudbreak
08-13-2018
06:52 PM
I was upgrading to HDP 3.0 and keep getting a timeout error when trying to start Ranger: Python script has been killed due to timeout after waiting 600 secs
stdout:
2018-08-06 19:21:53,314 - Stack Feature Version Info: Cluster Stack=3.0, Command Stack=None, Command Version=3.0.0.0-1634, Upgrade Direction=upgrade -> 3.0.0.0-1634
2018-08-06 19:21:53,336 - Using hadoop conf dir: /usr/hdp/3.0.0.0-1634/hadoop/conf
2018-08-06 19:21:53,679 - Stack Feature Version Info: Cluster Stack=3.0, Command Stack=None, Command Version=3.0.0.0-1634, Upgrade Direction=upgrade -> 3.0.0.0-1634
2018-08-06 19:21:53,688 - Using hadoop conf dir: /usr/hdp/3.0.0.0-1634/hadoop/conf
2018-08-06 19:21:53,690 - Group['ranger'] {}
2018-08-06 19:21:53,692 - Group['hdfs'] {}
2018-08-06 19:21:53,692 - Group['hadoop'] {}
2018-08-06 19:21:53,693 - Group['users'] {}
2018-08-06 19:21:53,694 - User['yarn-ats'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': ['hadoop'], 'uid': None}
2018-08-06 19:21:53,697 - User['infra-solr'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': ['hadoop'], 'uid': None}
2018-08-06 19:21:53,699 - User['zookeeper'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': ['hadoop'], 'uid': None}
2018-08-06 19:21:53,700 - User['atlas'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': ['hadoop'], 'uid': None}
2018-08-06 19:21:53,702 - User['ams'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': ['hadoop'], 'uid': None}
2018-08-06 19:21:53,703 - User['ranger'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': ['ranger', 'hadoop'], 'uid': None}
2018-08-06 19:21:53,705 - User['logsearch'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': ['hadoop'], 'uid': None}
2018-08-06 19:21:53,706 - User['ambari-qa'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': ['hadoop', 'users'], 'uid': None}
2018-08-06 19:21:53,707 - User['kafka'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': ['hadoop'], 'uid': None}
2018-08-06 19:21:53,709 - User['hdfs'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': ['hdfs', 'hadoop'], 'uid': None}
2018-08-06 19:21:53,710 - Modifying user hdfs
2018-08-06 19:21:53,732 - User['yarn'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': ['hadoop'], 'uid': None}
2018-08-06 19:21:53,735 - User['mapred'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': ['hadoop'], 'uid': None}
2018-08-06 19:21:53,737 - User['hbase'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': ['hadoop'], 'uid': None}
2018-08-06 19:21:53,739 - File['/var/lib/ambari-agent/tmp/changeUid.sh'] {'content': StaticFile('changeToSecureUid.sh'), 'mode': 0555}
2018-08-06 19:21:53,742 - Execute['/var/lib/ambari-agent/tmp/changeUid.sh ambari-qa /tmp/hadoop-ambari-qa,/tmp/hsperfdata_ambari-qa,/home/ambari-qa,/tmp/ambari-qa,/tmp/sqoop-ambari-qa 0'] {'not_if': '(test $(id -u ambari-qa) -gt 1000) || (false)'}
2018-08-06 19:21:53,751 - Skipping Execute['/var/lib/ambari-agent/tmp/changeUid.sh ambari-qa /tmp/hadoop-ambari-qa,/tmp/hsperfdata_ambari-qa,/home/ambari-qa,/tmp/ambari-qa,/tmp/sqoop-ambari-qa 0'] due to not_if
2018-08-06 19:21:53,752 - Directory['/tmp/hbase-hbase'] {'owner': 'hbase', 'create_parents': True, 'mode': 0775, 'cd_access': 'a'}
2018-08-06 19:21:53,754 - File['/var/lib/ambari-agent/tmp/changeUid.sh'] {'content': StaticFile('changeToSecureUid.sh'), 'mode': 0555}
2018-08-06 19:21:53,756 - File['/var/lib/ambari-agent/tmp/changeUid.sh'] {'content': StaticFile('changeToSecureUid.sh'), 'mode': 0555}
2018-08-06 19:21:53,758 - call['/var/lib/ambari-agent/tmp/changeUid.sh hbase'] {}
2018-08-06 19:21:53,772 - call returned (0, '65549')
2018-08-06 19:21:53,773 - Execute['/var/lib/ambari-agent/tmp/changeUid.sh hbase /home/hbase,/tmp/hbase,/usr/bin/hbase,/var/log/hbase,/tmp/hbase-hbase 65549'] {'not_if': '(test $(id -u hbase) -gt 1000) || (false)'}
2018-08-06 19:21:53,782 - Skipping Execute['/var/lib/ambari-agent/tmp/changeUid.sh hbase /home/hbase,/tmp/hbase,/usr/bin/hbase,/var/log/hbase,/tmp/hbase-hbase 65549'] due to not_if
2018-08-06 19:21:53,783 - Group['hdfs'] {}
2018-08-06 19:21:53,783 - User['hdfs'] {'fetch_nonlocal_groups': True, 'groups': ['hdfs', 'hadoop', 'hadoop', u'hdfs']}
2018-08-06 19:21:53,784 - Modifying user hdfs
2018-08-06 19:21:53,800 - FS Type: HDFS
2018-08-06 19:21:53,801 - Directory['/etc/hadoop'] {'mode': 0755}
2018-08-06 19:21:53,829 - File['/usr/hdp/3.0.0.0-1634/hadoop/conf/hadoop-env.sh'] {'content': InlineTemplate(...), 'owner': 'hdfs', 'group': 'hadoop'}
2018-08-06 19:21:53,830 - Directory['/var/lib/ambari-agent/tmp/hadoop_java_io_tmpdir'] {'owner': 'hdfs', 'group': 'hadoop', 'mode': 01777}
2018-08-06 19:21:53,859 - Execute[('setenforce', '0')] {'not_if': '(! which getenforce ) || (which getenforce && getenforce | grep -q Disabled)', 'sudo': True, 'only_if': 'test -f /selinux/enforce'}
2018-08-06 19:21:53,875 - Skipping Execute[('setenforce', '0')] due to only_if
2018-08-06 19:21:53,876 - Directory['/var/log/hadoop'] {'owner': 'root', 'create_parents': True, 'group': 'hadoop', 'mode': 0775, 'cd_access': 'a'}
2018-08-06 19:21:53,880 - Directory['/var/run/hadoop'] {'owner': 'root', 'create_parents': True, 'group': 'root', 'cd_access': 'a'}
2018-08-06 19:21:53,881 - Directory['/var/run/hadoop/hdfs'] {'owner': 'hdfs', 'cd_access': 'a'}
2018-08-06 19:21:53,882 - Directory['/tmp/hadoop-hdfs'] {'owner': 'hdfs', 'create_parents': True, 'cd_access': 'a'}
2018-08-06 19:21:53,889 - File['/usr/hdp/3.0.0.0-1634/hadoop/conf/commons-logging.properties'] {'content': Template('commons-logging.properties.j2'), 'owner': 'hdfs'}
2018-08-06 19:21:53,892 - File['/usr/hdp/3.0.0.0-1634/hadoop/conf/health_check'] {'content': Template('health_check.j2'), 'owner': 'hdfs'}
2018-08-06 19:21:53,902 - File['/usr/hdp/3.0.0.0-1634/hadoop/conf/log4j.properties'] {'content': InlineTemplate(...), 'owner': 'hdfs', 'group': 'hadoop', 'mode': 0644}
2018-08-06 19:21:53,918 - File['/usr/hdp/3.0.0.0-1634/hadoop/conf/hadoop-metrics2.properties'] {'content': Template('hadoop-metrics2.properties.j2'), 'owner': 'hdfs', 'group': 'hadoop'}
2018-08-06 19:21:53,920 - File['/usr/hdp/3.0.0.0-1634/hadoop/conf/task-log4j.properties'] {'content': StaticFile('task-log4j.properties'), 'mode': 0755}
2018-08-06 19:21:53,921 - File['/usr/hdp/3.0.0.0-1634/hadoop/conf/configuration.xsl'] {'owner': 'hdfs', 'group': 'hadoop'}
2018-08-06 19:21:53,927 - File['/etc/hadoop/conf/topology_mappings.data'] {'owner': 'hdfs', 'content': Template('topology_mappings.data.j2'), 'only_if': 'test -d /etc/hadoop/conf', 'group': 'hadoop', 'mode': 0644}
2018-08-06 19:21:53,932 - File['/etc/hadoop/conf/topology_script.py'] {'content': StaticFile('topology_script.py'), 'only_if': 'test -d /etc/hadoop/conf', 'mode': 0755}
2018-08-06 19:21:53,937 - Skipping unlimited key JCE policy check and setup since the Java VM is not managed by Ambari
2018-08-06 19:21:54,340 - Stack Feature Version Info: Cluster Stack=3.0, Command Stack=None, Command Version=3.0.0.0-1634, Upgrade Direction=upgrade -> 3.0.0.0-1634
2018-08-06 19:21:54,393 - File['/var/lib/ambari-agent/tmp/mysql-jdbc-driver.jar'] {'content': DownloadSource('http://r7u07.thanos.gotgdt.net:8080/resources/mysql-jdbc-driver.jar'), 'mode': 0644}
2018-08-06 19:21:54,394 - Not downloading the file from http://r7u07.thanos.gotgdt.net:8080/resources/mysql-jdbc-driver.jar, because /var/lib/ambari-agent/tmp/mysql-jdbc-driver.jar already exists
2018-08-06 19:21:54,395 - Execute[('cp', '--remove-destination', u'/var/lib/ambari-agent/tmp/mysql-jdbc-driver.jar', u'/usr/hdp/current/ranger-admin/ews/lib')] {'path': ['/bin', '/usr/bin/'], 'sudo': True}
2018-08-06 19:21:54,407 - File['/usr/hdp/current/ranger-admin/ews/lib/mysql-jdbc-driver.jar'] {'mode': 0644}
2018-08-06 19:21:54,407 - Changing permission for /usr/hdp/current/ranger-admin/ews/lib/mysql-jdbc-driver.jar from 600 to 644
2018-08-06 19:21:54,408 - ModifyPropertiesFile['/usr/hdp/current/ranger-admin/install.properties'] {'owner': 'ranger', 'properties': ...}
2018-08-06 19:21:54,409 - Modifying existing properties file: /usr/hdp/current/ranger-admin/install.properties
2018-08-06 19:21:54,419 - File['/usr/hdp/current/ranger-admin/install.properties'] {'owner': 'ranger', 'content': ..., 'group': None, 'mode': None, 'encoding': 'utf-8'}
2018-08-06 19:21:54,420 - Writing File['/usr/hdp/current/ranger-admin/install.properties'] because contents don't match
2018-08-06 19:21:54,421 - ModifyPropertiesFile['/usr/hdp/current/ranger-admin/install.properties'] {'owner': 'ranger', 'properties': {'SQL_CONNECTOR_JAR': u'/usr/hdp/current/ranger-admin/ews/lib/mysql-jdbc-driver.jar'}}
2018-08-06 19:21:54,421 - Modifying existing properties file: /usr/hdp/current/ranger-admin/install.properties
2018-08-06 19:21:54,422 - File['/usr/hdp/current/ranger-admin/install.properties'] {'owner': 'ranger', 'content': ..., 'group': None, 'mode': None, 'encoding': 'utf-8'}
2018-08-06 19:21:54,423 - ModifyPropertiesFile['/usr/hdp/current/ranger-admin/install.properties'] {'owner': 'ranger', 'properties': {'audit_store': u'solr'}}
2018-08-06 19:21:54,423 - Modifying existing properties file: /usr/hdp/current/ranger-admin/install.properties
2018-08-06 19:21:54,425 - File['/usr/hdp/current/ranger-admin/install.properties'] {'owner': 'ranger', 'content': ..., 'group': None, 'mode': None, 'encoding': 'utf-8'}
2018-08-06 19:21:54,425 - Setting up Ranger DB and DB User
2018-08-06 19:21:54,425 - Execute['ambari-python-wrap /usr/hdp/current/ranger-admin/dba_script.py -q'] {'logoutput': True, 'environment': {'RANGER_ADMIN_HOME': u'/usr/hdp/current/ranger-admin', 'JAVA_HOME': u'/usr/java/default'}, 'user': 'ranger'}
2018-08-06 19:21:54,643 [I] Running DBA setup script. QuiteMode:True
2018-08-06 19:21:54,643 [I] Using Java:/usr/java/default/bin/java
2018-08-06 19:21:54,643 [I] DB FLAVOR:MYSQL
2018-08-06 19:21:54,643 [I] DB Host:r7u07.thanos.gotgdt.net
2018-08-06 19:21:54,643 [I] ---------- Verifying DB root password ----------
2018-08-06 19:21:54,644 [I] DBA root user password validated
2018-08-06 19:21:54,644 [I] ---------- Verifying Ranger Admin db user password ----------
2018-08-06 19:21:54,644 [I] admin user password validated
2018-08-06 19:21:54,644 [I] ---------- Creating Ranger Admin db user ----------
2018-08-06 19:21:54,644 [JISQL] /usr/java/default/bin/java -cp /usr/hdp/current/ranger-admin/ews/lib/mysql-jdbc-driver.jar:/usr/hdp/current/ranger-admin/jisql/lib/* org.apache.util.sql.Jisql -driver mysqlconj -cstring jdbc:mysql://r7u07.thanos.gotgdt.net/mysql -u root -p '********' -noheader -trim -c \; -query "SELECT version();"
2018-08-06 19:21:55,093 [I] Verifying user rangeradmin for Host %
2018-08-06 19:21:55,093 [JISQL] /usr/java/default/bin/java -cp /usr/hdp/current/ranger-admin/ews/lib/mysql-jdbc-driver.jar:/usr/hdp/current/ranger-admin/jisql/lib/* org.apache.util.sql.Jisql -driver mysqlconj -cstring jdbc:mysql://r7u07.thanos.gotgdt.net/mysql -u root -p '********' -noheader -trim -c \; -query "select user from mysql.user where user='rangeradmin' and host='%';"
2018-08-06 19:21:55,528 [I] MySQL user rangeradmin already exists for host %
2018-08-06 19:21:55,528 [I] Verifying user rangeradmin for Host localhost
2018-08-06 19:21:55,528 [JISQL] /usr/java/default/bin/java -cp /usr/hdp/current/ranger-admin/ews/lib/mysql-jdbc-driver.jar:/usr/hdp/current/ranger-admin/jisql/lib/* org.apache.util.sql.Jisql -driver mysqlconj -cstring jdbc:mysql://r7u07.thanos.gotgdt.net/mysql -u root -p '********' -noheader -trim -c \; -query "select user from mysql.user where user='rangeradmin' and host='localhost';"
2018-08-06 19:21:55,992 [I] MySQL user rangeradmin already exists for host localhost
2018-08-06 19:21:55,993 [I] Verifying user rangeradmin for Host r7u07.thanos.gotgdt.net
2018-08-06 19:21:55,993 [JISQL] /usr/java/default/bin/java -cp /usr/hdp/current/ranger-admin/ews/lib/mysql-jdbc-driver.jar:/usr/hdp/current/ranger-admin/jisql/lib/* org.apache.util.sql.Jisql -driver mysqlconj -cstring jdbc:mysql://r7u07.thanos.gotgdt.net/mysql -u root -p '********' -noheader -trim -c \; -query "select user from mysql.user where user='rangeradmin' and host='r7u07.thanos.gotgdt.net';"
2018-08-06 19:21:56,429 [I] MySQL user rangeradmin already exists for host r7u07.thanos.gotgdt.net
2018-08-06 19:21:56,430 [I] ---------- Creating Ranger Admin database ----------
2018-08-06 19:21:56,430 [I] Verifying database ranger
2018-08-06 19:21:56,430 [JISQL] /usr/java/default/bin/java -cp /usr/hdp/current/ranger-admin/ews/lib/mysql-jdbc-driver.jar:/usr/hdp/current/ranger-admin/jisql/lib/* org.apache.util.sql.Jisql -driver mysqlconj -cstring jdbc:mysql://r7u07.thanos.gotgdt.net/mysql -u root -p '********' -noheader -trim -c \; -query "show databases like 'ranger';"
2018-08-06 19:21:56,888 [I] Database ranger already exists.
2018-08-06 19:21:56,889 [I] ---------- Granting permission to Ranger Admin db user ----------
2018-08-06 19:21:56,889 [I] ---------- Granting privileges TO user 'rangeradmin'@'%' on db 'ranger'----------
2018-08-06 19:21:56,889 [JISQL] /usr/java/default/bin/java -cp /usr/hdp/current/ranger-admin/ews/lib/mysql-jdbc-driver.jar:/usr/hdp/current/ranger-admin/jisql/lib/* org.apache.util.sql.Jisql -driver mysqlconj -cstring jdbc:mysql://r7u07.thanos.gotgdt.net/mysql -u root -p '********' -noheader -trim -c \; -query "grant all privileges on ranger.* to 'rangeradmin'@'%' with grant option;"
2018-08-06 19:21:57,337 [I] ---------- FLUSH PRIVILEGES ----------
2018-08-06 19:21:57,338 [JISQL] /usr/java/default/bin/java -cp /usr/hdp/current/ranger-admin/ews/lib/mysql-jdbc-driver.jar:/usr/hdp/current/ranger-admin/jisql/lib/* org.apache.util.sql.Jisql -driver mysqlconj -cstring jdbc:mysql://r7u07.thanos.gotgdt.net/mysql -u root -p '********' -noheader -trim -c \; -query "FLUSH PRIVILEGES;"
2018-08-06 19:21:57,820 [I] Privileges granted to 'rangeradmin' on 'ranger'
2018-08-06 19:21:57,820 [I] ---------- Granting privileges TO user 'rangeradmin'@'localhost' on db 'ranger'----------
2018-08-06 19:21:57,821 [JISQL] /usr/java/default/bin/java -cp /usr/hdp/current/ranger-admin/ews/lib/mysql-jdbc-driver.jar:/usr/hdp/current/ranger-admin/jisql/lib/* org.apache.util.sql.Jisql -driver mysqlconj -cstring jdbc:mysql://r7u07.thanos.gotgdt.net/mysql -u root -p '********' -noheader -trim -c \; -query "grant all privileges on ranger.* to 'rangeradmin'@'localhost' with grant option;"
2018-08-06 19:21:58,267 [I] ---------- FLUSH PRIVILEGES ----------
2018-08-06 19:21:58,267 [JISQL] /usr/java/default/bin/java -cp /usr/hdp/current/ranger-admin/ews/lib/mysql-jdbc-driver.jar:/usr/hdp/current/ranger-admin/jisql/lib/* org.apache.util.sql.Jisql -driver mysqlconj -cstring jdbc:mysql://r7u07.thanos.gotgdt.net/mysql -u root -p '********' -noheader -trim -c \; -query "FLUSH PRIVILEGES;"
2018-08-06 19:21:58,715 [I] Privileges granted to 'rangeradmin' on 'ranger'
2018-08-06 19:21:58,715 [I] ---------- Granting privileges TO user 'rangeradmin'@'r7u07.thanos.gotgdt.net' on db 'ranger'----------
2018-08-06 19:21:58,716 [JISQL] /usr/java/default/bin/java -cp /usr/hdp/current/ranger-admin/ews/lib/mysql-jdbc-driver.jar:/usr/hdp/current/ranger-admin/jisql/lib/* org.apache.util.sql.Jisql -driver mysqlconj -cstring jdbc:mysql://r7u07.thanos.gotgdt.net/mysql -u root -p '********' -noheader -trim -c \; -query "grant all privileges on ranger.* to 'rangeradmin'@'r7u07.thanos.gotgdt.net' with grant option;"
2018-08-06 19:21:59,197 [I] ---------- FLUSH PRIVILEGES ----------
2018-08-06 19:21:59,197 [JISQL] /usr/java/default/bin/java -cp /usr/hdp/current/ranger-admin/ews/lib/mysql-jdbc-driver.jar:/usr/hdp/current/ranger-admin/jisql/lib/* org.apache.util.sql.Jisql -driver mysqlconj -cstring jdbc:mysql://r7u07.thanos.gotgdt.net/mysql -u root -p '********' -noheader -trim -c \; -query "FLUSH PRIVILEGES;"
2018-08-06 19:21:59,642 [I] Privileges granted to 'rangeradmin' on 'ranger'
2018-08-06 19:21:59,642 [I] ---------- Ranger Policy Manager DB and User Creation Process Completed.. ----------
2018-08-06 19:21:59,660 - Execute['ambari-python-wrap /usr/hdp/current/ranger-admin/db_setup.py'] {'logoutput': True, 'environment': {'PATH': '/usr/sbin:/sbin:/usr/lib/ambari-server/*:/usr/lib64/qt-3.3/bin:/opt/anaconda/bin:/usr/local/sbin:/sbin:/bin:/usr/sbin:/usr/bin::/opt/bro/bin:/root/bin:/var/lib/ambari-agent', 'RANGER_ADMIN_HOME': u'/usr/hdp/current/ranger-admin', 'JAVA_HOME': u'/usr/java/default'}, 'user': 'ranger'}
2018-08-06 19:22:00,135 [I] DB FLAVOR :MYSQL
2018-08-06 19:22:00,136 [I] --------- Verifying Ranger DB connection ---------
2018-08-06 19:22:00,136 [I] Checking connection..
2018-08-06 19:22:00,136 [JISQL] /usr/java/default/bin/java -cp /usr/hdp/current/ranger-admin/ews/lib/mysql-jdbc-driver.jar:/usr/hdp/current/ranger-admin/jisql/lib/* org.apache.util.sql.Jisql -driver mysqlconj -cstring jdbc:mysql://r7u07.thanos.gotgdt.net/ranger -u 'rangeradmin' -p '********' -noheader -trim -c \; -query "SELECT version();"
2018-08-06 19:22:00,744 [I] Checking connection passed.
2018-08-06 19:22:00,744 [I] --------- Verifying version history table ---------
2018-08-06 19:22:00,745 [JISQL] /usr/java/default/bin/java -cp /usr/hdp/current/ranger-admin/ews/lib/mysql-jdbc-driver.jar:/usr/hdp/current/ranger-admin/jisql/lib/* org.apache.util.sql.Jisql -driver mysqlconj -cstring jdbc:mysql://r7u07.thanos.gotgdt.net/ranger -u 'rangeradmin' -p '********' -noheader -trim -c \; -query "show tables like 'x_db_version_h';"
2018-08-06 19:22:01,203 [I] Table x_db_version_h already exists in database 'ranger'
2018-08-06 19:22:01,203 [I] --------- Importing Ranger Core DB Schema ---------
2018-08-06 19:22:01,203 [JISQL] /usr/java/default/bin/java -cp /usr/hdp/current/ranger-admin/ews/lib/mysql-jdbc-driver.jar:/usr/hdp/current/ranger-admin/jisql/lib/* org.apache.util.sql.Jisql -driver mysqlconj -cstring jdbc:mysql://r7u07.thanos.gotgdt.net/ranger -u 'rangeradmin' -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2018-08-06 19:22:01,666 [I] CORE_DB_SCHEMA is already imported
2018-08-06 19:22:01,666 [JISQL] /usr/java/default/bin/java -cp /usr/hdp/current/ranger-admin/ews/lib/mysql-jdbc-driver.jar:/usr/hdp/current/ranger-admin/jisql/lib/* org.apache.util.sql.Jisql -driver mysqlconj -cstring jdbc:mysql://r7u07.thanos.gotgdt.net/ranger -u 'rangeradmin' -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 1.1.0.3.0.0.0-1634' and active='Y';"
2018-08-06 19:22:02,097 [I] --------- Applying Ranger DB patches ---------
2018-08-06 19:22:02,097 [I] Executing patch on ranger from file: 001-groupsource.sql
2018-08-06 19:22:02,098 [JISQL] /usr/java/default/bin/java -cp /usr/hdp/current/ranger-admin/ews/lib/mysql-jdbc-driver.jar:/usr/hdp/current/ranger-admin/jisql/lib/* org.apache.util.sql.Jisql -driver mysqlconj -cstring jdbc:mysql://r7u07.thanos.gotgdt.net/ranger -u 'rangeradmin' -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = '001' and active = 'Y';"
2018-08-06 19:22:02,519 [I] Patch 001-groupsource.sql is already applied
2018-08-06 19:22:02,520 [I] Executing patch on ranger from file: 002-policyname.sql
2018-08-06 19:22:02,520 [JISQL] /usr/java/default/bin/java -cp /usr/hdp/current/ranger-admin/ews/lib/mysql-jdbc-driver.jar:/usr/hdp/current/ranger-admin/jisql/lib/* org.apache.util.sql.Jisql -driver mysqlconj -cstring jdbc:mysql://r7u07.thanos.gotgdt.net/ranger -u 'rangeradmin' -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = '002' and active = 'Y';"
2018-08-06 19:22:02,943 [I] Patch 002-policyname.sql is already applied
2018-08-06 19:22:02,943 [I] Executing patch on ranger from file: 003-knoxrepo.sql
2018-08-06 19:22:02,943 [JISQL] /usr/java/default/bin/java -cp /usr/hdp/current/ranger-admin/ews/lib/mysql-jdbc-driver.jar:/usr/hdp/current/ranger-admin/jisql/lib/* org.apache.util.sql.Jisql -driver mysqlconj -cstring jdbc:mysql://r7u07.thanos.gotgdt.net/ranger -u 'rangeradmin' -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = '003' and active = 'Y';"
2018-08-06 19:22:03,407 [I] Patch 003-knoxrepo.sql is already applied
2018-08-06 19:22:03,408 [I] Executing patch on ranger from file: 004-assetconfigsize.sql
2018-08-06 19:22:03,408 [JISQL] /usr/java/default/bin/java -cp /usr/hdp/current/ranger-admin/ews/lib/mysql-jdbc-driver.jar:/usr/hdp/current/ranger-admin/jisql/lib/* org.apache.util.sql.Jisql -driver mysqlconj -cstring jdbc:mysql://r7u07.thanos.gotgdt.net/ranger -u 'rangeradmin' -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = '004' and active = 'Y';"
2018-08-06 19:22:03,836 [I] Patch 004-assetconfigsize.sql is already applied
2018-08-06 19:22:03,837 [I] Executing patch on ranger from file: 005-xtrxlogcolumnsize.sql
2018-08-06 19:22:03,837 [JISQL] /usr/java/default/bin/java -cp /usr/hdp/current/ranger-admin/ews/lib/mysql-jdbc-driver.jar:/usr/hdp/current/ranger-admin/jisql/lib/* org.apache.util.sql.Jisql -driver mysqlconj -cstring jdbc:mysql://r7u07.thanos.gotgdt.net/ranger -u 'rangeradmin' -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = '005' and active = 'Y';"
2018-08-06 19:22:04,258 [I] Patch 005-xtrxlogcolumnsize.sql is already applied
2018-08-06 19:22:04,259 [I] Executing patch on ranger from file: 006-createdefaultpublicgroup.sql
2018-08-06 19:22:04,259 [JISQL] /usr/java/default/bin/java -cp /usr/hdp/current/ranger-admin/ews/lib/mysql-jdbc-driver.jar:/usr/hdp/current/ranger-admin/jisql/lib/* org.apache.util.sql.Jisql -driver mysqlconj -cstring jdbc:mysql://r7u07.thanos.gotgdt.net/ranger -u 'rangeradmin' -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = '006' and active = 'Y';"
2018-08-06 19:22:04,689 [I] Patch 006-createdefaultpublicgroup.sql is already applied
2018-08-06 19:22:04,690 [I] Executing patch on ranger from file: 007-updateBlankPolicyName.sql
2018-08-06 19:22:04,690 [JISQL] /usr/java/default/bin/java -cp /usr/hdp/current/ranger-admin/ews/lib/mysql-jdbc-driver.jar:/usr/hdp/current/ranger-admin/jisql/lib/* org.apache.util.sql.Jisql -driver mysqlconj -cstring jdbc:mysql://r7u07.thanos.gotgdt.net/ranger -u 'rangeradmin' -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = '007' and active = 'Y';"
2018-08-06 19:22:05,134 [I] Patch 007-updateBlankPolicyName.sql is already applied
2018-08-06 19:22:05,134 [I] Executing patch on ranger from file: 008-removeTrailingSlash.sql
2018-08-06 19:22:05,134 [JISQL] /usr/java/default/bin/java -cp /usr/hdp/current/ranger-admin/ews/lib/mysql-jdbc-driver.jar:/usr/hdp/current/ranger-admin/jisql/lib/* org.apache.util.sql.Jisql -driver mysqlconj -cstring jdbc:mysql://r7u07.thanos.gotgdt.net/ranger -u 'rangeradmin' -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = '008' and active = 'Y';"
2018-08-06 19:22:05,590 [I] Patch 008-removeTrailingSlash.sql is already applied
2018-08-06 19:22:05,591 [I] Executing patch on ranger from file: 009-updated_schema.sql
2018-08-06 19:22:05,591 [JISQL] /usr/java/default/bin/java -cp /usr/hdp/current/ranger-admin/ews/lib/mysql-jdbc-driver.jar:/usr/hdp/current/ranger-admin/jisql/lib/* org.apache.util.sql.Jisql -driver mysqlconj -cstring jdbc:mysql://r7u07.thanos.gotgdt.net/ranger -u 'rangeradmin' -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = '009' and active = 'Y';"
2018-08-06 19:22:06,029 [I] Patch 009-updated_schema.sql is already applied
2018-08-06 19:22:06,030 [I] Executing patch on ranger from file: 010-users-and-groups-visibility.sql
2018-08-06 19:22:06,030 [JISQL] /usr/java/default/bin/java -cp /usr/hdp/current/ranger-admin/ews/lib/mysql-jdbc-driver.jar:/usr/hdp/current/ranger-admin/jisql/lib/* org.apache.util.sql.Jisql -driver mysqlconj -cstring jdbc:mysql://r7u07.thanos.gotgdt.net/ranger -u 'rangeradmin' -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = '010' and active = 'Y';"
2018-08-06 19:22:06,453 [I] Patch 010-users-and-groups-visibility.sql is already applied
2018-08-06 19:22:06,454 [I] Executing patch on ranger from file: 012-createusersyncuser.sql
2018-08-06 19:22:06,454 [JISQL] /usr/java/default/bin/java -cp /usr/hdp/current/ranger-admin/ews/lib/mysql-jdbc-driver.jar:/usr/hdp/current/ranger-admin/jisql/lib/* org.apache.util.sql.Jisql -driver mysqlconj -cstring jdbc:mysql://r7u07.thanos.gotgdt.net/ranger -u 'rangeradmin' -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = '012' and active = 'Y';"
2018-08-06 19:22:06,908 [I] Patch 012-createusersyncuser.sql is already applied
2018-08-06 19:22:06,909 [I] Executing patch on ranger from file: 013-permissionmodel.sql
2018-08-06 19:22:06,909 [JISQL] /usr/java/default/bin/java -cp /usr/hdp/current/ranger-admin/ews/lib/mysql-jdbc-driver.jar:/usr/hdp/current/ranger-admin/jisql/lib/* org.apache.util.sql.Jisql -driver mysqlconj -cstring jdbc:mysql://r7u07.thanos.gotgdt.net/ranger -u 'rangeradmin' -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = '013' and active = 'Y';"
2018-08-06 19:22:07,387 [I] Patch 013-permissionmodel.sql is already applied
2018-08-06 19:22:07,388 [I] Executing patch on ranger from file: 014-createkeyadmin.sql
2018-08-06 19:22:07,388 [JISQL] /usr/java/default/bin/java -cp /usr/hdp/current/ranger-admin/ews/lib/mysql-jdbc-driver.jar:/usr/hdp/current/ranger-admin/jisql/lib/* org.apache.util.sql.Jisql -driver mysqlconj -cstring jdbc:mysql://r7u07.thanos.gotgdt.net/ranger -u 'rangeradmin' -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = '014' and active = 'Y';"
2018-08-06 19:22:07,834 [I] Patch 014-createkeyadmin.sql is already applied
2018-08-06 19:22:07,835 [I] Executing patch on ranger from file: 016-updated-schema-for-tag-based-policy.sql
2018-08-06 19:22:07,835 [JISQL] /usr/java/default/bin/java -cp /usr/hdp/current/ranger-admin/ews/lib/mysql-jdbc-driver.jar:/usr/hdp/current/ranger-admin/jisql/lib/* org.apache.util.sql.Jisql -driver mysqlconj -cstring jdbc:mysql://r7u07.thanos.gotgdt.net/ranger -u 'rangeradmin' -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = '016' and active = 'Y';"
2018-08-06 19:22:08,310 [I] Patch 016-updated-schema-for-tag-based-policy.sql is already applied
2018-08-06 19:22:08,310 [I] Executing patch on ranger from file: 018-createtagsyncuser.sql
2018-08-06 19:22:08,311 [JISQL] /usr/java/default/bin/java -cp /usr/hdp/current/ranger-admin/ews/lib/mysql-jdbc-driver.jar:/usr/hdp/current/ranger-admin/jisql/lib/* org.apache.util.sql.Jisql -driver mysqlconj -cstring jdbc:mysql://r7u07.thanos.gotgdt.net/ranger -u 'rangeradmin' -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = '018' and active = 'Y';"
2018-08-06 19:22:08,764 [I] Patch 018-createtagsyncuser.sql is already applied
2018-08-06 19:22:08,765 [I] Executing patch on ranger from file: 019-create-indexes.sql
2018-08-06 19:22:08,765 [JISQL] /usr/java/default/bin/java -cp /usr/hdp/current/ranger-admin/ews/lib/mysql-jdbc-driver.jar:/usr/hdp/current/ranger-admin/jisql/lib/* org.apache.util.sql.Jisql -driver mysqlconj -cstring jdbc:mysql://r7u07.thanos.gotgdt.net/ranger -u 'rangeradmin' -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = '019' and active = 'Y';"
2018-08-06 19:22:09,264 [I] Patch 019-create-indexes.sql is already applied
2018-08-06 19:22:09,264 [I] Executing patch on ranger from file: 020-datamask-policy.sql
2018-08-06 19:22:09,265 [JISQL] /usr/java/default/bin/java -cp /usr/hdp/current/ranger-admin/ews/lib/mysql-jdbc-driver.jar:/usr/hdp/current/ranger-admin/jisql/lib/* org.apache.util.sql.Jisql -driver mysqlconj -cstring jdbc:mysql://r7u07.thanos.gotgdt.net/ranger -u 'rangeradmin' -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = '020' and active = 'Y';"
2018-08-06 19:22:09,716 [I] Patch 020-datamask-policy.sql is already applied
2018-08-06 19:22:09,717 [I] Executing patch on ranger from file: 021-update-tag-for-owner.sql
2018-08-06 19:22:09,717 [JISQL] /usr/java/default/bin/java -cp /usr/hdp/current/ranger-admin/ews/lib/mysql-jdbc-driver.jar:/usr/hdp/current/ranger-admin/jisql/lib/* org.apache.util.sql.Jisql -driver mysqlconj -cstring jdbc:mysql://r7u07.thanos.gotgdt.net/ranger -u 'rangeradmin' -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = '021' and active = 'Y';"
2018-08-06 19:22:10,142 [I] Patch 021-update-tag-for-owner.sql is already applied
2018-08-06 19:22:10,143 [I] Executing patch on ranger from file: 022-split-service-table.sql
2018-08-06 19:22:10,143 [JISQL] /usr/java/default/bin/java -cp /usr/hdp/current/ranger-admin/ews/lib/mysql-jdbc-driver.jar:/usr/hdp/current/ranger-admin/jisql/lib/* org.apache.util.sql.Jisql -driver mysqlconj -cstring jdbc:mysql://r7u07.thanos.gotgdt.net/ranger -u 'rangeradmin' -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = '022' and active = 'Y';"
2018-08-06 19:22:10,569 [I] Patch 022-split-service-table.sql is already applied
2018-08-06 19:22:10,570 [I] Executing patch on ranger from file: 023-add-unique-constraint-on-table-x_user.sql
2018-08-06 19:22:10,570 [JISQL] /usr/java/default/bin/java -cp /usr/hdp/current/ranger-admin/ews/lib/mysql-jdbc-driver.jar:/usr/hdp/current/ranger-admin/jisql/lib/* org.apache.util.sql.Jisql -driver mysqlconj -cstring jdbc:mysql://r7u07.thanos.gotgdt.net/ranger -u 'rangeradmin' -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = '023' and active = 'Y';"
2018-08-06 19:22:11,014 [I] Patch 023-add-unique-constraint-on-table-x_user.sql is already applied
2018-08-06 19:22:11,014 [I] Executing patch on ranger from file: 024-sortorder-column-size.sql
2018-08-06 19:22:11,015 [JISQL] /usr/java/default/bin/java -cp /usr/hdp/current/ranger-admin/ews/lib/mysql-jdbc-driver.jar:/usr/hdp/current/ranger-admin/jisql/lib/* org.apache.util.sql.Jisql -driver mysqlconj -cstring jdbc:mysql://r7u07.thanos.gotgdt.net/ranger -u 'rangeradmin' -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = '024' and active = 'Y';"
2018-08-06 19:22:11,447 [I] Patch 024-sortorder-column-size.sql is already applied
2018-08-06 19:22:11,448 [I] Executing patch on ranger from file: 025-create-schema-for-plugin-info.sql
2018-08-06 19:22:11,448 [JISQL] /usr/java/default/bin/java -cp /usr/hdp/current/ranger-admin/ews/lib/mysql-jdbc-driver.jar:/usr/hdp/current/ranger-admin/jisql/lib/* org.apache.util.sql.Jisql -driver mysqlconj -cstring jdbc:mysql://r7u07.thanos.gotgdt.net/ranger -u 'rangeradmin' -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = '025' and active = 'Y';"
2018-08-06 19:22:11,893 [I] Patch 025-create-schema-for-plugin-info.sql is already applied
2018-08-06 19:22:11,893 [I] Executing patch on ranger from file: 026-add-column-in-x_policy_export_audit.sql
2018-08-06 19:22:11,893 [JISQL] /usr/java/default/bin/java -cp /usr/hdp/current/ranger-admin/ews/lib/mysql-jdbc-driver.jar:/usr/hdp/current/ranger-admin/jisql/lib/* org.apache.util.sql.Jisql -driver mysqlconj -cstring jdbc:mysql://r7u07.thanos.gotgdt.net/ranger -u 'rangeradmin' -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = '026' and active = 'Y';"
2018-08-06 19:22:12,360 [I] Patch 026-add-column-in-x_policy_export_audit.sql is already applied
2018-08-06 19:22:12,360 [I] Executing patch on ranger from file: 027-sortorder-column-size.sql
2018-08-06 19:22:12,360 [JISQL] /usr/java/default/bin/java -cp /usr/hdp/current/ranger-admin/ews/lib/mysql-jdbc-driver.jar:/usr/hdp/current/ranger-admin/jisql/lib/* org.apache.util.sql.Jisql -driver mysqlconj -cstring jdbc:mysql://r7u07.thanos.gotgdt.net/ranger -u 'rangeradmin' -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = '027' and active = 'Y';"
2018-08-06 19:22:12,816 [I] Patch 027-sortorder-column-size.sql is already applied
2018-08-06 19:22:12,816 [I] Executing patch on ranger from file: 028-delete-xgroup-duplicate-references.sql
2018-08-06 19:22:12,816 [JISQL] /usr/java/default/bin/java -cp /usr/hdp/current/ranger-admin/ews/lib/mysql-jdbc-driver.jar:/usr/hdp/current/ranger-admin/jisql/lib/* org.apache.util.sql.Jisql -driver mysqlconj -cstring jdbc:mysql://r7u07.thanos.gotgdt.net/ranger -u 'rangeradmin' -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = '028' and active = 'Y';"
2018-08-06 19:22:13,299 [JISQL] /usr/java/default/bin/java -cp /usr/hdp/current/ranger-admin/ews/lib/mysql-jdbc-driver.jar:/usr/hdp/current/ranger-admin/jisql/lib/* org.apache.util.sql.Jisql -driver mysqlconj -cstring jdbc:mysql://r7u07.thanos.gotgdt.net/ranger -u 'rangeradmin' -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = '028' and active = 'N';"
2018-08-06 19:22:13,734 [I] Patch 028-delete-xgroup-duplicate-references.sql is being applied by some other process
2018-08-06 19:24:13,773 [JISQL] /usr/java/default/bin/java -cp /usr/hdp/current/ranger-admin/ews/lib/mysql-jdbc-driver.jar:/usr/hdp/current/ranger-admin/jisql/lib/* org.apache.util.sql.Jisql -driver mysqlconj -cstring jdbc:mysql://r7u07.thanos.gotgdt.net/ranger -u 'rangeradmin' -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = '028' and active = 'N';"
2018-08-06 19:24:14,236 [I] Patch 028-delete-xgroup-duplicate-references.sql is being applied by some other process
2018-08-06 19:26:14,332 [JISQL] /usr/java/default/bin/java -cp /usr/hdp/current/ranger-admin/ews/lib/mysql-jdbc-driver.jar:/usr/hdp/current/ranger-admin/jisql/lib/* org.apache.util.sql.Jisql -driver mysqlconj -cstring jdbc:mysql://r7u07.thanos.gotgdt.net/ranger -u 'rangeradmin' -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = '028' and active = 'N';"
2018-08-06 19:26:14,799 [I] Patch 028-delete-xgroup-duplicate-references.sql is being applied by some other process
2018-08-06 19:28:14,899 [JISQL] /usr/java/default/bin/java -cp /usr/hdp/current/ranger-admin/ews/lib/mysql-jdbc-driver.jar:/usr/hdp/current/ranger-admin/jisql/lib/* org.apache.util.sql.Jisql -driver mysqlconj -cstring jdbc:mysql://r7u07.thanos.gotgdt.net/ranger -u 'rangeradmin' -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = '028' and active = 'N';"
2018-08-06 19:28:15,402 [I] Patch 028-delete-xgroup-duplicate-references.sql is being applied by some other process
2018-08-06 19:30:15,482 [JISQL] /usr/java/default/bin/java -cp /usr/hdp/current/ranger-admin/ews/lib/mysql-jdbc-driver.jar:/usr/hdp/current/ranger-admin/jisql/lib/* org.apache.util.sql.Jisql -driver mysqlconj -cstring jdbc:mysql://r7u07.thanos.gotgdt.net/ranger -u 'rangeradmin' -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = '028' and active = 'N';"
2018-08-06 19:30:15,970 [I] Patch 028-delete-xgroup-duplicate-references.sql is being applied by some other process
Command failed after 1 tries
... View more
Labels:
- Labels:
-
Apache Ranger
08-02-2018
04:46 PM
As it were, being in a walled off environment that does not have the latest version of the CentOS repos, this was a significantly more head-scratching affair. As it turns out, the simple fix is to update yum, which fixes this bug. Unfortunately, that was not an option for me. Fortunately, there is a manual work-around that did work: Comment 17, which is to o the following: sed -i "/for creq in pkg.conflicts:/a\ if creq[0].startswith('freeipa'): continue" /usr/lib/python2.7/site-packages/yum/rpmsack.py So, in case someone else runs into this issue and is in the same type of restricted environment that I am in, this should fix things for you too...
... View more
08-02-2018
03:46 PM
I am attempting to upgrade from HDP 2.6 to 3.0 and am encountering dependency conflicts related to freeipa on CentOS 7. Has anyone else encountered this? From a quick google search, the freeipa/ipa conflict is a known bug that can be ignored, but I am unsure of how to get Ambari to do so...or if that is a good idea: stderr:
2018-08-02 15:19:12,001 - Failed to verify package dependencies. Execution of '['/usr/bin/yum', '-d', '0', '-e', '0', 'check', 'dependencies']' returned 1. ipa-admintools-4.4.0-14.el7.centos.6.noarch has installed conflicts freeipa-admintools: ipa-admintools-4.4.0-14.el7.centos.6.noarch
ipa-client-4.4.0-14.el7.centos.6.x86_64 has installed conflicts freeipa-client: ipa-client-4.4.0-14.el7.centos.6.x86_64
ipa-client-common-4.4.0-14.el7.centos.6.noarch has installed conflicts freeipa-client-common: ipa-client-common-4.4.0-14.el7.centos.6.noarch
ipa-common-4.4.0-14.el7.centos.6.noarch has installed conflicts freeipa-common: ipa-common-4.4.0-14.el7.centos.6.noarch
2018-08-02 15:19:12,001 - Failure while verifying dependencies
2018-08-02 15:19:12,001 - *******************************************************************************
2018-08-02 15:19:12,001 - Manually verify and fix package dependencies and then re-run install_packages
2018-08-02 15:19:12,001 - *******************************************************************************
Traceback (most recent call last):
File "/var/lib/ambari-agent/cache/custom_actions/scripts/install_packages.py", line 486, in
InstallPackages().execute()
File "/usr/lib/ambari-agent/lib/resource_management/libraries/script/script.py", line 353, in execute
method(env)
File "/var/lib/ambari-agent/cache/custom_actions/scripts/install_packages.py", line 149, in actionexecute
raise Fail("Failed to distribute repositories/install packages")
resource_management.core.exceptions.Fail: Failed to distribute repositories/install packages
stdout:
2018-08-02 15:18:48,195 - Will install packages for repository version 3.0.0.0
2018-08-02 15:18:48,195 - Repository for HDP/3.0.0.0/hdp-gpl is not managed by Ambari
2018-08-02 15:18:48,195 - Repository for HDP/3.0.0.0/hdp is not managed by Ambari
2018-08-02 15:18:48,195 - Repository for HDP/3.0.0.0/hdp-utils is not managed by Ambari
2018-08-02 15:18:48,196 - Yum non-completed transactions check passed
2018-08-02 15:18:48,196 - call[('ambari-python-wrap', u'/usr/bin/hdp-select', 'versions')] {}
2018-08-02 15:18:48,223 - call returned (0, '2.6.2.0-205\n3.0.0.0-1634')
2018-08-02 15:18:48,224 - Installing package hdp-select ('/usr/bin/yum -y install hdp-select')
2018-08-02 15:18:51,152 - Looking for matching packages in the following repositories: hdp-gpl, hdp, hdp-utils
2018-08-02 15:18:59,136 - Installing package atlas-metadata_3_0_0_0_1634 ('/usr/bin/yum -y install atlas-metadata_3_0_0_0_1634')
2018-08-02 15:18:59,760 - Installing package ambari-infra-solr-client ('/usr/bin/yum -y install ambari-infra-solr-client')
2018-08-02 15:19:00,383 - Installing package kafka_3_0_0_0_1634 ('/usr/bin/yum -y install kafka_3_0_0_0_1634')
2018-08-02 15:19:00,914 - Installing package gcc ('/usr/bin/yum -y install gcc')
2018-08-02 15:19:01,444 - Installing package python-kerberos ('/usr/bin/yum -y install python-kerberos')
2018-08-02 15:19:02,066 - Installing package hadoop_3_0_0_0_1634 ('/usr/bin/yum -y install hadoop_3_0_0_0_1634')
2018-08-02 15:19:02,596 - Installing package hadoop_3_0_0_0_1634-client ('/usr/bin/yum -y install hadoop_3_0_0_0_1634-client')
2018-08-02 15:19:03,220 - Installing package snappy ('/usr/bin/yum -y install snappy')
2018-08-02 15:19:03,749 - Installing package snappy-devel ('/usr/bin/yum -y install snappy-devel')
2018-08-02 15:19:04,369 - Installing package hadoop_3_0_0_0_1634-libhdfs ('/usr/bin/yum -y install hadoop_3_0_0_0_1634-libhdfs')
2018-08-02 15:19:05,005 - Installing package hadoop_3_0_0_0_1634-mapreduce ('/usr/bin/yum -y install hadoop_3_0_0_0_1634-mapreduce')
2018-08-02 15:19:05,649 - Installing package ambari-infra-solr-client ('/usr/bin/yum -y install ambari-infra-solr-client')
2018-08-02 15:19:06,293 - Installing package hbase_3_0_0_0_1634 ('/usr/bin/yum -y install hbase_3_0_0_0_1634')
2018-08-02 15:19:06,842 - Installing package phoenix_3_0_0_0_1634 ('/usr/bin/yum -y install phoenix_3_0_0_0_1634')
2018-08-02 15:19:07,387 - Installing package zookeeper_3_0_0_0_1634 ('/usr/bin/yum -y install zookeeper_3_0_0_0_1634')
2018-08-02 15:19:07,936 - Installing package zookeeper_3_0_0_0_1634-server ('/usr/bin/yum -y install zookeeper_3_0_0_0_1634-server')
2018-08-02 15:19:08,577 - Installing package hadoop_3_0_0_0_1634-yarn ('/usr/bin/yum -y install hadoop_3_0_0_0_1634-yarn')
2018-08-02 15:19:09,221 - Installing package hadoop_3_0_0_0_1634-mapreduce ('/usr/bin/yum -y install hadoop_3_0_0_0_1634-mapreduce')
2018-08-02 15:19:09,859 - Installing package hadoop_3_0_0_0_1634-hdfs ('/usr/bin/yum -y install hadoop_3_0_0_0_1634-hdfs')
2018-08-02 15:19:12,001 - Failed to verify package dependencies. Execution of '['/usr/bin/yum', '-d', '0', '-e', '0', 'check', 'dependencies']' returned 1. ipa-admintools-4.4.0-14.el7.centos.6.noarch has installed conflicts freeipa-admintools: ipa-admintools-4.4.0-14.el7.centos.6.noarch
ipa-client-4.4.0-14.el7.centos.6.x86_64 has installed conflicts freeipa-client: ipa-client-4.4.0-14.el7.centos.6.x86_64
ipa-client-common-4.4.0-14.el7.centos.6.noarch has installed conflicts freeipa-client-common: ipa-client-common-4.4.0-14.el7.centos.6.noarch
ipa-common-4.4.0-14.el7.centos.6.noarch has installed conflicts freeipa-common: ipa-common-4.4.0-14.el7.centos.6.noarch
2018-08-02 15:19:12,001 - Failure while verifying dependencies
2018-08-02 15:19:12,001 - *******************************************************************************
2018-08-02 15:19:12,001 - Manually verify and fix package dependencies and then re-run install_packages
2018-08-02 15:19:12,001 - *******************************************************************************
2018-08-02 15:19:12,002 - Installation of packages failed. Checking if installation was partially complete
2018-08-02 15:19:12,002 - Old versions: ['2.6.2.0-205', '3.0.0.0-1634']
2018-08-02 15:19:12,002 - call[('ambari-python-wrap', u'/usr/bin/hdp-select', 'versions')] {}
2018-08-02 15:19:12,027 - call returned (0, '2.6.2.0-205\n3.0.0.0-1634')
2018-08-02 15:19:12,027 - New versions: ['2.6.2.0-205', '3.0.0.0-1634']
2018-08-02 15:19:12,028 - Deltas: set([]) Command failed after 1 tries
... View more
04-27-2017
09:42 PM
I had a small test cluster that I had installed HDP 2.5 on and then uninstalled everything. Now I downloaded HDP 2.6 and attempted to run ambari-server setup as shown and each time, I get the same error related to the user that ambari should run as. I have tried not changing the default, accepting the default (root), and using another existing user. all of these result in the same error. I have deleted everything related to hadoop on the server that I can find in case that was an issue from the previous 2.5 install.
Here is the error: [root@pocc1 /]# ambari-server setup -v -gUsing python /usr/bin/pythonSetup ambari-serverINFO: Loading properties from /etc/ambari-server/conf/ambari.propertiesChecking SELinux...INFO: about to run command: /sbin/sestatusINFO: process_pid=13802SELinux status is 'disabled'INFO: Loading properties from /etc/ambari-server/conf/ambari.propertiesCustomize user account for ambari-server daemon [y/n] (n)? nINFO: Loading properties from /etc/ambari-server/conf/ambari.propertiesINFO: Cleaning bootstrap directory (/var/run/ambari-server/bootstrap) contents...ERROR: Unexpected error 'getpwuid(): uid not found: 1001'ERROR: Exiting with exit code 1. REASON: Failed to create user. Exiting. And here is what I found in /var/log/ambari-server/ambari-server-command.log : [root@pocc1 /]# more /var/log/ambari-server/ambari-server-command.log
INFO 2017-04-27 16:25:58,673 ambari-server.py:777 - loglevel=logging.INFO
INFO 2017-04-27 16:25:58,674 serverSetup.py:1090 - Setup ambari-server.
ERROR 2017-04-27 16:26:05,832 ambari-server.py:880 - 'Fatal exception: Failed to create user. Exiting., exit code 1'
Traceback (most recent call last):
File "/usr/sbin/ambari-server.py", line 863, in main
action_obj.execute()
File "/usr/sbin/ambari-server.py", line 78, in execute
self.fn(*self.args, **self.kwargs)
File "/usr/lib/python2.6/site-packages/ambari_server/serverSetup.py", line 1117, in setup
raise FatalException(retcode, err)
FatalException: 'Fatal exception: Failed to create user. Exiting., exit code 1'
INFO 2017-04-27 16:26:14,435 ambari-server.py:777 - loglevel=logging.INFO
INFO 2017-04-27 16:26:14,436 serverSetup.py:1090 - Setup ambari-server.
ERROR 2017-04-27 16:26:15,932 ambari-server.py:880 - 'Fatal exception: Failed to create user. Exiting., exit code 1'
Traceback (most recent call last):
File "/usr/sbin/ambari-server.py", line 863, in main
action_obj.execute()
File "/usr/sbin/ambari-server.py", line 78, in execute
self.fn(*self.args, **self.kwargs)
File "/usr/lib/python2.6/site-packages/ambari_server/serverSetup.py", line 1117, in setup
raise FatalException(retcode, err)
FatalException: 'Fatal exception: Failed to create user. Exiting., exit code 1'
INFO 2017-04-27 16:26:24,324 ambari-server.py:777 - loglevel=logging.INFO
INFO 2017-04-27 16:26:24,326 serverSetup.py:1090 - Setup ambari-server.
ERROR 2017-04-27 16:26:30,378 ambari-server.py:880 - 'Fatal exception: Failed to create user. Exiting., exit code 1'
Traceback (most recent call last):
File "/usr/sbin/ambari-server.py", line 863, in main
action_obj.execute()
File "/usr/sbin/ambari-server.py", line 78, in execute
self.fn(*self.args, **self.kwargs)
File "/usr/lib/python2.6/site-packages/ambari_server/serverSetup.py", line 1117, in setup
raise FatalException(retcode, err)
FatalException: 'Fatal exception: Failed to create user. Exiting., exit code 1'
INFO 2017-04-27 16:26:36,497 ambari-server.py:777 - loglevel=logging.INFO
INFO 2017-04-27 16:26:36,499 serverSetup.py:1090 - Setup ambari-server.
ERROR 2017-04-27 16:26:50,455 ambari-server.py:880 - 'Fatal exception: Failed to create user. Exiting., exit code 1'
Traceback (most recent call last):
File "/usr/sbin/ambari-server.py", line 863, in main
action_obj.execute()
File "/usr/sbin/ambari-server.py", line 78, in execute
self.fn(*self.args, **self.kwargs)
File "/usr/lib/python2.6/site-packages/ambari_server/serverSetup.py", line 1117, in setup
raise FatalException(retcode, err)
FatalException: 'Fatal exception: Failed to create user. Exiting., exit code 1'
INFO 2017-04-27 16:29:45,363 ambari-server.py:777 - loglevel=logging.INFO
INFO 2017-04-27 16:29:45,365 ambari-server.py:160 - Stopping ambari-server.
INFO 2017-04-27 16:29:45,365 ambari-server.py:189 - Ambari Server is not running
INFO 2017-04-27 16:36:59,920 ambari-server.py:777 - loglevel=logging.INFO
INFO 2017-04-27 16:36:59,922 serverSetup.py:1090 - Setup ambari-server.
ERROR 2017-04-27 16:37:01,782 ambari-server.py:880 - 'Fatal exception: Failed to create user. Exiting., exit code 1'
Traceback (most recent call last):
File "/usr/sbin/ambari-server.py", line 863, in main
action_obj.execute()
File "/usr/sbin/ambari-server.py", line 78, in execute
self.fn(*self.args, **self.kwargs)
File "/usr/lib/python2.6/site-packages/ambari_server/serverSetup.py", line 1117, in setup
raise FatalException(retcode, err)
FatalException: 'Fatal exception: Failed to create user. Exiting., exit code 1'
INFO 2017-04-27 16:55:58,505 ambari-server.py:777 - loglevel=logging.INFO
INFO 2017-04-27 16:55:58,507 serverSetup.py:1090 - Setup ambari-server.
ERROR 2017-04-27 16:56:09,222 ambari-server.py:880 - 'Fatal exception: Failed to create user. Exiting., exit code 1'
Traceback (most recent call last):
File "/usr/sbin/ambari-server.py", line 863, in main
action_obj.execute()
File "/usr/sbin/ambari-server.py", line 78, in execute
self.fn(*self.args, **self.kwargs)
File "/usr/lib/python2.6/site-packages/ambari_server/serverSetup.py", line 1117, in setup
raise FatalException(retcode, err)
FatalException: 'Fatal exception: Failed to create user. Exiting., exit code 1'
INFO 2017-04-27 17:18:02,302 ambari-server.py:777 - loglevel=logging.INFO
INFO 2017-04-27 17:18:02,304 serverSetup.py:1090 - Setup ambari-server.
ERROR 2017-04-27 17:18:06,580 ambari-server.py:880 - 'Fatal exception: Failed to create user. Exiting., exit code 1'
Traceback (most recent call last):
File "/usr/sbin/ambari-server.py", line 863, in main
action_obj.execute()
File "/usr/sbin/ambari-server.py", line 78, in execute
self.fn(*self.args, **self.kwargs)
File "/usr/lib/python2.6/site-packages/ambari_server/serverSetup.py", line 1117, in setup
raise FatalException(retcode, err)
FatalException: 'Fatal exception: Failed to create user. Exiting., exit code 1'
Any suggestions would be greatly appreciated! I looked at the offending code and followed the python functions and could not find any obvious reason for the errors...but I don't write in Python, so I could easily have missed something. One other thing I noticed is that the ambari install seems to place some files in /usr/lib/python2.6/site-packages/ambari_server/ directory, but Python version on this OS (CentOS 7) is actually 2.7. There is no corresponding ambari_server directory in /usr/lib/python2.7/site-packages directory, which made me scratch my head a bit since I checked in the docs and saw that Python 2.7 should be fine...
... View more
Labels:
- Labels:
-
Apache Ambari
