Member since
04-27-2017
9
Posts
0
Kudos Received
1
Solution
My Accepted Solutions
| Title | Views | Posted |
|---|---|---|
| 160 | 08-02-2018 04:46 PM |
03-28-2019
02:02 PM
@Renaud Manus, I have circled back to this and now am using cloudbreak 2.9.0. I am not even able to create a credential in cloudbreak now...neither v2 or v3 seems to work. I have confirmed that my openstack credentials work and are properly configured by using them with the openstack CLI (python client) on my Cloudbreak server. I am seeing error messages related to the URL being requested within the Openstack logs: 10.10.0.98 - - [27/Mar/2019:15:45:28 -0400] "POST /v3/tokens HTTP/1.1" 404 233 "-" "Jersey/2.26 (HttpUrlConnection 10.0.2)"
10.10.0.98 - - [27/Mar/2019:15:46:35 -0400] "POST /v3/tokens HTTP/1.1" 404 233 "-" "Jersey/2.26 (HttpUrlConnection 10.0.2)"
10.10.0.98 - - [27/Mar/2019:15:47:24 -0400] "POST /v3/auth/tokens HTTP/1.1" 201 6992 "-" "Jersey/2.26 (HttpUrlConnection 10.0.2)"
10.10.0.98 - - [27/Mar/2019:15:50:12 -0400] "POST /v3/auth/tokens HTTP/1.1" 201 6992 "-" "Jersey/2.26 (HttpUrlConnection 10.0.2)" It looks like when I try to create a v3 credential it is hitting the right URL, but is giving a fairly useless "NOT FOUND" error on the cloudbreak side. With the v2 credential, I get the same "NOT FOUND" error in the cloudbreak logs, but in the Openstack logs, it looks like the correct URL is getting hit (/v3/auth/tokens vs /v3/tokens). I am running out of things to try and hope someone can take a look at this to see what might be going on. Given that the first time around, @Renaud Manus seemed to be able to get it working with the V2 API, I am hoping that this can work...
... View more
12-03-2018
10:02 PM
I am seeing a lot of errors related to my logfeeder, (I am running HDP 3.0.1, HDF3.2, Ambari 2.7.1). From a google search, the errors I am seeing are related to AMBARI-23825, but that particular issue shows it was fixed in 2.7.0...due to the slight mismatch between Hortonworks versions and the Apache version...not sure if it is fixed in the current Ambari version from Hortonworks. I am not sure what the actual impact is of these errors, but I am seeing a ton of them (6277 events in the last 24 hours). I have noticed this issue since I installed the cluster, but am just now circling back to it. I don't see anywhere else to dig further into this to see additional logs that might shed more light on the matter. Is this familiar? Has that particular fix been implemented in the Hortonworks Ambari 2.7.1? 2018-12-03 15:38:32,950 ERROR LogFeederUtil.java:134 - Caught exception checkIn. , input=input:source=file, path=/var/log/ambari-logsearch-logfeeder/logsearch-logfeeder.json. Messages suppressed before: 1
java.lang.NullPointerException
2018-12-03 15:39:23,087 ERROR LogFeederUtil.java:134 - Error applying date transformation. isEpoch=false, targetDateFormat=yyyy-MM-dd HH:mm:ss,SSS, value=2018-12-03T20:39:17,594. mapClass=map_date, input=input:source=file, path=null, fieldName=logtime
java.text.ParseException: Unparseable date: 2018-12-03T20:39:17,594
at org.apache.commons.lang3.time.FastDateParser.parse(FastDateParser.java:367)
at org.apache.commons.lang3.time.FastDateFormat.parse(FastDateFormat.java:550)
at org.apache.ambari.logfeeder.mapper.MapperDate.apply(MapperDate.java:89)
at org.apache.ambari.logfeeder.plugin.filter.Filter.apply(Filter.java:114)
at org.apache.ambari.logfeeder.filter.FilterGrok.applyMessage(FilterGrok.java:278)
at org.apache.ambari.logfeeder.filter.FilterGrok.flush(FilterGrok.java:296)
at org.apache.ambari.logfeeder.plugin.input.Input.flush(Input.java:214)
at org.apache.ambari.logfeeder.input.file.ProcessFileHelper.processFile(ProcessFileHelper.java:70)
at org.apache.ambari.logfeeder.input.InputFile.processFile(InputFile.java:311)
at org.apache.ambari.logfeeder.input.InputFile.start(InputFile.java:290)
at org.apache.ambari.logfeeder.plugin.input.Input.run(Input.java:171)
at java.lang.Thread.run(Thread.java:745)
... View more
Labels:
10-12-2018
02:20 PM
@mmolnar, thanks for the suggestion...unfortunately, my private cloud does not seem to have the v2 credentials enabled as I get errors when trying to create a new credential as v2.
... View more
10-09-2018
08:57 PM
Thanks for the response...I have tried with the default images and the ones I imported...neither has worked. I get the error shown above when I use the default images...when I use the ones I uploaded, I get 401 errors. Also, given that Mitaka is 5 versions behind current and was EOL as of April of 2017 (more than a year ago), is there a date expected for support of newer versions of OpenStack? Unfortunately, I don't have control over the Openstack version and must use the one that is supplied on my private cluster/cloud.
... View more
10-05-2018
08:42 PM
I am working on a private cloud that has Openstack Rocky on it. I have tried multiple times to spin up clusters with both Cloudbreak 2.7.1 and 2.8TP with no luck. Installing either version of cloudbreak seems to work fine, but each time I try to create a cluster, I get an almost immediate failure. I have looked through the cloudbreak logs and have not found any helpful errors and am just about at my wits end with this. I have noticed that Cloudbreak does not seem to be able to retrieve the image catalog that I have locally...I had my Openstack admin upload the images as shown in the documentation, which I can see from my Openstack console/UI as expected...but in cloudbreak, when I look at the default cloudbreak image catalog, I see what is expected, but with my internal catalog, depending on which URL I use, I get either "multiple choices" errors or "401" errors. The urls I use are http://myopenstack:9292 or http://myopenstack:9292/v2/images. Apart from that, the only errors I am currently getting when I create a cluster is this: Error during stack creation flow:
cloudbreak_1 | org.openstack4j.api.exceptions.ServerResponseException: Internal Server Error
cloudbreak_1 | at org.openstack4j.core.transport.HttpExceptionHandler.mapException(HttpExceptionHandler.java:40)
cloudbreak_1 | at org.openstack4j.core.transport.HttpExceptionHandler.mapException(HttpExceptionHandler.java:23)
cloudbreak_1 | at org.openstack4j.core.transport.HttpEntityHandler.handle(HttpEntityHandler.java:51)
cloudbreak_1 | at org.openstack4j.core.transport.HttpEntityHandler.handle(HttpEntityHandler.java:24)
cloudbreak_1 | at org.openstack4j.connectors.jersey2.HttpResponseImpl.getEntity(HttpResponseImpl.java:63)
cloudbreak_1 | at org.openstack4j.openstack.internal.BaseOpenStackService$Invocation.execute(BaseOpenStackService.java:225)
cloudbreak_1 | at org.openstack4j.openstack.internal.BaseOpenStackService$Invocation.execute(BaseOpenStackService.java:207)
cloudbreak_1 | at org.openstack4j.openstack.heat.internal.StackServiceImpl.getStackByName(StackServiceImpl.java:91)
cloudbreak_1 | at com.sequenceiq.cloudbreak.cloud.openstack.common.OpenStackStackValidator.validate(OpenStackStackValidator.java:27)
cloudbreak_1 | at com.sequenceiq.cloudbreak.cloud.handler.ProvisionValidationHandler.accept(ProvisionValidationHandler.java:48)
cloudbreak_1 | at com.sequenceiq.cloudbreak.cloud.handler.ProvisionValidationHandler.accept(ProvisionValidationHandler.java:21)
cloudbreak_1 | at com.sequenceiq.cloudbreak.cloud.handler.ProvisionValidationHandler$$FastClassBySpringCGLIB$$5f1962a5.invoke(<generated>)
cloudbreak_1 | at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:204)
cloudbreak_1 | at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:746)
cloudbreak_1 | at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163)
cloudbreak_1 | at org.springframework.aop.framework.adapter.MethodBeforeAdviceInterceptor.invoke(MethodBeforeAdviceInterceptor.java:52)
cloudbreak_1 | at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:185)
cloudbreak_1 | at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:92)
cloudbreak_1 | at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:185)
cloudbreak_1 | at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:688)
cloudbreak_1 | at com.sequenceiq.cloudbreak.cloud.handler.ProvisionValidationHandler$$EnhancerBySpringCGLIB$$67d65420.accept(<generated>)
cloudbreak_1 | at reactor.bus.EventBus$3.accept(EventBus.java:317)
cloudbreak_1 | at reactor.bus.EventBus$3.accept(EventBus.java:310)
cloudbreak_1 | at reactor.bus.routing.ConsumerFilteringRouter.route(ConsumerFilteringRouter.java:72)
cloudbreak_1 | at reactor.bus.routing.TraceableDelegatingRouter.route(TraceableDelegatingRouter.java:51)
cloudbreak_1 | at reactor.bus.EventBus.accept(EventBus.java:591)
cloudbreak_1 | at reactor.bus.EventBus.accept(EventBus.java:63)
cloudbreak_1 | at reactor.core.dispatch.AbstractLifecycleDispatcher.route(AbstractLifecycleDispatcher.java:160)
cloudbreak_1 | at reactor.core.dispatch.MultiThreadDispatcher$MultiThreadTask.run(MultiThreadDispatcher.java:74)
cloudbreak_1 | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1135)
cloudbreak_1 | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
cloudbreak_1 | at java.base/java.lang.Thread.run(Thread.java:844)
... View more
Labels:
08-13-2018
06:52 PM
I was upgrading to HDP 3.0 and keep getting a timeout error when trying to start Ranger: Python script has been killed due to timeout after waiting 600 secs
stdout:
2018-08-06 19:21:53,314 - Stack Feature Version Info: Cluster Stack=3.0, Command Stack=None, Command Version=3.0.0.0-1634, Upgrade Direction=upgrade -> 3.0.0.0-1634
2018-08-06 19:21:53,336 - Using hadoop conf dir: /usr/hdp/3.0.0.0-1634/hadoop/conf
2018-08-06 19:21:53,679 - Stack Feature Version Info: Cluster Stack=3.0, Command Stack=None, Command Version=3.0.0.0-1634, Upgrade Direction=upgrade -> 3.0.0.0-1634
2018-08-06 19:21:53,688 - Using hadoop conf dir: /usr/hdp/3.0.0.0-1634/hadoop/conf
2018-08-06 19:21:53,690 - Group['ranger'] {}
2018-08-06 19:21:53,692 - Group['hdfs'] {}
2018-08-06 19:21:53,692 - Group['hadoop'] {}
2018-08-06 19:21:53,693 - Group['users'] {}
2018-08-06 19:21:53,694 - User['yarn-ats'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': ['hadoop'], 'uid': None}
2018-08-06 19:21:53,697 - User['infra-solr'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': ['hadoop'], 'uid': None}
2018-08-06 19:21:53,699 - User['zookeeper'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': ['hadoop'], 'uid': None}
2018-08-06 19:21:53,700 - User['atlas'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': ['hadoop'], 'uid': None}
2018-08-06 19:21:53,702 - User['ams'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': ['hadoop'], 'uid': None}
2018-08-06 19:21:53,703 - User['ranger'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': ['ranger', 'hadoop'], 'uid': None}
2018-08-06 19:21:53,705 - User['logsearch'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': ['hadoop'], 'uid': None}
2018-08-06 19:21:53,706 - User['ambari-qa'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': ['hadoop', 'users'], 'uid': None}
2018-08-06 19:21:53,707 - User['kafka'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': ['hadoop'], 'uid': None}
2018-08-06 19:21:53,709 - User['hdfs'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': ['hdfs', 'hadoop'], 'uid': None}
2018-08-06 19:21:53,710 - Modifying user hdfs
2018-08-06 19:21:53,732 - User['yarn'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': ['hadoop'], 'uid': None}
2018-08-06 19:21:53,735 - User['mapred'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': ['hadoop'], 'uid': None}
2018-08-06 19:21:53,737 - User['hbase'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': ['hadoop'], 'uid': None}
2018-08-06 19:21:53,739 - File['/var/lib/ambari-agent/tmp/changeUid.sh'] {'content': StaticFile('changeToSecureUid.sh'), 'mode': 0555}
2018-08-06 19:21:53,742 - Execute['/var/lib/ambari-agent/tmp/changeUid.sh ambari-qa /tmp/hadoop-ambari-qa,/tmp/hsperfdata_ambari-qa,/home/ambari-qa,/tmp/ambari-qa,/tmp/sqoop-ambari-qa 0'] {'not_if': '(test $(id -u ambari-qa) -gt 1000) || (false)'}
2018-08-06 19:21:53,751 - Skipping Execute['/var/lib/ambari-agent/tmp/changeUid.sh ambari-qa /tmp/hadoop-ambari-qa,/tmp/hsperfdata_ambari-qa,/home/ambari-qa,/tmp/ambari-qa,/tmp/sqoop-ambari-qa 0'] due to not_if
2018-08-06 19:21:53,752 - Directory['/tmp/hbase-hbase'] {'owner': 'hbase', 'create_parents': True, 'mode': 0775, 'cd_access': 'a'}
2018-08-06 19:21:53,754 - File['/var/lib/ambari-agent/tmp/changeUid.sh'] {'content': StaticFile('changeToSecureUid.sh'), 'mode': 0555}
2018-08-06 19:21:53,756 - File['/var/lib/ambari-agent/tmp/changeUid.sh'] {'content': StaticFile('changeToSecureUid.sh'), 'mode': 0555}
2018-08-06 19:21:53,758 - call['/var/lib/ambari-agent/tmp/changeUid.sh hbase'] {}
2018-08-06 19:21:53,772 - call returned (0, '65549')
2018-08-06 19:21:53,773 - Execute['/var/lib/ambari-agent/tmp/changeUid.sh hbase /home/hbase,/tmp/hbase,/usr/bin/hbase,/var/log/hbase,/tmp/hbase-hbase 65549'] {'not_if': '(test $(id -u hbase) -gt 1000) || (false)'}
2018-08-06 19:21:53,782 - Skipping Execute['/var/lib/ambari-agent/tmp/changeUid.sh hbase /home/hbase,/tmp/hbase,/usr/bin/hbase,/var/log/hbase,/tmp/hbase-hbase 65549'] due to not_if
2018-08-06 19:21:53,783 - Group['hdfs'] {}
2018-08-06 19:21:53,783 - User['hdfs'] {'fetch_nonlocal_groups': True, 'groups': ['hdfs', 'hadoop', 'hadoop', u'hdfs']}
2018-08-06 19:21:53,784 - Modifying user hdfs
2018-08-06 19:21:53,800 - FS Type: HDFS
2018-08-06 19:21:53,801 - Directory['/etc/hadoop'] {'mode': 0755}
2018-08-06 19:21:53,829 - File['/usr/hdp/3.0.0.0-1634/hadoop/conf/hadoop-env.sh'] {'content': InlineTemplate(...), 'owner': 'hdfs', 'group': 'hadoop'}
2018-08-06 19:21:53,830 - Directory['/var/lib/ambari-agent/tmp/hadoop_java_io_tmpdir'] {'owner': 'hdfs', 'group': 'hadoop', 'mode': 01777}
2018-08-06 19:21:53,859 - Execute[('setenforce', '0')] {'not_if': '(! which getenforce ) || (which getenforce && getenforce | grep -q Disabled)', 'sudo': True, 'only_if': 'test -f /selinux/enforce'}
2018-08-06 19:21:53,875 - Skipping Execute[('setenforce', '0')] due to only_if
2018-08-06 19:21:53,876 - Directory['/var/log/hadoop'] {'owner': 'root', 'create_parents': True, 'group': 'hadoop', 'mode': 0775, 'cd_access': 'a'}
2018-08-06 19:21:53,880 - Directory['/var/run/hadoop'] {'owner': 'root', 'create_parents': True, 'group': 'root', 'cd_access': 'a'}
2018-08-06 19:21:53,881 - Directory['/var/run/hadoop/hdfs'] {'owner': 'hdfs', 'cd_access': 'a'}
2018-08-06 19:21:53,882 - Directory['/tmp/hadoop-hdfs'] {'owner': 'hdfs', 'create_parents': True, 'cd_access': 'a'}
2018-08-06 19:21:53,889 - File['/usr/hdp/3.0.0.0-1634/hadoop/conf/commons-logging.properties'] {'content': Template('commons-logging.properties.j2'), 'owner': 'hdfs'}
2018-08-06 19:21:53,892 - File['/usr/hdp/3.0.0.0-1634/hadoop/conf/health_check'] {'content': Template('health_check.j2'), 'owner': 'hdfs'}
2018-08-06 19:21:53,902 - File['/usr/hdp/3.0.0.0-1634/hadoop/conf/log4j.properties'] {'content': InlineTemplate(...), 'owner': 'hdfs', 'group': 'hadoop', 'mode': 0644}
2018-08-06 19:21:53,918 - File['/usr/hdp/3.0.0.0-1634/hadoop/conf/hadoop-metrics2.properties'] {'content': Template('hadoop-metrics2.properties.j2'), 'owner': 'hdfs', 'group': 'hadoop'}
2018-08-06 19:21:53,920 - File['/usr/hdp/3.0.0.0-1634/hadoop/conf/task-log4j.properties'] {'content': StaticFile('task-log4j.properties'), 'mode': 0755}
2018-08-06 19:21:53,921 - File['/usr/hdp/3.0.0.0-1634/hadoop/conf/configuration.xsl'] {'owner': 'hdfs', 'group': 'hadoop'}
2018-08-06 19:21:53,927 - File['/etc/hadoop/conf/topology_mappings.data'] {'owner': 'hdfs', 'content': Template('topology_mappings.data.j2'), 'only_if': 'test -d /etc/hadoop/conf', 'group': 'hadoop', 'mode': 0644}
2018-08-06 19:21:53,932 - File['/etc/hadoop/conf/topology_script.py'] {'content': StaticFile('topology_script.py'), 'only_if': 'test -d /etc/hadoop/conf', 'mode': 0755}
2018-08-06 19:21:53,937 - Skipping unlimited key JCE policy check and setup since the Java VM is not managed by Ambari
2018-08-06 19:21:54,340 - Stack Feature Version Info: Cluster Stack=3.0, Command Stack=None, Command Version=3.0.0.0-1634, Upgrade Direction=upgrade -> 3.0.0.0-1634
2018-08-06 19:21:54,393 - File['/var/lib/ambari-agent/tmp/mysql-jdbc-driver.jar'] {'content': DownloadSource('http://r7u07.thanos.gotgdt.net:8080/resources/mysql-jdbc-driver.jar'), 'mode': 0644}
2018-08-06 19:21:54,394 - Not downloading the file from http://r7u07.thanos.gotgdt.net:8080/resources/mysql-jdbc-driver.jar, because /var/lib/ambari-agent/tmp/mysql-jdbc-driver.jar already exists
2018-08-06 19:21:54,395 - Execute[('cp', '--remove-destination', u'/var/lib/ambari-agent/tmp/mysql-jdbc-driver.jar', u'/usr/hdp/current/ranger-admin/ews/lib')] {'path': ['/bin', '/usr/bin/'], 'sudo': True}
2018-08-06 19:21:54,407 - File['/usr/hdp/current/ranger-admin/ews/lib/mysql-jdbc-driver.jar'] {'mode': 0644}
2018-08-06 19:21:54,407 - Changing permission for /usr/hdp/current/ranger-admin/ews/lib/mysql-jdbc-driver.jar from 600 to 644
2018-08-06 19:21:54,408 - ModifyPropertiesFile['/usr/hdp/current/ranger-admin/install.properties'] {'owner': 'ranger', 'properties': ...}
2018-08-06 19:21:54,409 - Modifying existing properties file: /usr/hdp/current/ranger-admin/install.properties
2018-08-06 19:21:54,419 - File['/usr/hdp/current/ranger-admin/install.properties'] {'owner': 'ranger', 'content': ..., 'group': None, 'mode': None, 'encoding': 'utf-8'}
2018-08-06 19:21:54,420 - Writing File['/usr/hdp/current/ranger-admin/install.properties'] because contents don't match
2018-08-06 19:21:54,421 - ModifyPropertiesFile['/usr/hdp/current/ranger-admin/install.properties'] {'owner': 'ranger', 'properties': {'SQL_CONNECTOR_JAR': u'/usr/hdp/current/ranger-admin/ews/lib/mysql-jdbc-driver.jar'}}
2018-08-06 19:21:54,421 - Modifying existing properties file: /usr/hdp/current/ranger-admin/install.properties
2018-08-06 19:21:54,422 - File['/usr/hdp/current/ranger-admin/install.properties'] {'owner': 'ranger', 'content': ..., 'group': None, 'mode': None, 'encoding': 'utf-8'}
2018-08-06 19:21:54,423 - ModifyPropertiesFile['/usr/hdp/current/ranger-admin/install.properties'] {'owner': 'ranger', 'properties': {'audit_store': u'solr'}}
2018-08-06 19:21:54,423 - Modifying existing properties file: /usr/hdp/current/ranger-admin/install.properties
2018-08-06 19:21:54,425 - File['/usr/hdp/current/ranger-admin/install.properties'] {'owner': 'ranger', 'content': ..., 'group': None, 'mode': None, 'encoding': 'utf-8'}
2018-08-06 19:21:54,425 - Setting up Ranger DB and DB User
2018-08-06 19:21:54,425 - Execute['ambari-python-wrap /usr/hdp/current/ranger-admin/dba_script.py -q'] {'logoutput': True, 'environment': {'RANGER_ADMIN_HOME': u'/usr/hdp/current/ranger-admin', 'JAVA_HOME': u'/usr/java/default'}, 'user': 'ranger'}
2018-08-06 19:21:54,643 [I] Running DBA setup script. QuiteMode:True
2018-08-06 19:21:54,643 [I] Using Java:/usr/java/default/bin/java
2018-08-06 19:21:54,643 [I] DB FLAVOR:MYSQL
2018-08-06 19:21:54,643 [I] DB Host:r7u07.thanos.gotgdt.net
2018-08-06 19:21:54,643 [I] ---------- Verifying DB root password ----------
2018-08-06 19:21:54,644 [I] DBA root user password validated
2018-08-06 19:21:54,644 [I] ---------- Verifying Ranger Admin db user password ----------
2018-08-06 19:21:54,644 [I] admin user password validated
2018-08-06 19:21:54,644 [I] ---------- Creating Ranger Admin db user ----------
2018-08-06 19:21:54,644 [JISQL] /usr/java/default/bin/java -cp /usr/hdp/current/ranger-admin/ews/lib/mysql-jdbc-driver.jar:/usr/hdp/current/ranger-admin/jisql/lib/* org.apache.util.sql.Jisql -driver mysqlconj -cstring jdbc:mysql://r7u07.thanos.gotgdt.net/mysql -u root -p '********' -noheader -trim -c \; -query "SELECT version();"
2018-08-06 19:21:55,093 [I] Verifying user rangeradmin for Host %
2018-08-06 19:21:55,093 [JISQL] /usr/java/default/bin/java -cp /usr/hdp/current/ranger-admin/ews/lib/mysql-jdbc-driver.jar:/usr/hdp/current/ranger-admin/jisql/lib/* org.apache.util.sql.Jisql -driver mysqlconj -cstring jdbc:mysql://r7u07.thanos.gotgdt.net/mysql -u root -p '********' -noheader -trim -c \; -query "select user from mysql.user where user='rangeradmin' and host='%';"
2018-08-06 19:21:55,528 [I] MySQL user rangeradmin already exists for host %
2018-08-06 19:21:55,528 [I] Verifying user rangeradmin for Host localhost
2018-08-06 19:21:55,528 [JISQL] /usr/java/default/bin/java -cp /usr/hdp/current/ranger-admin/ews/lib/mysql-jdbc-driver.jar:/usr/hdp/current/ranger-admin/jisql/lib/* org.apache.util.sql.Jisql -driver mysqlconj -cstring jdbc:mysql://r7u07.thanos.gotgdt.net/mysql -u root -p '********' -noheader -trim -c \; -query "select user from mysql.user where user='rangeradmin' and host='localhost';"
2018-08-06 19:21:55,992 [I] MySQL user rangeradmin already exists for host localhost
2018-08-06 19:21:55,993 [I] Verifying user rangeradmin for Host r7u07.thanos.gotgdt.net
2018-08-06 19:21:55,993 [JISQL] /usr/java/default/bin/java -cp /usr/hdp/current/ranger-admin/ews/lib/mysql-jdbc-driver.jar:/usr/hdp/current/ranger-admin/jisql/lib/* org.apache.util.sql.Jisql -driver mysqlconj -cstring jdbc:mysql://r7u07.thanos.gotgdt.net/mysql -u root -p '********' -noheader -trim -c \; -query "select user from mysql.user where user='rangeradmin' and host='r7u07.thanos.gotgdt.net';"
2018-08-06 19:21:56,429 [I] MySQL user rangeradmin already exists for host r7u07.thanos.gotgdt.net
2018-08-06 19:21:56,430 [I] ---------- Creating Ranger Admin database ----------
2018-08-06 19:21:56,430 [I] Verifying database ranger
2018-08-06 19:21:56,430 [JISQL] /usr/java/default/bin/java -cp /usr/hdp/current/ranger-admin/ews/lib/mysql-jdbc-driver.jar:/usr/hdp/current/ranger-admin/jisql/lib/* org.apache.util.sql.Jisql -driver mysqlconj -cstring jdbc:mysql://r7u07.thanos.gotgdt.net/mysql -u root -p '********' -noheader -trim -c \; -query "show databases like 'ranger';"
2018-08-06 19:21:56,888 [I] Database ranger already exists.
2018-08-06 19:21:56,889 [I] ---------- Granting permission to Ranger Admin db user ----------
2018-08-06 19:21:56,889 [I] ---------- Granting privileges TO user 'rangeradmin'@'%' on db 'ranger'----------
2018-08-06 19:21:56,889 [JISQL] /usr/java/default/bin/java -cp /usr/hdp/current/ranger-admin/ews/lib/mysql-jdbc-driver.jar:/usr/hdp/current/ranger-admin/jisql/lib/* org.apache.util.sql.Jisql -driver mysqlconj -cstring jdbc:mysql://r7u07.thanos.gotgdt.net/mysql -u root -p '********' -noheader -trim -c \; -query "grant all privileges on ranger.* to 'rangeradmin'@'%' with grant option;"
2018-08-06 19:21:57,337 [I] ---------- FLUSH PRIVILEGES ----------
2018-08-06 19:21:57,338 [JISQL] /usr/java/default/bin/java -cp /usr/hdp/current/ranger-admin/ews/lib/mysql-jdbc-driver.jar:/usr/hdp/current/ranger-admin/jisql/lib/* org.apache.util.sql.Jisql -driver mysqlconj -cstring jdbc:mysql://r7u07.thanos.gotgdt.net/mysql -u root -p '********' -noheader -trim -c \; -query "FLUSH PRIVILEGES;"
2018-08-06 19:21:57,820 [I] Privileges granted to 'rangeradmin' on 'ranger'
2018-08-06 19:21:57,820 [I] ---------- Granting privileges TO user 'rangeradmin'@'localhost' on db 'ranger'----------
2018-08-06 19:21:57,821 [JISQL] /usr/java/default/bin/java -cp /usr/hdp/current/ranger-admin/ews/lib/mysql-jdbc-driver.jar:/usr/hdp/current/ranger-admin/jisql/lib/* org.apache.util.sql.Jisql -driver mysqlconj -cstring jdbc:mysql://r7u07.thanos.gotgdt.net/mysql -u root -p '********' -noheader -trim -c \; -query "grant all privileges on ranger.* to 'rangeradmin'@'localhost' with grant option;"
2018-08-06 19:21:58,267 [I] ---------- FLUSH PRIVILEGES ----------
2018-08-06 19:21:58,267 [JISQL] /usr/java/default/bin/java -cp /usr/hdp/current/ranger-admin/ews/lib/mysql-jdbc-driver.jar:/usr/hdp/current/ranger-admin/jisql/lib/* org.apache.util.sql.Jisql -driver mysqlconj -cstring jdbc:mysql://r7u07.thanos.gotgdt.net/mysql -u root -p '********' -noheader -trim -c \; -query "FLUSH PRIVILEGES;"
2018-08-06 19:21:58,715 [I] Privileges granted to 'rangeradmin' on 'ranger'
2018-08-06 19:21:58,715 [I] ---------- Granting privileges TO user 'rangeradmin'@'r7u07.thanos.gotgdt.net' on db 'ranger'----------
2018-08-06 19:21:58,716 [JISQL] /usr/java/default/bin/java -cp /usr/hdp/current/ranger-admin/ews/lib/mysql-jdbc-driver.jar:/usr/hdp/current/ranger-admin/jisql/lib/* org.apache.util.sql.Jisql -driver mysqlconj -cstring jdbc:mysql://r7u07.thanos.gotgdt.net/mysql -u root -p '********' -noheader -trim -c \; -query "grant all privileges on ranger.* to 'rangeradmin'@'r7u07.thanos.gotgdt.net' with grant option;"
2018-08-06 19:21:59,197 [I] ---------- FLUSH PRIVILEGES ----------
2018-08-06 19:21:59,197 [JISQL] /usr/java/default/bin/java -cp /usr/hdp/current/ranger-admin/ews/lib/mysql-jdbc-driver.jar:/usr/hdp/current/ranger-admin/jisql/lib/* org.apache.util.sql.Jisql -driver mysqlconj -cstring jdbc:mysql://r7u07.thanos.gotgdt.net/mysql -u root -p '********' -noheader -trim -c \; -query "FLUSH PRIVILEGES;"
2018-08-06 19:21:59,642 [I] Privileges granted to 'rangeradmin' on 'ranger'
2018-08-06 19:21:59,642 [I] ---------- Ranger Policy Manager DB and User Creation Process Completed.. ----------
2018-08-06 19:21:59,660 - Execute['ambari-python-wrap /usr/hdp/current/ranger-admin/db_setup.py'] {'logoutput': True, 'environment': {'PATH': '/usr/sbin:/sbin:/usr/lib/ambari-server/*:/usr/lib64/qt-3.3/bin:/opt/anaconda/bin:/usr/local/sbin:/sbin:/bin:/usr/sbin:/usr/bin::/opt/bro/bin:/root/bin:/var/lib/ambari-agent', 'RANGER_ADMIN_HOME': u'/usr/hdp/current/ranger-admin', 'JAVA_HOME': u'/usr/java/default'}, 'user': 'ranger'}
2018-08-06 19:22:00,135 [I] DB FLAVOR :MYSQL
2018-08-06 19:22:00,136 [I] --------- Verifying Ranger DB connection ---------
2018-08-06 19:22:00,136 [I] Checking connection..
2018-08-06 19:22:00,136 [JISQL] /usr/java/default/bin/java -cp /usr/hdp/current/ranger-admin/ews/lib/mysql-jdbc-driver.jar:/usr/hdp/current/ranger-admin/jisql/lib/* org.apache.util.sql.Jisql -driver mysqlconj -cstring jdbc:mysql://r7u07.thanos.gotgdt.net/ranger -u 'rangeradmin' -p '********' -noheader -trim -c \; -query "SELECT version();"
2018-08-06 19:22:00,744 [I] Checking connection passed.
2018-08-06 19:22:00,744 [I] --------- Verifying version history table ---------
2018-08-06 19:22:00,745 [JISQL] /usr/java/default/bin/java -cp /usr/hdp/current/ranger-admin/ews/lib/mysql-jdbc-driver.jar:/usr/hdp/current/ranger-admin/jisql/lib/* org.apache.util.sql.Jisql -driver mysqlconj -cstring jdbc:mysql://r7u07.thanos.gotgdt.net/ranger -u 'rangeradmin' -p '********' -noheader -trim -c \; -query "show tables like 'x_db_version_h';"
2018-08-06 19:22:01,203 [I] Table x_db_version_h already exists in database 'ranger'
2018-08-06 19:22:01,203 [I] --------- Importing Ranger Core DB Schema ---------
2018-08-06 19:22:01,203 [JISQL] /usr/java/default/bin/java -cp /usr/hdp/current/ranger-admin/ews/lib/mysql-jdbc-driver.jar:/usr/hdp/current/ranger-admin/jisql/lib/* org.apache.util.sql.Jisql -driver mysqlconj -cstring jdbc:mysql://r7u07.thanos.gotgdt.net/ranger -u 'rangeradmin' -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2018-08-06 19:22:01,666 [I] CORE_DB_SCHEMA is already imported
2018-08-06 19:22:01,666 [JISQL] /usr/java/default/bin/java -cp /usr/hdp/current/ranger-admin/ews/lib/mysql-jdbc-driver.jar:/usr/hdp/current/ranger-admin/jisql/lib/* org.apache.util.sql.Jisql -driver mysqlconj -cstring jdbc:mysql://r7u07.thanos.gotgdt.net/ranger -u 'rangeradmin' -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 1.1.0.3.0.0.0-1634' and active='Y';"
2018-08-06 19:22:02,097 [I] --------- Applying Ranger DB patches ---------
2018-08-06 19:22:02,097 [I] Executing patch on ranger from file: 001-groupsource.sql
2018-08-06 19:22:02,098 [JISQL] /usr/java/default/bin/java -cp /usr/hdp/current/ranger-admin/ews/lib/mysql-jdbc-driver.jar:/usr/hdp/current/ranger-admin/jisql/lib/* org.apache.util.sql.Jisql -driver mysqlconj -cstring jdbc:mysql://r7u07.thanos.gotgdt.net/ranger -u 'rangeradmin' -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = '001' and active = 'Y';"
2018-08-06 19:22:02,519 [I] Patch 001-groupsource.sql is already applied
2018-08-06 19:22:02,520 [I] Executing patch on ranger from file: 002-policyname.sql
2018-08-06 19:22:02,520 [JISQL] /usr/java/default/bin/java -cp /usr/hdp/current/ranger-admin/ews/lib/mysql-jdbc-driver.jar:/usr/hdp/current/ranger-admin/jisql/lib/* org.apache.util.sql.Jisql -driver mysqlconj -cstring jdbc:mysql://r7u07.thanos.gotgdt.net/ranger -u 'rangeradmin' -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = '002' and active = 'Y';"
2018-08-06 19:22:02,943 [I] Patch 002-policyname.sql is already applied
2018-08-06 19:22:02,943 [I] Executing patch on ranger from file: 003-knoxrepo.sql
2018-08-06 19:22:02,943 [JISQL] /usr/java/default/bin/java -cp /usr/hdp/current/ranger-admin/ews/lib/mysql-jdbc-driver.jar:/usr/hdp/current/ranger-admin/jisql/lib/* org.apache.util.sql.Jisql -driver mysqlconj -cstring jdbc:mysql://r7u07.thanos.gotgdt.net/ranger -u 'rangeradmin' -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = '003' and active = 'Y';"
2018-08-06 19:22:03,407 [I] Patch 003-knoxrepo.sql is already applied
2018-08-06 19:22:03,408 [I] Executing patch on ranger from file: 004-assetconfigsize.sql
2018-08-06 19:22:03,408 [JISQL] /usr/java/default/bin/java -cp /usr/hdp/current/ranger-admin/ews/lib/mysql-jdbc-driver.jar:/usr/hdp/current/ranger-admin/jisql/lib/* org.apache.util.sql.Jisql -driver mysqlconj -cstring jdbc:mysql://r7u07.thanos.gotgdt.net/ranger -u 'rangeradmin' -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = '004' and active = 'Y';"
2018-08-06 19:22:03,836 [I] Patch 004-assetconfigsize.sql is already applied
2018-08-06 19:22:03,837 [I] Executing patch on ranger from file: 005-xtrxlogcolumnsize.sql
2018-08-06 19:22:03,837 [JISQL] /usr/java/default/bin/java -cp /usr/hdp/current/ranger-admin/ews/lib/mysql-jdbc-driver.jar:/usr/hdp/current/ranger-admin/jisql/lib/* org.apache.util.sql.Jisql -driver mysqlconj -cstring jdbc:mysql://r7u07.thanos.gotgdt.net/ranger -u 'rangeradmin' -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = '005' and active = 'Y';"
2018-08-06 19:22:04,258 [I] Patch 005-xtrxlogcolumnsize.sql is already applied
2018-08-06 19:22:04,259 [I] Executing patch on ranger from file: 006-createdefaultpublicgroup.sql
2018-08-06 19:22:04,259 [JISQL] /usr/java/default/bin/java -cp /usr/hdp/current/ranger-admin/ews/lib/mysql-jdbc-driver.jar:/usr/hdp/current/ranger-admin/jisql/lib/* org.apache.util.sql.Jisql -driver mysqlconj -cstring jdbc:mysql://r7u07.thanos.gotgdt.net/ranger -u 'rangeradmin' -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = '006' and active = 'Y';"
2018-08-06 19:22:04,689 [I] Patch 006-createdefaultpublicgroup.sql is already applied
2018-08-06 19:22:04,690 [I] Executing patch on ranger from file: 007-updateBlankPolicyName.sql
2018-08-06 19:22:04,690 [JISQL] /usr/java/default/bin/java -cp /usr/hdp/current/ranger-admin/ews/lib/mysql-jdbc-driver.jar:/usr/hdp/current/ranger-admin/jisql/lib/* org.apache.util.sql.Jisql -driver mysqlconj -cstring jdbc:mysql://r7u07.thanos.gotgdt.net/ranger -u 'rangeradmin' -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = '007' and active = 'Y';"
2018-08-06 19:22:05,134 [I] Patch 007-updateBlankPolicyName.sql is already applied
2018-08-06 19:22:05,134 [I] Executing patch on ranger from file: 008-removeTrailingSlash.sql
2018-08-06 19:22:05,134 [JISQL] /usr/java/default/bin/java -cp /usr/hdp/current/ranger-admin/ews/lib/mysql-jdbc-driver.jar:/usr/hdp/current/ranger-admin/jisql/lib/* org.apache.util.sql.Jisql -driver mysqlconj -cstring jdbc:mysql://r7u07.thanos.gotgdt.net/ranger -u 'rangeradmin' -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = '008' and active = 'Y';"
2018-08-06 19:22:05,590 [I] Patch 008-removeTrailingSlash.sql is already applied
2018-08-06 19:22:05,591 [I] Executing patch on ranger from file: 009-updated_schema.sql
2018-08-06 19:22:05,591 [JISQL] /usr/java/default/bin/java -cp /usr/hdp/current/ranger-admin/ews/lib/mysql-jdbc-driver.jar:/usr/hdp/current/ranger-admin/jisql/lib/* org.apache.util.sql.Jisql -driver mysqlconj -cstring jdbc:mysql://r7u07.thanos.gotgdt.net/ranger -u 'rangeradmin' -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = '009' and active = 'Y';"
2018-08-06 19:22:06,029 [I] Patch 009-updated_schema.sql is already applied
2018-08-06 19:22:06,030 [I] Executing patch on ranger from file: 010-users-and-groups-visibility.sql
2018-08-06 19:22:06,030 [JISQL] /usr/java/default/bin/java -cp /usr/hdp/current/ranger-admin/ews/lib/mysql-jdbc-driver.jar:/usr/hdp/current/ranger-admin/jisql/lib/* org.apache.util.sql.Jisql -driver mysqlconj -cstring jdbc:mysql://r7u07.thanos.gotgdt.net/ranger -u 'rangeradmin' -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = '010' and active = 'Y';"
2018-08-06 19:22:06,453 [I] Patch 010-users-and-groups-visibility.sql is already applied
2018-08-06 19:22:06,454 [I] Executing patch on ranger from file: 012-createusersyncuser.sql
2018-08-06 19:22:06,454 [JISQL] /usr/java/default/bin/java -cp /usr/hdp/current/ranger-admin/ews/lib/mysql-jdbc-driver.jar:/usr/hdp/current/ranger-admin/jisql/lib/* org.apache.util.sql.Jisql -driver mysqlconj -cstring jdbc:mysql://r7u07.thanos.gotgdt.net/ranger -u 'rangeradmin' -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = '012' and active = 'Y';"
2018-08-06 19:22:06,908 [I] Patch 012-createusersyncuser.sql is already applied
2018-08-06 19:22:06,909 [I] Executing patch on ranger from file: 013-permissionmodel.sql
2018-08-06 19:22:06,909 [JISQL] /usr/java/default/bin/java -cp /usr/hdp/current/ranger-admin/ews/lib/mysql-jdbc-driver.jar:/usr/hdp/current/ranger-admin/jisql/lib/* org.apache.util.sql.Jisql -driver mysqlconj -cstring jdbc:mysql://r7u07.thanos.gotgdt.net/ranger -u 'rangeradmin' -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = '013' and active = 'Y';"
2018-08-06 19:22:07,387 [I] Patch 013-permissionmodel.sql is already applied
2018-08-06 19:22:07,388 [I] Executing patch on ranger from file: 014-createkeyadmin.sql
2018-08-06 19:22:07,388 [JISQL] /usr/java/default/bin/java -cp /usr/hdp/current/ranger-admin/ews/lib/mysql-jdbc-driver.jar:/usr/hdp/current/ranger-admin/jisql/lib/* org.apache.util.sql.Jisql -driver mysqlconj -cstring jdbc:mysql://r7u07.thanos.gotgdt.net/ranger -u 'rangeradmin' -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = '014' and active = 'Y';"
2018-08-06 19:22:07,834 [I] Patch 014-createkeyadmin.sql is already applied
2018-08-06 19:22:07,835 [I] Executing patch on ranger from file: 016-updated-schema-for-tag-based-policy.sql
2018-08-06 19:22:07,835 [JISQL] /usr/java/default/bin/java -cp /usr/hdp/current/ranger-admin/ews/lib/mysql-jdbc-driver.jar:/usr/hdp/current/ranger-admin/jisql/lib/* org.apache.util.sql.Jisql -driver mysqlconj -cstring jdbc:mysql://r7u07.thanos.gotgdt.net/ranger -u 'rangeradmin' -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = '016' and active = 'Y';"
2018-08-06 19:22:08,310 [I] Patch 016-updated-schema-for-tag-based-policy.sql is already applied
2018-08-06 19:22:08,310 [I] Executing patch on ranger from file: 018-createtagsyncuser.sql
2018-08-06 19:22:08,311 [JISQL] /usr/java/default/bin/java -cp /usr/hdp/current/ranger-admin/ews/lib/mysql-jdbc-driver.jar:/usr/hdp/current/ranger-admin/jisql/lib/* org.apache.util.sql.Jisql -driver mysqlconj -cstring jdbc:mysql://r7u07.thanos.gotgdt.net/ranger -u 'rangeradmin' -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = '018' and active = 'Y';"
2018-08-06 19:22:08,764 [I] Patch 018-createtagsyncuser.sql is already applied
2018-08-06 19:22:08,765 [I] Executing patch on ranger from file: 019-create-indexes.sql
2018-08-06 19:22:08,765 [JISQL] /usr/java/default/bin/java -cp /usr/hdp/current/ranger-admin/ews/lib/mysql-jdbc-driver.jar:/usr/hdp/current/ranger-admin/jisql/lib/* org.apache.util.sql.Jisql -driver mysqlconj -cstring jdbc:mysql://r7u07.thanos.gotgdt.net/ranger -u 'rangeradmin' -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = '019' and active = 'Y';"
2018-08-06 19:22:09,264 [I] Patch 019-create-indexes.sql is already applied
2018-08-06 19:22:09,264 [I] Executing patch on ranger from file: 020-datamask-policy.sql
2018-08-06 19:22:09,265 [JISQL] /usr/java/default/bin/java -cp /usr/hdp/current/ranger-admin/ews/lib/mysql-jdbc-driver.jar:/usr/hdp/current/ranger-admin/jisql/lib/* org.apache.util.sql.Jisql -driver mysqlconj -cstring jdbc:mysql://r7u07.thanos.gotgdt.net/ranger -u 'rangeradmin' -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = '020' and active = 'Y';"
2018-08-06 19:22:09,716 [I] Patch 020-datamask-policy.sql is already applied
2018-08-06 19:22:09,717 [I] Executing patch on ranger from file: 021-update-tag-for-owner.sql
2018-08-06 19:22:09,717 [JISQL] /usr/java/default/bin/java -cp /usr/hdp/current/ranger-admin/ews/lib/mysql-jdbc-driver.jar:/usr/hdp/current/ranger-admin/jisql/lib/* org.apache.util.sql.Jisql -driver mysqlconj -cstring jdbc:mysql://r7u07.thanos.gotgdt.net/ranger -u 'rangeradmin' -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = '021' and active = 'Y';"
2018-08-06 19:22:10,142 [I] Patch 021-update-tag-for-owner.sql is already applied
2018-08-06 19:22:10,143 [I] Executing patch on ranger from file: 022-split-service-table.sql
2018-08-06 19:22:10,143 [JISQL] /usr/java/default/bin/java -cp /usr/hdp/current/ranger-admin/ews/lib/mysql-jdbc-driver.jar:/usr/hdp/current/ranger-admin/jisql/lib/* org.apache.util.sql.Jisql -driver mysqlconj -cstring jdbc:mysql://r7u07.thanos.gotgdt.net/ranger -u 'rangeradmin' -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = '022' and active = 'Y';"
2018-08-06 19:22:10,569 [I] Patch 022-split-service-table.sql is already applied
2018-08-06 19:22:10,570 [I] Executing patch on ranger from file: 023-add-unique-constraint-on-table-x_user.sql
2018-08-06 19:22:10,570 [JISQL] /usr/java/default/bin/java -cp /usr/hdp/current/ranger-admin/ews/lib/mysql-jdbc-driver.jar:/usr/hdp/current/ranger-admin/jisql/lib/* org.apache.util.sql.Jisql -driver mysqlconj -cstring jdbc:mysql://r7u07.thanos.gotgdt.net/ranger -u 'rangeradmin' -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = '023' and active = 'Y';"
2018-08-06 19:22:11,014 [I] Patch 023-add-unique-constraint-on-table-x_user.sql is already applied
2018-08-06 19:22:11,014 [I] Executing patch on ranger from file: 024-sortorder-column-size.sql
2018-08-06 19:22:11,015 [JISQL] /usr/java/default/bin/java -cp /usr/hdp/current/ranger-admin/ews/lib/mysql-jdbc-driver.jar:/usr/hdp/current/ranger-admin/jisql/lib/* org.apache.util.sql.Jisql -driver mysqlconj -cstring jdbc:mysql://r7u07.thanos.gotgdt.net/ranger -u 'rangeradmin' -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = '024' and active = 'Y';"
2018-08-06 19:22:11,447 [I] Patch 024-sortorder-column-size.sql is already applied
2018-08-06 19:22:11,448 [I] Executing patch on ranger from file: 025-create-schema-for-plugin-info.sql
2018-08-06 19:22:11,448 [JISQL] /usr/java/default/bin/java -cp /usr/hdp/current/ranger-admin/ews/lib/mysql-jdbc-driver.jar:/usr/hdp/current/ranger-admin/jisql/lib/* org.apache.util.sql.Jisql -driver mysqlconj -cstring jdbc:mysql://r7u07.thanos.gotgdt.net/ranger -u 'rangeradmin' -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = '025' and active = 'Y';"
2018-08-06 19:22:11,893 [I] Patch 025-create-schema-for-plugin-info.sql is already applied
2018-08-06 19:22:11,893 [I] Executing patch on ranger from file: 026-add-column-in-x_policy_export_audit.sql
2018-08-06 19:22:11,893 [JISQL] /usr/java/default/bin/java -cp /usr/hdp/current/ranger-admin/ews/lib/mysql-jdbc-driver.jar:/usr/hdp/current/ranger-admin/jisql/lib/* org.apache.util.sql.Jisql -driver mysqlconj -cstring jdbc:mysql://r7u07.thanos.gotgdt.net/ranger -u 'rangeradmin' -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = '026' and active = 'Y';"
2018-08-06 19:22:12,360 [I] Patch 026-add-column-in-x_policy_export_audit.sql is already applied
2018-08-06 19:22:12,360 [I] Executing patch on ranger from file: 027-sortorder-column-size.sql
2018-08-06 19:22:12,360 [JISQL] /usr/java/default/bin/java -cp /usr/hdp/current/ranger-admin/ews/lib/mysql-jdbc-driver.jar:/usr/hdp/current/ranger-admin/jisql/lib/* org.apache.util.sql.Jisql -driver mysqlconj -cstring jdbc:mysql://r7u07.thanos.gotgdt.net/ranger -u 'rangeradmin' -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = '027' and active = 'Y';"
2018-08-06 19:22:12,816 [I] Patch 027-sortorder-column-size.sql is already applied
2018-08-06 19:22:12,816 [I] Executing patch on ranger from file: 028-delete-xgroup-duplicate-references.sql
2018-08-06 19:22:12,816 [JISQL] /usr/java/default/bin/java -cp /usr/hdp/current/ranger-admin/ews/lib/mysql-jdbc-driver.jar:/usr/hdp/current/ranger-admin/jisql/lib/* org.apache.util.sql.Jisql -driver mysqlconj -cstring jdbc:mysql://r7u07.thanos.gotgdt.net/ranger -u 'rangeradmin' -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = '028' and active = 'Y';"
2018-08-06 19:22:13,299 [JISQL] /usr/java/default/bin/java -cp /usr/hdp/current/ranger-admin/ews/lib/mysql-jdbc-driver.jar:/usr/hdp/current/ranger-admin/jisql/lib/* org.apache.util.sql.Jisql -driver mysqlconj -cstring jdbc:mysql://r7u07.thanos.gotgdt.net/ranger -u 'rangeradmin' -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = '028' and active = 'N';"
2018-08-06 19:22:13,734 [I] Patch 028-delete-xgroup-duplicate-references.sql is being applied by some other process
2018-08-06 19:24:13,773 [JISQL] /usr/java/default/bin/java -cp /usr/hdp/current/ranger-admin/ews/lib/mysql-jdbc-driver.jar:/usr/hdp/current/ranger-admin/jisql/lib/* org.apache.util.sql.Jisql -driver mysqlconj -cstring jdbc:mysql://r7u07.thanos.gotgdt.net/ranger -u 'rangeradmin' -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = '028' and active = 'N';"
2018-08-06 19:24:14,236 [I] Patch 028-delete-xgroup-duplicate-references.sql is being applied by some other process
2018-08-06 19:26:14,332 [JISQL] /usr/java/default/bin/java -cp /usr/hdp/current/ranger-admin/ews/lib/mysql-jdbc-driver.jar:/usr/hdp/current/ranger-admin/jisql/lib/* org.apache.util.sql.Jisql -driver mysqlconj -cstring jdbc:mysql://r7u07.thanos.gotgdt.net/ranger -u 'rangeradmin' -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = '028' and active = 'N';"
2018-08-06 19:26:14,799 [I] Patch 028-delete-xgroup-duplicate-references.sql is being applied by some other process
2018-08-06 19:28:14,899 [JISQL] /usr/java/default/bin/java -cp /usr/hdp/current/ranger-admin/ews/lib/mysql-jdbc-driver.jar:/usr/hdp/current/ranger-admin/jisql/lib/* org.apache.util.sql.Jisql -driver mysqlconj -cstring jdbc:mysql://r7u07.thanos.gotgdt.net/ranger -u 'rangeradmin' -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = '028' and active = 'N';"
2018-08-06 19:28:15,402 [I] Patch 028-delete-xgroup-duplicate-references.sql is being applied by some other process
2018-08-06 19:30:15,482 [JISQL] /usr/java/default/bin/java -cp /usr/hdp/current/ranger-admin/ews/lib/mysql-jdbc-driver.jar:/usr/hdp/current/ranger-admin/jisql/lib/* org.apache.util.sql.Jisql -driver mysqlconj -cstring jdbc:mysql://r7u07.thanos.gotgdt.net/ranger -u 'rangeradmin' -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = '028' and active = 'N';"
2018-08-06 19:30:15,970 [I] Patch 028-delete-xgroup-duplicate-references.sql is being applied by some other process
Command failed after 1 tries
... View more
Labels:
08-02-2018
04:46 PM
As it were, being in a walled off environment that does not have the latest version of the CentOS repos, this was a significantly more head-scratching affair. As it turns out, the simple fix is to update yum, which fixes this bug. Unfortunately, that was not an option for me. Fortunately, there is a manual work-around that did work: Comment 17, which is to o the following: sed -i "/for creq in pkg.conflicts:/a\ if creq[0].startswith('freeipa'): continue" /usr/lib/python2.7/site-packages/yum/rpmsack.py So, in case someone else runs into this issue and is in the same type of restricted environment that I am in, this should fix things for you too...
... View more
08-02-2018
03:46 PM
I am attempting to upgrade from HDP 2.6 to 3.0 and am encountering dependency conflicts related to freeipa on CentOS 7. Has anyone else encountered this? From a quick google search, the freeipa/ipa conflict is a known bug that can be ignored, but I am unsure of how to get Ambari to do so...or if that is a good idea: stderr:
2018-08-02 15:19:12,001 - Failed to verify package dependencies. Execution of '['/usr/bin/yum', '-d', '0', '-e', '0', 'check', 'dependencies']' returned 1. ipa-admintools-4.4.0-14.el7.centos.6.noarch has installed conflicts freeipa-admintools: ipa-admintools-4.4.0-14.el7.centos.6.noarch
ipa-client-4.4.0-14.el7.centos.6.x86_64 has installed conflicts freeipa-client: ipa-client-4.4.0-14.el7.centos.6.x86_64
ipa-client-common-4.4.0-14.el7.centos.6.noarch has installed conflicts freeipa-client-common: ipa-client-common-4.4.0-14.el7.centos.6.noarch
ipa-common-4.4.0-14.el7.centos.6.noarch has installed conflicts freeipa-common: ipa-common-4.4.0-14.el7.centos.6.noarch
2018-08-02 15:19:12,001 - Failure while verifying dependencies
2018-08-02 15:19:12,001 - *******************************************************************************
2018-08-02 15:19:12,001 - Manually verify and fix package dependencies and then re-run install_packages
2018-08-02 15:19:12,001 - *******************************************************************************
Traceback (most recent call last):
File "/var/lib/ambari-agent/cache/custom_actions/scripts/install_packages.py", line 486, in
InstallPackages().execute()
File "/usr/lib/ambari-agent/lib/resource_management/libraries/script/script.py", line 353, in execute
method(env)
File "/var/lib/ambari-agent/cache/custom_actions/scripts/install_packages.py", line 149, in actionexecute
raise Fail("Failed to distribute repositories/install packages")
resource_management.core.exceptions.Fail: Failed to distribute repositories/install packages
stdout:
2018-08-02 15:18:48,195 - Will install packages for repository version 3.0.0.0
2018-08-02 15:18:48,195 - Repository for HDP/3.0.0.0/hdp-gpl is not managed by Ambari
2018-08-02 15:18:48,195 - Repository for HDP/3.0.0.0/hdp is not managed by Ambari
2018-08-02 15:18:48,195 - Repository for HDP/3.0.0.0/hdp-utils is not managed by Ambari
2018-08-02 15:18:48,196 - Yum non-completed transactions check passed
2018-08-02 15:18:48,196 - call[('ambari-python-wrap', u'/usr/bin/hdp-select', 'versions')] {}
2018-08-02 15:18:48,223 - call returned (0, '2.6.2.0-205\n3.0.0.0-1634')
2018-08-02 15:18:48,224 - Installing package hdp-select ('/usr/bin/yum -y install hdp-select')
2018-08-02 15:18:51,152 - Looking for matching packages in the following repositories: hdp-gpl, hdp, hdp-utils
2018-08-02 15:18:59,136 - Installing package atlas-metadata_3_0_0_0_1634 ('/usr/bin/yum -y install atlas-metadata_3_0_0_0_1634')
2018-08-02 15:18:59,760 - Installing package ambari-infra-solr-client ('/usr/bin/yum -y install ambari-infra-solr-client')
2018-08-02 15:19:00,383 - Installing package kafka_3_0_0_0_1634 ('/usr/bin/yum -y install kafka_3_0_0_0_1634')
2018-08-02 15:19:00,914 - Installing package gcc ('/usr/bin/yum -y install gcc')
2018-08-02 15:19:01,444 - Installing package python-kerberos ('/usr/bin/yum -y install python-kerberos')
2018-08-02 15:19:02,066 - Installing package hadoop_3_0_0_0_1634 ('/usr/bin/yum -y install hadoop_3_0_0_0_1634')
2018-08-02 15:19:02,596 - Installing package hadoop_3_0_0_0_1634-client ('/usr/bin/yum -y install hadoop_3_0_0_0_1634-client')
2018-08-02 15:19:03,220 - Installing package snappy ('/usr/bin/yum -y install snappy')
2018-08-02 15:19:03,749 - Installing package snappy-devel ('/usr/bin/yum -y install snappy-devel')
2018-08-02 15:19:04,369 - Installing package hadoop_3_0_0_0_1634-libhdfs ('/usr/bin/yum -y install hadoop_3_0_0_0_1634-libhdfs')
2018-08-02 15:19:05,005 - Installing package hadoop_3_0_0_0_1634-mapreduce ('/usr/bin/yum -y install hadoop_3_0_0_0_1634-mapreduce')
2018-08-02 15:19:05,649 - Installing package ambari-infra-solr-client ('/usr/bin/yum -y install ambari-infra-solr-client')
2018-08-02 15:19:06,293 - Installing package hbase_3_0_0_0_1634 ('/usr/bin/yum -y install hbase_3_0_0_0_1634')
2018-08-02 15:19:06,842 - Installing package phoenix_3_0_0_0_1634 ('/usr/bin/yum -y install phoenix_3_0_0_0_1634')
2018-08-02 15:19:07,387 - Installing package zookeeper_3_0_0_0_1634 ('/usr/bin/yum -y install zookeeper_3_0_0_0_1634')
2018-08-02 15:19:07,936 - Installing package zookeeper_3_0_0_0_1634-server ('/usr/bin/yum -y install zookeeper_3_0_0_0_1634-server')
2018-08-02 15:19:08,577 - Installing package hadoop_3_0_0_0_1634-yarn ('/usr/bin/yum -y install hadoop_3_0_0_0_1634-yarn')
2018-08-02 15:19:09,221 - Installing package hadoop_3_0_0_0_1634-mapreduce ('/usr/bin/yum -y install hadoop_3_0_0_0_1634-mapreduce')
2018-08-02 15:19:09,859 - Installing package hadoop_3_0_0_0_1634-hdfs ('/usr/bin/yum -y install hadoop_3_0_0_0_1634-hdfs')
2018-08-02 15:19:12,001 - Failed to verify package dependencies. Execution of '['/usr/bin/yum', '-d', '0', '-e', '0', 'check', 'dependencies']' returned 1. ipa-admintools-4.4.0-14.el7.centos.6.noarch has installed conflicts freeipa-admintools: ipa-admintools-4.4.0-14.el7.centos.6.noarch
ipa-client-4.4.0-14.el7.centos.6.x86_64 has installed conflicts freeipa-client: ipa-client-4.4.0-14.el7.centos.6.x86_64
ipa-client-common-4.4.0-14.el7.centos.6.noarch has installed conflicts freeipa-client-common: ipa-client-common-4.4.0-14.el7.centos.6.noarch
ipa-common-4.4.0-14.el7.centos.6.noarch has installed conflicts freeipa-common: ipa-common-4.4.0-14.el7.centos.6.noarch
2018-08-02 15:19:12,001 - Failure while verifying dependencies
2018-08-02 15:19:12,001 - *******************************************************************************
2018-08-02 15:19:12,001 - Manually verify and fix package dependencies and then re-run install_packages
2018-08-02 15:19:12,001 - *******************************************************************************
2018-08-02 15:19:12,002 - Installation of packages failed. Checking if installation was partially complete
2018-08-02 15:19:12,002 - Old versions: ['2.6.2.0-205', '3.0.0.0-1634']
2018-08-02 15:19:12,002 - call[('ambari-python-wrap', u'/usr/bin/hdp-select', 'versions')] {}
2018-08-02 15:19:12,027 - call returned (0, '2.6.2.0-205\n3.0.0.0-1634')
2018-08-02 15:19:12,027 - New versions: ['2.6.2.0-205', '3.0.0.0-1634']
2018-08-02 15:19:12,028 - Deltas: set([]) Command failed after 1 tries
... View more
04-27-2017
09:42 PM
I had a small test cluster that I had installed HDP 2.5 on and then uninstalled everything. Now I downloaded HDP 2.6 and attempted to run ambari-server setup as shown and each time, I get the same error related to the user that ambari should run as. I have tried not changing the default, accepting the default (root), and using another existing user. all of these result in the same error. I have deleted everything related to hadoop on the server that I can find in case that was an issue from the previous 2.5 install.
Here is the error: [root@pocc1 /]# ambari-server setup -v -gUsing python /usr/bin/pythonSetup ambari-serverINFO: Loading properties from /etc/ambari-server/conf/ambari.propertiesChecking SELinux...INFO: about to run command: /sbin/sestatusINFO: process_pid=13802SELinux status is 'disabled'INFO: Loading properties from /etc/ambari-server/conf/ambari.propertiesCustomize user account for ambari-server daemon [y/n] (n)? nINFO: Loading properties from /etc/ambari-server/conf/ambari.propertiesINFO: Cleaning bootstrap directory (/var/run/ambari-server/bootstrap) contents...ERROR: Unexpected error 'getpwuid(): uid not found: 1001'ERROR: Exiting with exit code 1. REASON: Failed to create user. Exiting. And here is what I found in /var/log/ambari-server/ambari-server-command.log : [root@pocc1 /]# more /var/log/ambari-server/ambari-server-command.log
INFO 2017-04-27 16:25:58,673 ambari-server.py:777 - loglevel=logging.INFO
INFO 2017-04-27 16:25:58,674 serverSetup.py:1090 - Setup ambari-server.
ERROR 2017-04-27 16:26:05,832 ambari-server.py:880 - 'Fatal exception: Failed to create user. Exiting., exit code 1'
Traceback (most recent call last):
File "/usr/sbin/ambari-server.py", line 863, in main
action_obj.execute()
File "/usr/sbin/ambari-server.py", line 78, in execute
self.fn(*self.args, **self.kwargs)
File "/usr/lib/python2.6/site-packages/ambari_server/serverSetup.py", line 1117, in setup
raise FatalException(retcode, err)
FatalException: 'Fatal exception: Failed to create user. Exiting., exit code 1'
INFO 2017-04-27 16:26:14,435 ambari-server.py:777 - loglevel=logging.INFO
INFO 2017-04-27 16:26:14,436 serverSetup.py:1090 - Setup ambari-server.
ERROR 2017-04-27 16:26:15,932 ambari-server.py:880 - 'Fatal exception: Failed to create user. Exiting., exit code 1'
Traceback (most recent call last):
File "/usr/sbin/ambari-server.py", line 863, in main
action_obj.execute()
File "/usr/sbin/ambari-server.py", line 78, in execute
self.fn(*self.args, **self.kwargs)
File "/usr/lib/python2.6/site-packages/ambari_server/serverSetup.py", line 1117, in setup
raise FatalException(retcode, err)
FatalException: 'Fatal exception: Failed to create user. Exiting., exit code 1'
INFO 2017-04-27 16:26:24,324 ambari-server.py:777 - loglevel=logging.INFO
INFO 2017-04-27 16:26:24,326 serverSetup.py:1090 - Setup ambari-server.
ERROR 2017-04-27 16:26:30,378 ambari-server.py:880 - 'Fatal exception: Failed to create user. Exiting., exit code 1'
Traceback (most recent call last):
File "/usr/sbin/ambari-server.py", line 863, in main
action_obj.execute()
File "/usr/sbin/ambari-server.py", line 78, in execute
self.fn(*self.args, **self.kwargs)
File "/usr/lib/python2.6/site-packages/ambari_server/serverSetup.py", line 1117, in setup
raise FatalException(retcode, err)
FatalException: 'Fatal exception: Failed to create user. Exiting., exit code 1'
INFO 2017-04-27 16:26:36,497 ambari-server.py:777 - loglevel=logging.INFO
INFO 2017-04-27 16:26:36,499 serverSetup.py:1090 - Setup ambari-server.
ERROR 2017-04-27 16:26:50,455 ambari-server.py:880 - 'Fatal exception: Failed to create user. Exiting., exit code 1'
Traceback (most recent call last):
File "/usr/sbin/ambari-server.py", line 863, in main
action_obj.execute()
File "/usr/sbin/ambari-server.py", line 78, in execute
self.fn(*self.args, **self.kwargs)
File "/usr/lib/python2.6/site-packages/ambari_server/serverSetup.py", line 1117, in setup
raise FatalException(retcode, err)
FatalException: 'Fatal exception: Failed to create user. Exiting., exit code 1'
INFO 2017-04-27 16:29:45,363 ambari-server.py:777 - loglevel=logging.INFO
INFO 2017-04-27 16:29:45,365 ambari-server.py:160 - Stopping ambari-server.
INFO 2017-04-27 16:29:45,365 ambari-server.py:189 - Ambari Server is not running
INFO 2017-04-27 16:36:59,920 ambari-server.py:777 - loglevel=logging.INFO
INFO 2017-04-27 16:36:59,922 serverSetup.py:1090 - Setup ambari-server.
ERROR 2017-04-27 16:37:01,782 ambari-server.py:880 - 'Fatal exception: Failed to create user. Exiting., exit code 1'
Traceback (most recent call last):
File "/usr/sbin/ambari-server.py", line 863, in main
action_obj.execute()
File "/usr/sbin/ambari-server.py", line 78, in execute
self.fn(*self.args, **self.kwargs)
File "/usr/lib/python2.6/site-packages/ambari_server/serverSetup.py", line 1117, in setup
raise FatalException(retcode, err)
FatalException: 'Fatal exception: Failed to create user. Exiting., exit code 1'
INFO 2017-04-27 16:55:58,505 ambari-server.py:777 - loglevel=logging.INFO
INFO 2017-04-27 16:55:58,507 serverSetup.py:1090 - Setup ambari-server.
ERROR 2017-04-27 16:56:09,222 ambari-server.py:880 - 'Fatal exception: Failed to create user. Exiting., exit code 1'
Traceback (most recent call last):
File "/usr/sbin/ambari-server.py", line 863, in main
action_obj.execute()
File "/usr/sbin/ambari-server.py", line 78, in execute
self.fn(*self.args, **self.kwargs)
File "/usr/lib/python2.6/site-packages/ambari_server/serverSetup.py", line 1117, in setup
raise FatalException(retcode, err)
FatalException: 'Fatal exception: Failed to create user. Exiting., exit code 1'
INFO 2017-04-27 17:18:02,302 ambari-server.py:777 - loglevel=logging.INFO
INFO 2017-04-27 17:18:02,304 serverSetup.py:1090 - Setup ambari-server.
ERROR 2017-04-27 17:18:06,580 ambari-server.py:880 - 'Fatal exception: Failed to create user. Exiting., exit code 1'
Traceback (most recent call last):
File "/usr/sbin/ambari-server.py", line 863, in main
action_obj.execute()
File "/usr/sbin/ambari-server.py", line 78, in execute
self.fn(*self.args, **self.kwargs)
File "/usr/lib/python2.6/site-packages/ambari_server/serverSetup.py", line 1117, in setup
raise FatalException(retcode, err)
FatalException: 'Fatal exception: Failed to create user. Exiting., exit code 1'
Any suggestions would be greatly appreciated! I looked at the offending code and followed the python functions and could not find any obvious reason for the errors...but I don't write in Python, so I could easily have missed something. One other thing I noticed is that the ambari install seems to place some files in /usr/lib/python2.6/site-packages/ambari_server/ directory, but Python version on this OS (CentOS 7) is actually 2.7. There is no corresponding ambari_server directory in /usr/lib/python2.7/site-packages directory, which made me scratch my head a bit since I checked in the docs and saw that Python 2.7 should be fine...
... View more
Labels:
