Member since
03-13-2019
11
Posts
0
Kudos Received
0
Solutions
06-21-2019
02:18 AM
Hi All, I was trying to set up a DPS instance and it started forwarding me to Knox (the local docker container, not my cluster service) When looking into this, I found this documentation however it uses a release version of 1.2.2. When running the command it says the release cant be found. I followed the bouncing ball to this page which hosts all the releases and it appears that the latest release is 1.0.0-dev.2. Is that the version/release I should be using? Kind Regards, Nathaniel Vala
... View more
Labels:
04-28-2019
07:25 AM
Sorry, It was there initially, not sure what happened
... View more
04-27-2019
03:07 PM
I built a NiFi flow with Nifi and Atlas, did the integrations and all of a sudden I am getting the following error anytime i try to post a web request to Atlas to update classification This is the Flow, and the troubled item is the flow path in the bottom right (Write Classification to Atlas) Any help would be greatly appreciated
... View more
Labels:
04-05-2019
01:06 PM
Hi All, Trying to enable Ranger with AD and am getting issues with the usersync function. Below is the two errors, it seems like the user doing the sync is unable to authenticate to the Ranger Admin UI but dont know why. Anyone know how to fix this? Ranger Admin Logs: <IP-ADDRESS> - - [04/Apr/2019:14:59:06 +0000] "POST /service/xusers/ugsync/auditinfo/ HTTP/1.1" 401 - "-" "Java/1.8.0_191" Ranger UserSync Logs: 04 Apr 2019 14:59:06 ERROR LdapPolicyMgrUserGroupBuilder [UnixUserSyncThread] - Failed to add addorUpdate group user info
04 Apr 2019 14:59:06 ERROR LdapDeltaUserGroupBuilder [UnixUserSyncThread] - sink.addOrUpdateGroup failed with exception: Failed to add addorUpdate group user info, for group: Role_Reader, users: [ssnape]
04 Apr 2019 14:59:06 ERROR LdapPolicyMgrUserGroupBuilder [UnixUserSyncThread] - Failed to add User :
com.sun.jersey.api.client.UniformInterfaceException: POST http://<IP-ADDRESS>:6080/service/xusers/ugsync/auditinfo/ returned a response status of 401 Unauthorized
at com.sun.jersey.api.client.WebResource.handle(WebResource.java:688)
at com.sun.jersey.api.client.WebResource.access$200(WebResource.java:74)
at com.sun.jersey.api.client.WebResource$Builder.post(WebResource.java:570)
at org.apache.ranger.ldapusersync.process.LdapPolicyMgrUserGroupBuilder.getUserGroupAuditInfo(LdapPolicyMgrUserGroupBuilder.java:522)
at org.apache.ranger.ldapusersync.process.LdapPolicyMgrUserGroupBuilder.access$300(LdapPolicyMgrUserGroupBuilder.java:68)
at org.apache.ranger.ldapusersync.process.LdapPolicyMgrUserGroupBuilder$4.run(LdapPolicyMgrUserGroupBuilder.java:495)
at org.apache.ranger.ldapusersync.process.LdapPolicyMgrUserGroupBuilder$4.run(LdapPolicyMgrUserGroupBuilder.java:491)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:360)
at org.apache.ranger.ldapusersync.process.LdapPolicyMgrUserGroupBuilder.addUserGroupAuditInfo(LdapPolicyMgrUserGroupBuilder.java:491)
at org.apache.ranger.ldapusersync.process.LdapPolicyMgrUserGroupBuilder.postUserGroupAuditInfo(LdapPolicyMgrUserGroupBuilder.java:474)
at org.apache.ranger.ldapusersync.process.LdapDeltaUserGroupBuilder.updateSink(LdapDeltaUserGroupBuilder.java:408)
at org.apache.ranger.usergroupsync.UserGroupSync.run(UserGroupSync.java:58)
at java.lang.Thread.run(Thread.java:748) I tried uninstalling and reinstalling the services and still no luck, also tried using just unix permissions and still can't connect. After digging around, I found that this setting looks like it could be wrong? as if I try to access that keystore i get the following: [root@uksddemgmthwx09-hg11 3.1.0.0-78]# ll /etc/ranger/admin/conf/ranger-admin-keystore.jks
ls: cannot access /etc/ranger/admin/conf/ranger-admin-keystore.jks: No such file or directory Any help would be appreciated.
... View more
Labels:
04-04-2019
07:44 PM
Hi All, Trying to enable Ranger with AD and am getting issues with the usersync function. Below is the two errors, it seems like the user doing the sync is unable to authenticate to the Ranger Admin UI but dont know why. Anyone know how to fix this? Ranger Admin Logs: <IP-ADDRESS> - - [04/Apr/2019:14:59:06 +0000] "POST /service/xusers/ugsync/auditinfo/ HTTP/1.1" 401 - "-" "Java/1.8.0_191" Ranger UserSync Logs: 04 Apr 2019 14:59:06 ERROR LdapPolicyMgrUserGroupBuilder [UnixUserSyncThread] - Failed to add addorUpdate group user info
04 Apr 2019 14:59:06 ERROR LdapDeltaUserGroupBuilder [UnixUserSyncThread] - sink.addOrUpdateGroup failed with exception: Failed to add addorUpdate group user info, for group: Role_Reader, users: [ssnape]
04 Apr 2019 14:59:06 ERROR LdapPolicyMgrUserGroupBuilder [UnixUserSyncThread] - Failed to add User :
com.sun.jersey.api.client.UniformInterfaceException: POST http://<IP-ADDRESS>:6080/service/xusers/ugsync/auditinfo/ returned a response status of 401 Unauthorized
at com.sun.jersey.api.client.WebResource.handle(WebResource.java:688)
at com.sun.jersey.api.client.WebResource.access$200(WebResource.java:74)
at com.sun.jersey.api.client.WebResource$Builder.post(WebResource.java:570)
at org.apache.ranger.ldapusersync.process.LdapPolicyMgrUserGroupBuilder.getUserGroupAuditInfo(LdapPolicyMgrUserGroupBuilder.java:522)
at org.apache.ranger.ldapusersync.process.LdapPolicyMgrUserGroupBuilder.access$300(LdapPolicyMgrUserGroupBuilder.java:68)
at org.apache.ranger.ldapusersync.process.LdapPolicyMgrUserGroupBuilder$4.run(LdapPolicyMgrUserGroupBuilder.java:495)
at org.apache.ranger.ldapusersync.process.LdapPolicyMgrUserGroupBuilder$4.run(LdapPolicyMgrUserGroupBuilder.java:491)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:360)
at org.apache.ranger.ldapusersync.process.LdapPolicyMgrUserGroupBuilder.addUserGroupAuditInfo(LdapPolicyMgrUserGroupBuilder.java:491)
at org.apache.ranger.ldapusersync.process.LdapPolicyMgrUserGroupBuilder.postUserGroupAuditInfo(LdapPolicyMgrUserGroupBuilder.java:474)
at org.apache.ranger.ldapusersync.process.LdapDeltaUserGroupBuilder.updateSink(LdapDeltaUserGroupBuilder.java:408)
at org.apache.ranger.usergroupsync.UserGroupSync.run(UserGroupSync.java:58)
at java.lang.Thread.run(Thread.java:748) I tried uninstalling and reinstalling the services and still no luck, also tried using just unix permissions and still can't connect. After digging around, I found that this setting looks like it could be wrong? as if I try to access that keystore i get the following: [root@uksddemgmthwx09-hg11 3.1.0.0-78]# ll /etc/ranger/admin/conf/ranger-admin-keystore.jks
ls: cannot access /etc/ranger/admin/conf/ranger-admin-keystore.jks: No such file or directory Any help would be appreciated.
... View more
Labels:
03-29-2019
07:16 AM
Thanks @Geoffrey Shelton Okot 🙂 it was owned by root, i thought this was normal and that ambari must have started the process as root because it is a security appliance, but changing to ranger works!
... View more
03-28-2019
02:04 PM
Hi All, I am having an issue in restarting Ranger Service via Ambari. I deployed a cluster via cloudbreak then added the Ranger service, I then had to make a config change and when I go to Ranger > Restart > Restart All Affected I get the attached issue: Traceback (most recent call last):
File "/var/lib/ambari-agent/cache/stacks/HDP/3.0/services/RANGER/package/scripts/ranger_admin.py", line 241, in <module>
RangerAdmin().execute()
File "/usr/lib/ambari-agent/lib/resource_management/libraries/script/script.py", line 352, in execute
method(env)
File "/usr/lib/ambari-agent/lib/resource_management/libraries/script/script.py", line 971, in restart
self.stop(env, upgrade_type=upgrade_type)
File "/var/lib/ambari-agent/cache/stacks/HDP/3.0/services/RANGER/package/scripts/ranger_admin.py", line 61, in stop
Execute(format('{params.ranger_stop}'), environment={'JAVA_HOME': params.java_home}, user=params.unix_user)
File "/usr/lib/ambari-agent/lib/resource_management/core/base.py", line 166, in __init__
self.env.run()
File "/usr/lib/ambari-agent/lib/resource_management/core/environment.py", line 160, in run
self.run_action(resource, action)
File "/usr/lib/ambari-agent/lib/resource_management/core/environment.py", line 124, in run_action
provider_action()
File "/usr/lib/ambari-agent/lib/resource_management/core/providers/system.py", line 263, in action_run
returns=self.resource.returns)
File "/usr/lib/ambari-agent/lib/resource_management/core/shell.py", line 72, in inner
result = function(command, **kwargs)
File "/usr/lib/ambari-agent/lib/resource_management/core/shell.py", line 102, in checked_call
tries=tries, try_sleep=try_sleep, timeout_kill_strategy=timeout_kill_strategy, returns=returns)
File "/usr/lib/ambari-agent/lib/resource_management/core/shell.py", line 150, in _call_wrapper
result = _call(command, **kwargs_copy)
File "/usr/lib/ambari-agent/lib/resource_management/core/shell.py", line 314, in _call
raise ExecutionFailed(err_msg, code, out, err)
resource_management.core.exceptions.ExecutionFailed: Execution of '/usr/hdp/current/ranger-admin/ews/ranger-admin-services.sh stop' returned 126. -bash: /usr/hdp/current/ranger-admin/ews/ranger-admin-services.sh: Permission denied
... View more
Labels:
03-28-2019
02:04 PM
Hi All, I am having an issue in restarting Ranger Service via Ambari. I deployed a cluster via cloudbreak then added the Ranger service, I then had to make a config change and when I go to Ranger > Restart > Restart All Affected I get the attached issue: Traceback (most recent call last):
File "/var/lib/ambari-agent/cache/stacks/HDP/3.0/services/RANGER/package/scripts/ranger_admin.py", line 241, in <module>
RangerAdmin().execute()
File "/usr/lib/ambari-agent/lib/resource_management/libraries/script/script.py", line 352, in execute
method(env)
File "/usr/lib/ambari-agent/lib/resource_management/libraries/script/script.py", line 971, in restart
self.stop(env, upgrade_type=upgrade_type)
File "/var/lib/ambari-agent/cache/stacks/HDP/3.0/services/RANGER/package/scripts/ranger_admin.py", line 61, in stop
Execute(format('{params.ranger_stop}'), environment={'JAVA_HOME': params.java_home}, user=params.unix_user)
File "/usr/lib/ambari-agent/lib/resource_management/core/base.py", line 166, in __init__
self.env.run()
File "/usr/lib/ambari-agent/lib/resource_management/core/environment.py", line 160, in run
self.run_action(resource, action)
File "/usr/lib/ambari-agent/lib/resource_management/core/environment.py", line 124, in run_action
provider_action()
File "/usr/lib/ambari-agent/lib/resource_management/core/providers/system.py", line 263, in action_run
returns=self.resource.returns)
File "/usr/lib/ambari-agent/lib/resource_management/core/shell.py", line 72, in inner
result = function(command, **kwargs)
File "/usr/lib/ambari-agent/lib/resource_management/core/shell.py", line 102, in checked_call
tries=tries, try_sleep=try_sleep, timeout_kill_strategy=timeout_kill_strategy, returns=returns)
File "/usr/lib/ambari-agent/lib/resource_management/core/shell.py", line 150, in _call_wrapper
result = _call(command, **kwargs_copy)
File "/usr/lib/ambari-agent/lib/resource_management/core/shell.py", line 314, in _call
raise ExecutionFailed(err_msg, code, out, err)
resource_management.core.exceptions.ExecutionFailed: Execution of '/usr/hdp/current/ranger-admin/ews/ranger-admin-services.sh stop' returned 126. -bash: /usr/hdp/current/ranger-admin/ews/ranger-admin-services.sh: Permission denied
... View more
03-26-2019
07:15 AM
Thanks! This solved the issue. Once I had removed the SQL service endpoint from the VNet that hosted my cloudbreak VM everything worked fine 🙂
... View more
03-19-2019
10:14 AM
Hi @Gergely Topolyai, Thanks for the recommendation, I upgraded to 2.9.0 however was still not able to connect. However this time I got a more verbose message, looks like it is an Azure routing / compatibility issue.
... View more
03-13-2019
09:48 PM
Hi All, Trying to add an Azure Database for Postgres (v10). I am able to access it using psql from my host however when trying to add it to Hortonworks as an External Source gives the following issue: Kind Regards, Nathaniel Vala
... View more
Labels: