About falbani

falbani · ‎05-03-2018

Hi @Peter Kim This feature was introduced by: https://issues.apache.org/jira/browse/RANGER-244 The motivation behind it is: During LDAP/AD sync, the entire company users and groups are imported into our database. Most of the users might not be using Hadoop. So customer wants to selectively hide users and groups, so that it doesn't show up in the drop down list when creating policies. What happens with users/groups mark as hidden? Hidden users will not be listed in the autocomplete popup during policy creation. You can read more about it from jira link I shared above. HTH *** If you found this answer addressed your question, please take a moment to login and click the "accept" link on the answer.

falbani · ‎04-30-2018

@Arnaud Bohelay Answers inline: 1. when running such a spark2 request in zeppelin, which permissions are applied? Answer > The application will run as zeppelin user, so all access will be performed as zeppelin 2. How can I "elevate" these permissions to root (so that access can be made to any folder) Answer > This is generally not a good idea. I suggest you create a folder with proper access permissions somewhere else. Maybe under opt. Like this: mkdir /opt/share chmod 777 /opt/share and use that one instead of /root which is the home directory for the root user. HTH *** If you found this answer addressed your question, please take a moment to login and click the "accept" link on the answer.

falbani · ‎04-27-2018

@Sriram Yes, that would work. You could also avoid having to copy twice (point a and c) by moving the original data to a temporary location first (which will trigger only a change on the Namenode metadata and not actual copy of blocks which could take lot time): a) Use hdfs dfs mv command to move all the original files and subfolders to /tmp b) Copy the files from /tmp to the original location using distcp -p c) Remove the original files *** If you found my previous answer addressed your question, please take a moment to login and click the "accept" link on the answer.

falbani · ‎04-26-2018

@Sriram Hadoop I'm not aware of any other method but distcp command. Just wanted to add to this thread that distcp command has a -p option that you can use to preserve file permissions (user, group, posix permissions) and timestamp as well. HTH

falbani · ‎04-26-2018

@Victor Please let us know if the above answer has helped you. Thanks.

falbani · ‎04-24-2018

@Victor The logs are showing a problem with Execution of '/usr/bin/yum -d 0 -e 0 -y install lucidworks-hdpsearch' returned 1 - I checked and lucidworks-hdpsearch is provided by HDP-UTILS repo, so you should check if yum repository for HDP-UTILS is working on the host were this is failing. yum whatprovides lucidworks-hdpsearch Loaded plugins: fastestmirror, ovl Loading mirror speeds from cached hostfile * base: mirror.sjc02.svwh.net * epel: mirror.sfo12.us.leaseweb.net * extras: mirror.web-ster.com * updates: centos-distro.cavecreek.net lucidworks-hdpsearch-2.3-4.noarch : lucidworks-hdpsearch Repo : HDP-UTILS-1.1.0.21 HTH

falbani · ‎04-24-2018

@Kant T Is your zeppelin configured to use remote storage for notebooks and interpreter settings? If so this is a known issue when upgrading to HDP 2.6.3 - The fix for this issue is already part of HDP 2.6.4. I understand there is a HDP internal bug and Hotfix you could request from Hortonworks Support if upgrading to 2.6.4 is not possible. Here is the link to the tech alert sent not long ago about this problem, it contains steps on how to apply the hotfix as well: https://community.hortonworks.com/content/supportkb/177625/zeppelin-service-issue-secure-cluster-technical-al.html If this helps answering your question please mark the answer. HTH

falbani · ‎04-20-2018

@Anshuman Mehta Yes, by default the amb_ranger_admin should be automatically created as an internal user. Not sure why is missing on your case. If the user does not exist you could create it using Ranger Admin UI - make sure the role for the user is Admin. If the above answer has helped please mark it so that it will help others as well. Thank you.

falbani · ‎04-20-2018

Changing the amb_ranger_admin password is possible. This user password is stored in two different locations. If for any reason there is difference between them you will run into issues. On this article I will go over the locations and steps to change the password. Locations 1. The amb_ranger_admin user and password exist in Ranger Admin database (encrypted) by default as an internal user. This user's password is the first location. 2. Ambari keeps a copy of the amb_ranger_admin password to create repositories and default policies for each plugin. This password is stored in ambari database (encrypted) as part of configuration of ranger-env. "ranger_admin_password" : "SECRET:ranger-env:2:ranger_admin_password", "ranger_admin_username" : "amb_ranger_admin", How to update amb_ranger_admin password? 1. Login to Ranger Admin UI, and navigate to Settions > Users and Groups. Then search for the amb_ranger_admin user and click on the username to edit. Click on the Change Password tab and enter new password. 2. Login to Ambari UI, and navigate to Ranger > Configs > Advanced. Locate Section "Admin Settings" and update password for "Ranger Admin username for Ambari". Then save and restart services if required. What if passwords are not same? Usually you will see an Ambari UI alert like the following: Ranger Admin password check User:amb_ranger_admin credentials on Ambari UI are not in sync with Ranger While passwords are mismatched Ambari wont be able to automatically create plugin repositories and policies. Due to this start/restart of any of the ranger plugin enabled services will be delayed, but services eventually will start after exhausting all retries. Error creating repository. Http status code - 401. {"statusCode":401,"msgDesc":"Authentication Failed"} Retry Repository Creation is being called Will retry 4 time(s), caught exception: Error getting <clusterName>_<serviceName> repository for component <serviceName>. Http status code - 401. {"statusCode":401,"msgDesc":"Authentication Failed"}. Sleeping for 8 sec(s)

falbani · ‎04-20-2018

Hi @Anshuman Mehta, Yes, it is possible to update amb_ranger_admin password. This user password is stored in two different locations. If there is a difference between them you will run into issues. Locations 1. The amb_ranger_admin user and password exist in Ranger Admin database (encrypted) by default as an internal user. This user's password is the first location. 2. Ambari keeps a copy of the amb_ranger_admin password to create repositories and default policies for each plugin. This password is stored in ambari database (encrypted) as part of configuration of ranger-env. "ranger_admin_password" : "SECRET:ranger-env:2:ranger_admin_password", "ranger_admin_username" : "amb_ranger_admin", How to update amb_ranger_admin password? 1. Login to Ranger Admin UI, and navigate to Settions > Users and Groups. Then search for the amb_ranger_admin user and click on the username to edit. Click on the Change Password tab and enter new password. 2. Login to Ambari UI, and navigate to Ranger > Configs > Advanced. Locate Section "Admin Settings" and update password for "Ranger Admin username for Ambari". Then save and restart services if required.

Online	Offline
Last Visited	‎10-24-2023 05:42 PM

Member Since	‎06-09-2016 09:21 PM
Last Visited	‎10-24-2023 05:42 PM
Posts	529
Kudos received	129

Cloudera Community

Re: Dependency of HDP Atlas on Ranger

Re: Spark throws "Invalid Sync" Error when trying ...

Re: Does HS2 integration with AD impact zeppelin c...

Re: zeppelin jdbc interpreter issue when HS2 is i...

Re: Accessing hive database outside the cluster ne...

Re: What is the purpose of using the "Set Visibili...

Re: Spark 2 in zeppelin cannot access local files ...

Re: How to change the block size of existing files...

Re: How to change the block size of existing files...

Re: Solr fails to install in Apache Ambari Version...

Re: Solr fails to install in Apache Ambari Version...

Re: zeppelin Web page - HTTP ERROR: 503

Re: amb_ranger_admin password update

How to change amb_ranger_admin password?

Re: amb_ranger_admin password update