About bhanu_pamu

bhanu_pamu · ‎07-19-2018

@Anjali Shevadkar We had to implement the ldap settings in core-site.xml via Ambari and then restart the effected services. Later you may run the hdfs regroup mapping command to sync from backend. Let me know how it goes ?

bhanu_pamu · ‎06-13-2018

@Vinicius Higa Murakami Is there a way to move the blocks from non-DFS mount /hadoop to DFS mounts like /data and later remove the files if they are yet there on /hadoop mount.

bhanu_pamu · ‎06-13-2018

@Vinay K What is the OS you are running on. Do you have OS user with the same name ? Do you see hdfs directory for that user in /user/asif Are you querying on internal or external hive table ?

bhanu_pamu · ‎06-05-2018

While enabling kerberos on Ambari managed hadoop cluster we faced error at the last stage, when services are started. It failed at Slider Install step, with the following error. 2018-06-05 16:17:28,171 - Execution of '/usr/bin/yum -d 0 -e 0 -y install storm_3_1_0_0_564-slider-client' returned 1. Error: Package: storm_3_1_0_0_564-slider-client-1.1.1.3.1.0.0-564.x86_64 (HDF-3.0-repo-1) Requires: slider_3_1_0_0_564 Existing version of slider and storm ]$ sudo yum list | grep storm storm_2_6_3_0_235-slider-client.x86_64 1.1.0.2.6.3.0-235 @HDP-2.6-repo-1 atlas-metadata-storm-plugin.noarch 0.8.0.2.6.3.0-235 HDP-2.6-repo-1 atlas-metadata_2_6_3_0_235-storm-plugin.noarch ranger-storm-plugin.noarch 0.7.0.3.1.0.0-564 HDF-3.0-repo-1 ranger_2_6_3_0_235-storm-plugin.x86_64 0.7.0.2.6.3.0-235 HDP-2.6-repo-1 ranger_3_1_0_0_564-storm-plugin.x86_64 0.7.0.3.1.0.0-564 HDF-3.0-repo-1 storm.noarch 1.1.1.3.1.0.0-564 HDF-3.0-repo-1 storm-slider-client.noarch 1.1.1.3.1.0.0-564 HDF-3.0-repo-1 storm_2_6_3_0_235.x86_64 1.1.0.2.6.3.0-235 HDP-2.6-repo-1 storm_3_1_0_0_564.x86_64 1.1.1.3.1.0.0-564 HDF-3.0-repo-1 storm_3_1_0_0_564-slider-client.x86_64 1.1.1.3.1.0.0-564 HDF-3.0-repo-1 ]$ sudo yum list | grep slider slider_2_6_3_0_235.noarch 0.92.0.2.6.3.0-235 @HDP-2.6-repo-1 storm_2_6_3_0_235-slider-client.x86_64 1.1.0.2.6.3.0-235 @HDP-2.6-repo-1 slider.noarch 0.92.0.2.6.3.0-235 HDP-2.6-repo-1 storm-slider-client.noarch 1.1.1.3.1.0.0-564 HDF-3.0-repo-1 storm_3_1_0_0_564-slider-client.x86_64 1.1.1.3.1.0.0-564 HDF-3.0-repo-1 There doesn't seem to be a slider rpm available with HDF repo binaries. 1. Is it possible to skip the upgrade of Storm via HDF repo ?

bhanu_pamu · ‎05-30-2018

1. The group mapping is done via LDAP with the similar settings that are used to configured Ranger User Info. 2. Yes, we have checked that possibility and hence we have changed the groups to small case to avoid any kind of doubt regarding the case sensitivity. Yet the problem persists. Here's the example. >hdfs groups bhanu.pamu bhanu.pamu : developers And we have granted 'developers' group 'select' access in Ranger to Hive Tables. Any further suggestions please.

bhanu_pamu · ‎05-29-2018

We have HDP 2.6.3 clustered with kerberos enabled. We have-Hive plugin enabled and policies set for Groups which are imported from OpenDJ(LDAP). We can see hive policies working when the permissions are granted to users, however when the same policies are granted to Groups, the user get's the error regarding - USE privilege not available for default tables. Users and Groups are imported to Ranger, Ambari and also hadoop-group mapping is enabled. So when we enter - hdfs groups username, we get the ldap group the user is added to. So we are not sure, what more needs to be checked. Any suggestions would be helpful.

bhanu_pamu · ‎05-28-2018

Can you specify the location of json files which needs to be checked.

bhanu_pamu · ‎05-24-2018

Followed the steps mentioned in this link - and it worked. https://community.hortonworks.com/questions/149389/zeppelin-does-not-write-its-notes-in-hdfs-on-hdp-2.html

bhanu_pamu · ‎05-24-2018

I followed the above steps. The configuration in Ambari --> Zeppelin Notebook--> Configs --> Advanced zeppelin-config zeppelin.config.fs.dir=conf zeppelin.notebook.dir=notebook zeppelin.interpreter.dir=interpreter zeppelin.notebook.storage=org.apache.zeppelin.notebook.repo.FileSystemNotebookRepo Yet while I login to Zeppelin Notebook to either of the nodes - the Notebook Repos tab shows the following value Notebook Path /usr/hdp/current/zeppelin-server/notebook/ So whenever I create a notebook, it goes and saved in local zeppelin server directory. I tried changing the path of Network Repos from Zeppelin login, however when I restart the services, it goes back to default. I tried changing the value of ZEPPELIN_NOTEBOOK_DIR in zeppelin_env_content using Ambari, however the after service restart Zeppelin doesn't work properly. It gives 503 server error or the notebooks repo is empty, no old notebooks seen. I have copied the notebooks from /usr/hdp/current/zeppelin-server/notebook/local to hdfs file system /user/zeppelin/notebook, still no gain. Somehow the configuration doesn't work in HA mode. The notebook files are not written to HDFS file system. Any further suggestions?

bhanu_pamu · ‎05-23-2018

I have installed Zeppelin Notebooks on two nodes in a Ambari Managed HDP Cluster using the link. Both the links are up and running. User authentication is enabled via LDAP users. When a user is creating a notebook on Node 1, the notebook is not visible when he logs in from URL-of node 2. zeppelin.notebook.storage=org.apache.zeppelin.notebook.repo.FileSystemNotebookRepo is enabled. The version of Zeppelin is 0.7.3 Is it possible to use - HDFS file system location as the repository path for Zeppelin notebooks and where do I configure the path for Zeppelin, so that both nodes point to the same repo. Thanks.

bhanu_pamu · ‎05-08-2018

@Jorge Alonso - Please go to Ranger - Service Manager - Hive you should see the clustername_hive tab. Click on it , you will find 4 policies in Ranger by default. Check the policy related to - all database, udf - grant access to your user/hive user. Let me know how it goes.

Online	Offline
Last Visited	‎08-14-2018 12:35 PM

Date Registered	‎05-08-2018 08:41 AM
Last Visited	‎08-14-2018 12:35 PM
Total Messages Posted	11
Total Kudos Received	2

Re: Configuration Steps for Central Repository of ...

Re: Ranger - Hive Policies does not work with LDAP...

Re: Non-DFS storage occupied in Hadoop mount in Li...

Re: hive running query from different user but use...

Installation of Storm 3.1 Fails because Slider 3.1...

Re: Ranger - Hive Policies does not work with LDAP...

Ranger - Hive Policies does not work with LDAP gro...

Re: Ranger policies not working for some groups

Re: Configuration Steps for Central Repository of ...

Re: Configuration Steps for Central Repository of ...

Configuration Steps for Central Repository of Zepp...

Re: Hive view raise Failed to execute statement: s...