Support Questions
Find answers, ask questions, and share your expertise

Trouble enabling hdfs plugin for Ranger - open source

Trouble enabling hdfs plugin for Ranger - open source

Contributor

Hi experts,

I was able to install ranger via open source and able to access the Ranger UI.

The usersync seems to work as well.

When I try to enable the hdfs plugin, then I restart all the services in the cluster, for some reason the hdfs service does not get added as a plugin to Ranger, I am not able to see it via the Ranger UI.

 

[root@test02 ranger-hdfs-plugin]# ./enable-hdfs-plugin.sh
Custom user and group is available, using custom user and group.
+ Mon Mar 8 23:40:29 CST 2021 : hadoop: lib folder=/usr/local/hadoop/lib conf folder=/usr/local/hadoop/conf
+ Mon Mar 8 23:40:29 CST 2021 : Saving /usr/local/hadoop/conf/ranger-hdfs-audit.xml to /usr/local/hadoop/conf/.ranger-hdfs-audit.xml.20210308-234029 ...
+ Mon Mar 8 23:40:29 CST 2021 : Saving /usr/local/hadoop/conf/ranger-hdfs-security.xml to /usr/local/hadoop/conf/.ranger-hdfs-security.xml.20210308-234029 ...
+ Mon Mar 8 23:40:29 CST 2021 : Saving /usr/local/hadoop/conf/ranger-policymgr-ssl.xml to /usr/local/hadoop/conf/.ranger-policymgr-ssl.xml.20210308-234029 ...
+ Mon Mar 8 23:40:29 CST 2021 : Saving current config file: /usr/local/hadoop/conf/hdfs-site.xml to /usr/local/hadoop/conf/.hdfs-site.xml.20210308-234029 ...
Picked up _JAVA_OPTIONS: -Xmx2048m -XX:MaxPermSize=512m -Djava.awt.headless=true
OpenJDK 64-Bit Server VM warning: ignoring option MaxPermSize=512m; support was removed in 8.0
+ Mon Mar 8 23:40:29 CST 2021 : Saving current config file: /usr/local/hadoop/conf/ranger-hdfs-audit.xml to /usr/local/hadoop/conf/.ranger-hdfs-audit.xml.20210308-234029 ...
Picked up _JAVA_OPTIONS: -Xmx2048m -XX:MaxPermSize=512m -Djava.awt.headless=true
OpenJDK 64-Bit Server VM warning: ignoring option MaxPermSize=512m; support was removed in 8.0
+ Mon Mar 8 23:40:29 CST 2021 : Saving current config file: /usr/local/hadoop/conf/ranger-hdfs-security.xml to /usr/local/hadoop/conf/.ranger-hdfs-security.xml.20210308-234029 ...
Picked up _JAVA_OPTIONS: -Xmx2048m -XX:MaxPermSize=512m -Djava.awt.headless=true
OpenJDK 64-Bit Server VM warning: ignoring option MaxPermSize=512m; support was removed in 8.0
+ Mon Mar 8 23:40:30 CST 2021 : Saving current config file: /usr/local/hadoop/conf/ranger-policymgr-ssl.xml to /usr/local/hadoop/conf/.ranger-policymgr-ssl.xml.20210308-234029 ...
Picked up _JAVA_OPTIONS: -Xmx2048m -XX:MaxPermSize=512m -Djava.awt.headless=true
OpenJDK 64-Bit Server VM warning: ignoring option MaxPermSize=512m; support was removed in 8.0
+ Mon Mar 8 23:40:30 CST 2021 : Saving lib file: /usr/local/hadoop/lib/ranger-hdfs-plugin-shim-0.5.4-SNAPSHOT.jar to /usr/local/hadoop/lib/.ranger-hdfs-plugin-shim-0.5.4-SNAPSHOT.jar.20210308234030 ...
+ Mon Mar 8 23:40:30 CST 2021 : Saving lib file: /usr/local/hadoop/lib/ranger-plugin-classloader-0.5.4-SNAPSHOT.jar to /usr/local/hadoop/lib/.ranger-plugin-classloader-0.5.4-SNAPSHOT.jar.20210308234030 ...
+ Mon Mar 8 23:40:30 CST 2021 : Saving current JCE file: /etc/ranger/test/cred.jceks to /etc/ranger/test/.cred.jceks.20210308234030 ...
+ Mon Mar 8 23:40:30 CST 2021 : Saving current JCE file: /etc/ranger/test/cred.jceks to /etc/ranger/test/.cred.jceks.20210308234030 ...
+ Mon Mar 8 23:40:31 CST 2021 : Saving current JCE file: /etc/ranger/test/cred.jceks to /etc/ranger/test/.cred.jceks.20210308234031 ...
Ranger Plugin for hadoop has been enabled. Please restart hadoop to ensure that changes are effective.
[root@test02 ranger-hdfs-plugin]#

 

Can someone please redirect me in the right direction so I can add the hdfs plugin to Ranger?

 

Also I tried to manually add the hdfs service to Ranger with the following settings.

 

Service Name *
 test
 
 
Description
 
 
 
Active Status
  • Enabled
 
 

Config Properties :

Username *
 admin
 
 
Password *
 *****
 
 
Namenode URL *
 hdfs://test.domain.com:8020/
 
 
Authorization Enabled
No 
 
 
Authentication Type *
Simple
 
 
hadoop.security.auth_to_local
 DEFAULT
 
 
dfs.datanode.kerberos.principal
 
 
 
dfs.namenode.kerberos.principal
 
 
 
dfs.secondary.namenode.kerberos.principal
 
 
 
RPC Protection Type
Authentication
 
 
Common Name for Certificate
 
 
 
Add New Configurations
Name Value
 
 
 
 
 
After clicking "test connection" it says connection successful, but i still do not see the HDFS service on the ranger UI.
 
Any help is much appreciated.
 
Thanks,