question Re: Can I use Ranger to set permissions on Spark? in Archives of Support Questions (Read Only)

Can I use Ranger to set permissions on Spark?

menorah84 — Wed, 20 Jul 2016 16:02:03 GMT

I was reading on Ranger's documentation but it looks like that Apache Spark (within a Hadoop-YARN cluster) is not included among the list of supported services. My questions are:

(1) Is it possible to still use Ranger to grant permissions on who can use Spark?

(2) Are there other tools / frameworks / strategies I can employ to secure my Spark cluster?

(3) If Ranger allows it or if there is such a tool / framework / strategy, can I also do fine-grain authorization like database, table, column-level permission for Spark SQL?

Re: Can I use Ranger to set permissions on Spark?

dsharma — Wed, 20 Jul 2016 16:06:58 GMT

currenly ranger does not provide direct support for spark but yes you can configure ranger plugin for bottom layer like hive and hdfs.

Re: Can I use Ranger to set permissions on Spark?

sshimpi — Wed, 20 Jul 2016 16:16:36 GMT

@J. D. Bacolod

As per latest documentation Spark is currently not supported with ranger. There is no spark plugin available for ranger

http://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.4.2/bk_Security_Guide/content/configuring_mysql_for_ranger.html