Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Why is LLAP needed to enable row level security on SparkThriftServer or Spark SQL through Ranger

Highlighted

Why is LLAP needed to enable row level security on SparkThriftServer or Spark SQL through Ranger

New Contributor

If Ranger is doing query re-writes why does it need LLAP. Why isn't Spark + HDFS sufficient for the query filtering?

4 REPLIES 4
Highlighted

Re: Why is LLAP needed to enable row level security on SparkThriftServer or Spark SQL through Ranger

Contributor

Re: Why is LLAP needed to enable row level security on SparkThriftServer or Spark SQL through Ranger

New Contributor

@Rishi

I read this article before, but the filtering and projection is already provided by Spark execution engine over HDFS. Why do we need LLAP in the middle only in context of row level security. (Note: I am not talking about performance benefits of LLAP in general here).

How about this?

USer submits query -> Ranger authorizes and modifies the query filters/projections-> the new query gets executed as normal Saprk SQL of HDFS (with no need of LLAP)

Highlighted

Re: Why is LLAP needed to enable row level security on SparkThriftServer or Spark SQL through Ranger

New Contributor

I read this article before, but the filtering and projection is already provided by Spark execution engine over HDFS. Why do we need LLAP in the middle only in context of row level security. (Note: I am not talking about performance benefits of LLAP in general here).

How about this?

USer submits query -> Ranger authorizes and modifies the query filters/projections-> the new query gets executed as normal Saprk SQL of HDFS (with no need of LLAP)

Highlighted

Re: Why is LLAP needed to enable row level security on SparkThriftServer or Spark SQL through Ranger

New Contributor

Indeed there is no need of using LLAP.

 

You could use this library for achieving what you are requesting without LLAP:

 

https://github.com/apache/submarine/tree/master/submarine-security/spark-security

 

It works between Spark and Ranger.

 

 

Don't have an account?
Coming from Hortonworks? Activate your account here