Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Why is LLAP needed to enable row level security on SparkThriftServer or Spark SQL through Ranger

Why is LLAP needed to enable row level security on SparkThriftServer or Spark SQL through Ranger

New Contributor

If Ranger is doing query re-writes why does it need LLAP. Why isn't Spark + HDFS sufficient for the query filtering?

3 REPLIES 3

Re: Why is LLAP needed to enable row level security on SparkThriftServer or Spark SQL through Ranger

Contributor

Re: Why is LLAP needed to enable row level security on SparkThriftServer or Spark SQL through Ranger

New Contributor

@Rishi

I read this article before, but the filtering and projection is already provided by Spark execution engine over HDFS. Why do we need LLAP in the middle only in context of row level security. (Note: I am not talking about performance benefits of LLAP in general here).

How about this?

USer submits query -> Ranger authorizes and modifies the query filters/projections-> the new query gets executed as normal Saprk SQL of HDFS (with no need of LLAP)

Highlighted

Re: Why is LLAP needed to enable row level security on SparkThriftServer or Spark SQL through Ranger

New Contributor

I read this article before, but the filtering and projection is already provided by Spark execution engine over HDFS. Why do we need LLAP in the middle only in context of row level security. (Note: I am not talking about performance benefits of LLAP in general here).

How about this?

USer submits query -> Ranger authorizes and modifies the query filters/projections-> the new query gets executed as normal Saprk SQL of HDFS (with no need of LLAP)

Don't have an account?
Coming from Hortonworks? Activate your account here