Support Questions

Find answers, ask questions, and share your expertise
Announcements
Celebrating as our community reaches 100,000 members! Thank you!

Ranger Dynamic query rewrite available for hive?

avatar
Master Guru

Is dynamic query rewrite avialable for hive as it is In HDP 2.5 dynamic query rewrite via Ranger for SparkSQL?

1 ACCEPTED SOLUTION

avatar

@Sunile Manjee Answer is Yes. In HDP 2.5 Spark Column Security is available with LLAP and Ranger integration

You get Fine-Grained Column Level Access Control for SparkSQL. Fully dynamic policies per user. Doesn’t require views. Use Standard Ranger policies and tools to control access and masking policies.

Flow:

1.SparkSQL gets data locations known as “splits” from HiveServer and plans query.

2.HiveServer2 authorizes access using Ranger. Per-user policies like row filtering are applied.

3.Spark gets a modified query plan based on dynamic security policy.

4.Spark reads data from LLAP. Filtering / masking guaranteed by LLAP server.

9450-screen-shot-2016-11-15-at-105644-am.png

9449-screen-shot-2016-11-15-at-105545-am.png

View solution in original post

2 REPLIES 2

avatar

Ranger supports row-level filtering for Hive in 2.5, and accomplishes this by dynamically rewriting the query. I believe LLAP is a dependency for row-level filtering in SparkSQL.

avatar

@Sunile Manjee Answer is Yes. In HDP 2.5 Spark Column Security is available with LLAP and Ranger integration

You get Fine-Grained Column Level Access Control for SparkSQL. Fully dynamic policies per user. Doesn’t require views. Use Standard Ranger policies and tools to control access and masking policies.

Flow:

1.SparkSQL gets data locations known as “splits” from HiveServer and plans query.

2.HiveServer2 authorizes access using Ranger. Per-user policies like row filtering are applied.

3.Spark gets a modified query plan based on dynamic security policy.

4.Spark reads data from LLAP. Filtering / masking guaranteed by LLAP server.

9450-screen-shot-2016-11-15-at-105644-am.png

9449-screen-shot-2016-11-15-at-105545-am.png