Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

How to enable pam based authentication in Spark sql ?

Highlighted

How to enable pam based authentication in Spark sql ?

New Contributor

When user is connecting to spark sql using jdbc , password is not prompted.

How to enable pam based authentication to authenticate users connecting spark sql through jdbc(beeline)

We do not have kerberos ,ACL or ranger enabled and cannot use them due to custom software.

beeline -u jdbc:hive2://localhost:10015/default -n hive
Connecting to jdbc:hive2://localhost:10015/default
Connected to: Spark SQL (version 1.6.2)
Driver: Hive JDBC (version 1.2.1000.2.5.0.0-1245)
Transaction isolation: TRANSACTION_REPEATABLE_READ
Beeline version 1.2.1000.2.5.0.0-1245 by Apache Hive

3 REPLIES 3

Re: How to enable pam based authentication in Spark sql ?

Super Guru

I believe if you want to use PAM, it has to go through Knox. Here is the PAM setup guide for HDP

https://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.6.5/bk_security/content/setting_up_pam_authenti...

Re: How to enable pam based authentication in Spark sql ?

New Contributor

@sunile.manjee: The thing is we cannot enable Knox as well due to customized architecture.

We have PAM based authentication for Hive and it works as expected.We want to enable the same for Spark SQL but i cannot find an option for that .

The main security issues is observed when a user tries to connect through spark sql through beeline with just the username and not even password ,they are able to connect .

beeline -u jdbc:hive2://localhost:10015/default -n bob
Connecting to jdbc:hive2://localhost:10015/default
Connected to: Spark SQL (version 1.6.2)
Driver: Hive JDBC (version 1.2.1000.2.5.0.0-1245)
Transaction isolation: TRANSACTION_REPEATABLE_READ
Beeline version 1.2.1000.2.5.0.0-1245 by Apache Hive

Re: How to enable pam based authentication in Spark sql ?

Super Guru

@tauqeer khan I did some further digging. Again you may have to use knox via SSSD.