Created 07-18-2018 04:04 PM
When user is connecting to spark sql using jdbc , password is not prompted.
How to enable pam based authentication to authenticate users connecting spark sql through jdbc(beeline)
We do not have kerberos ,ACL or ranger enabled and cannot use them due to custom software.
beeline -u jdbc:hive2://localhost:10015/default -n hive
Connecting to jdbc:hive2://localhost:10015/default
Connected to: Spark SQL (version 1.6.2)
Driver: Hive JDBC (version 1.2.1000.2.5.0.0-1245)
Transaction isolation: TRANSACTION_REPEATABLE_READ
Beeline version 1.2.1000.2.5.0.0-1245 by Apache Hive
Created 07-19-2018 04:11 AM
I believe if you want to use PAM, it has to go through Knox. Here is the PAM setup guide for HDP
Created 07-19-2018 11:47 AM
@sunile.manjee: The thing is we cannot enable Knox as well due to customized architecture.
We have PAM based authentication for Hive and it works as expected.We want to enable the same for Spark SQL but i cannot find an option for that .
The main security issues is observed when a user tries to connect through spark sql through beeline with just the username and not even password ,they are able to connect .
beeline -u jdbc:hive2://localhost:10015/default -n bob
Connecting to jdbc:hive2://localhost:10015/default
Connected to: Spark SQL (version 1.6.2)
Driver: Hive JDBC (version 1.2.1000.2.5.0.0-1245)
Transaction isolation: TRANSACTION_REPEATABLE_READ
Beeline version 1.2.1000.2.5.0.0-1245 by Apache Hive
Created 08-09-2018 04:15 AM
@tauqeer khan I did some further digging. Again you may have to use knox via SSSD.