My understanding is that Sqoop uses Hiverser(CLI), which does not support authorization. Is there anyway to configure Sqoop to use HiverServer2, so it can use Hive Authorization?
Any help would be much appreciated!
Hive authentication using kerberos or simple auth is supported in sqoop2 starting at version 1.99.4:
Nifi can import using hive with authentication using the PutHiveQL or PutHiveStreaming processors:
PutHiveQL specifies the kerberos principals and key tab on the HiveConnectionPool.
PutHiveStreaming sets the security options in the hive-site.xml config file.
Documentation for the Nifi Processors are at:
This is a great question. As @cduby pointed out its not available until sqoop 2. But, if you have to load data into tables using some sort of authorization, you could directly load the data in hdfs, then use beeline to move data into tables with authorization, then you can apply Ranger policies per user and other features. Its a bit of a long way to achieve the results but will get you closer to audit, authorization requirements.