We can configure Hive View 2.0 to view Ranger Policies associated with any Table. It will not be configured by default (as of HDP 2.6.3) and we need to follow the below steps: 1. Go to Ambari Dasboard -> admin -> Manage Ambari 2. In the Manage Ambari page under Views section, expand Hive and then click on Hive View 2.0 3. Under the setting section, please provide the details as below: - Ranger Service Name: Go to Ranger Admin UI and check the Ranger Service Name which is configured for Hive (shown as below). Here it is tsk_hive - Provide the Ranger Admin username and password as you have configured - WebHDFS Authentication for kerberos enabled cluster: auth=KERBEROS;proxyuser=<proxyuser> Provide the ambari user principal name in place of <proxyuser> 4. After adding the above details, click on "Save". Leave the other settings as default. Additional Steps (only when you are not using local cluster): - If you are using the Local Cluster, then it is not required to change any parameters in "cluster configuration" section. - If you are using custom settings, then please provide the details as below: Once you provide the details, follow the below steps: 5. Go to Hive View 2.0 -> Tables -> click on the Table for which you want to view the Ranger Policies 6. Then click on "Authorization" Tab to view the Ranger Policies as below: ... View more

Beeline is a JDBC client tool which is used to connect to HiveServer2 or HiveServer2Interactive(LLAP). Beeline, which connects to HiveServer2 and requires access to only one .jar file: hive-jdbc-<version>-standalone.jar Hortonworks recommends using HiveServer2 and a JDBC client (such as Beeline) as the primary way to access Hive. This approach uses SQL standard-based authorization or Ranger-based authorization. However, some users may wish to access Hive data from other applications, such as Pig. For these use cases, use the Hive CLI and storage-based authorization. Connecting to Hive with Beeline The following examples demonstrate how to use Beeline to connect to Hive for all possible variations of these modes. Embedded Client Use the following syntax to connect to Hive from Beeline in embedded mode: !connect jdbc:hive2:// Remote Client with HiveServer2 TCP Transport Mode and SASL Authentication Use the following syntax to connect to HiveServer2 in TCP mode from a remote Beeline client: !connect jdbc:hive2://<hiveserver2host>:<port>/<db> The default port for HiveServer2 in TCP mode is 10000 , and db is the name of the database to which you want to connect. Connecting to HiveServer2 using Zookeeper Discovery Mode Note: You can also find the below HiveServer2 JDBC URL from Ambari from Hive -> Summary page. To copy the JDBC URL, you can use the copy to clipboard icon next to the URL Observe the / after the <ZOOKEEPER QUORUM> in each string below - HiveServer2 using Binary Transport Mode: jdbc:hive2://<ZOOKEEPER QUORUM>/;serviceDiscoveryMode=zooKeeper;zooKeeperNamespace=hiveserver2HiveServer2 - HiveServer2 using HTTP Transport Mode: jdbc:hive2://<ZOOKEEPER QUORUM>/;serviceDiscoveryMode=zooKeeper;zooKeeperNamespace=hiveserver2;transportMode=http;httpPath=cliservice Connection String for connection to HiveServer2Interactive Look for zooKeeperNamespace=hiveserver2-hive2 in the below URL jdbc:hive2://<ZOOKEEPER QUORUM>/;serviceDiscoveryMode=zooKeeper;zooKeeperNamespace=hiveserver2-hive2 For running Hive Scripts using Beeline, you can make use of -f option in Beeline. beeline -u "jdbc:hive2://master01:2181,master02:2181,master03:2181/;serviceDiscoveryMode=zooKeeper;zooKeeperNamespace=hiveserver2" -f file.hql Reference article: https://cwiki.apache.org/confluence/display/Hive/HiveServer2+Clients Please refer above article for Beeline command options and examples for getting started with Beeline. ... View more

From https://cwiki.apache.org/confluence/display/Hive/LanguageManual+UDF I found the below, but want some more details: collect_list(col) Returns a list of objects with duplicates ... View more