Error: 2016-02-11 08:57:07,482 ERROR [Thread-9]: client.RangerAdminRESTClient (RangerAdminRESTClient.java:getServicePoliciesIfUpdated(81)) - Error getting policies. request=http://phdns01.cloud.hortonworks.com:6080/service/plugins/policies/download/HDPTEST_hive?lastKnownVersion=11&pluginId=hiveServer2@phdns02.cloud.hortonworks.com-HDPTEST_hive, response={"httpStatusCode":400,"statusCode":1,"msgDesc":"Serivce:HDPTEST_hive not found","messageList":[{"name":"DATA_NOT_FOUND","rbKey":"xa.error.data_not_found","message":"Data not found"}]}, serviceName=HDPTEST_hive Issue: Ranger was deleted and delete process ended up causing issues at the database level as shown above. Delete was done using the following command curl --user admin:admin -i -H "X-Requested-By: ambari" -X DELETE http://`hostname -f`:8080/api/v1/clusters/CLUSTERNAME/services/RANGER Now, No Hive repo showed up in Ranger console after adding Ranger and enabling Hive plugin. Fix: As you can seen in the error "HDPTEST_hive" Data Not Found. Disclaimer: Unofficial solution ... View more

The documentation is straight forward BUT based on my experience, we always end up some kind of LDAP error messages. This article is walking through the Hive and LDAP integration. HDP 2.3.4 Ambari 2.2 Security workshop was used to setup the openLDPA Most important: 2016-02-10 08:02:50,705 ERROR [HiveServer2-Handler-Pool: Thread-39]: transport.TSaslTransport (TSaslTransport.java:open(315)) - SASL negotiation failure javax.security.sasl.SaslException: Error validating the login [Caused by javax.security.sasl.AuthenticationException: Error validating LDAP user [Caused by javax.naming.AuthenticationException: [LDAP: error code 32 - No Such Object]]] at org.apache.hive.service.auth.PlainSaslServer.evaluateResponse(PlainSaslServer.java:109) I kept hitting the above error because of wrong baseDN Correct setting: Test: ... View more

Command: curl -s -d execute="select+*+from+nstest;" -d statusdir="1p" 'http://localhost:50111/templeton/v1/hive?user.name=hive' Let's insert some data and test again Wait for job to finish and the directory will show up on HDFS You can monitor the job from RM UI More details: https://cwiki.apache.org/confluence/display/Hive/HiveWebInterface ... View more

Use case: There is lot of data in the locally managed table and we want to convert those table into external table because we are working on a use case where our spark and home grown application has trouble reading locally managed tables. Solution: alter table table_name SET TBLPROPERTIES('EXTERNAL'='TRUE'); Test: Locally managed table dropped hive> drop table sample_07; OK Time taken: 0.602 seconds Data deleted as it's locally managed table. hive> dfs -ls /apps/hive/warehouse/sample_07; ls: `/apps/hive/warehouse/sample_07': No such file or directory Command failed with exit code = 1 Query returned non-zero code: 1, cause: null Converting sample_07_test from locally managed to external to keep the data there after drop. hive> alter table sample_07_test SET TBLPROPERTIES('EXTERNAL'='TRUE'); OK Time taken: 0.463 seconds Table dropped after converting into external table. hive> drop table sample_07_test; OK Time taken: 0.552 seconds Data is still on HDFS hive> dfs -ls /apps/hive/warehouse/sample_07_test; Found 1 items -rwxrwxrwx 3 hive hdfs 46059 2016-02-10 03:24 /apps/hive/warehouse/sample_07_test/000000_0 hive> Table removed from HCatalog hive> select * from sample_07_test; FAILED: SemanticException [Error 10001]: Line 1:14 Table not found 'sample_07_test' hive> ... View more