Member since
10-24-2016
11
Posts
1
Kudos Received
0
Solutions
04-28-2017
05:10 PM
7 Kudos
Looks like the data was removed from hdfs but no drop partition query was executed on hive side. The data being displayed from 'show partitions <table_name>' command retrieves data from hive metastore db, which has the information on table partition but not the real data, which is stored in hdfs. About the data missing from hdfs, it might be worth checking the hdfs-audit.log to trace the lifecycle of the directory/file
... View more
11-22-2016
03:58 AM
Go to ranger UI. the link is found by going to ambari, then to ranger, and click on quick links. that will give you ranger ui. go to hive. check the user policy to determine if there are any policies give you access to UDF. Another quick way to check if you have ranger enabled is by going to ranger config via ambari and determine if hive plugin is enabled.
... View more
10-24-2016
01:55 PM
Some of these properties are a little bit mis-leading and were renamed in 1.0 to make it clearer: https://nifi.apache.org/docs/nifi-docs/html/administration-guide.html#kerberos_properties I think if you are calling an external script you would need to handle renewing the kerberos tickets yourself. You could just setup a GenerateFlowFile on a timer schedule that went to an ExecuteStreamCommand and just did a kinit every couple of hours.
... View more