REFRESH the table only when I add new data through HIVE or HDFS commands ? That is when I am doing insert into ...through impala-shell no need for refreshing ? Correct. INVALIDATE METADATA  of the table only when I change the structure of the table (add columns, drop partitions) through HIVE?  Correct. Or creating new tables through Hive. DROPping partitions of a table through impala-shell (i.e alter table  .. drop partition .. purge).  Do I have to do REFRESH or INVALIDATE METADATA? No. DROPping partitions of a table through impala-shell . How can I compute the new stats of the partitioned table?  Compute incremental stats OR Drop Incremental stats before dropping partition ? The next time you run an incremental stats for a new partition Impala will update things correctly (e.g. the global row count) ... View more

Hi, @nanda_bigdata ,   In addition, could you please also check the following: In CM > Hive > Configuration, ensure that the HBase Service property is set to the existing HBase service In CM > HBase > Instances, ensure you have Gateway roles assigned to all the hosts in your cluster. If not, add them. Restart the necessary services and deploy client configuration if you make any changes above and try agian.   André ... View more

This configuration does work. It's an unusual and odd solution, though. If you are concerned enough with your data to enable TLS for HiveServer2, you should also enable TLS for Impala. Otherwise, your Hive data would still be exposed over the network when clients connect with Impala to run queries.   Regards, André ... View more

Hi, LeoFernandes,   There's no JMX in NiFi. However, you can either use NiFi Reporting Tasks or use the NiFi API (https://nifi.apache.org/docs/nifi-docs/rest-api/index.html) if you want some custom monitoring.   André ... View more