Hi, I believe it is a bridge as according to this page. I have installed the Atlas Hook for Kafka following the below instructions on HDP 3.1.0: https://community.hortonworks.com/content/supportkb/246715/how-to-setup-apache-atlas-hook-for-apache-kafka-on.html If it is a bridge then we will need to run the script import-kafka.sh periodically to update Atlas as changes such as topic creation will not automatically flow through. Thanks Paul ... View more

Hi, Does anyone know whether Hive will partition prune when a partitioned table appears in a left outer join such as below: SELECT * FROM tab a LEFT OUTER JOIN partitoned_tab b ON a.col_1 = b.col_1 AND a.partition_col = b.partition_col It only appears to partition prune as indicated by Dynamic Partitioning Event Operator in the explain plan when joins are inner. Thanks, Paul ... View more

Hi, We have started using HDP 3.0 and we are connecting to hive through beeline but we are encountering concurrency issues. All sessions are using the hive user to connect and we are finding that when a second session tries to execute a query it remains in a pending status until the second session is closed. Any ideas where to start looking to determine why two or more sessions using the same user cannot execute queries simultaneously? Here is the configuration details of our HDP 3.0 cluster: Number of nodes 5 (2 master, 3 data) 16GB memory on each node 12GB memory for YARN containers per data node Maximum container size memory is set to 12GB to satisfy Hive LLAP requirements Maximum container size vcores is set to 3 Thanks Paul ... View more