We've been using the Tez Persistent Queues (Interactive Query Tuning) to optimize Tez Queue performance. Separately we now have Capacity Scheduler "Fair Sharing" policies, which allows separate jobs on the same queue to execute with evenly shared resources. How should we reconcile the two for optimal Hive configuration? E.g. should we configure Persistent queues when queries are submitted as one user "Hive" and use Fair Sharing policies if the job is submitted by a variety of users? Any guidance on whether or not we should use the two in combination will help. ... View more

Is there a way I can configure nifi, not to pull same files over? It appears to pull the same files more than once if some files in the directory were modified. I.e. could you explain the full algorithm behavior on how GetSFTP tracks which files it has downloaded? And how does this behave in case NiFi process or the server restarts? ... View more

In your opinion, what is the best consolidated resource for performance tuning an HBase instance? Are the HBase guides the best reference we have for performance tuning or are there others which are more comprehensive? http://hbase.apache.org/book.html#performance http://hbase.apache.org/book.html#important_configurations ... View more

Which tools do you see as most popular for customers who wish to manage large number of NiFi worker/slave instances across many separate servers? E.g. do you see people using Puppet, pdcp, or other tools? ... View more

Customer would like to know if they are able to switch the keys which are stored in the KMS without re-encrypting HDFS data? I believe this may also be referred to as the EEK (Encrypted Encryption Key)? Documentation here ... View more

Atlas UI allows us to search for entities with SQL like syntax, for example 'table where name = "sales_fact"'. Is this SQL framework based on any existing libraries within Gremlin? Or was this custom built for Atlas? Trying to understand if there is documentation on the proper SQL syntax for these searches? Doc Reference: http://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.3.2/bk_data_governance/content/section_metadata_store_mgmt_with_atlas_ui.html ... View more