Yes, check out http://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.3.0/bk_yarn_resource_mgt/content/configuring_node_labels.html ... View more

From the code it looks like ColumnPruner is always applied by optimizer and there is no way to exclude it after HIVE-4113. It would be good to get more details on the scenario where you ran into this. Have you tried this query with Hive v0.14 or later? ... View more

For that you will need to get access to javax.security.auth.kerberos.KerberosTicket, the class in Hadoop UesrGroupInformation provides API to manage that, however the closest method to deal with expirations is checkTGTAndReloginFromKeytab which is likely not what you want. ... View more

The trick will be to manage separate hive configs for each HiveServer2 instance. You will need to use different values for authentication properties and the port on which to start. ... View more

One way you can achieve the transformation of your CSV data to ORC would be to do the following: 1. Register your CSV GZ data as a text table, something like: create table <tablename>_txt (...) location '...'; 2. Create equivalent ORC table create table <tablename>_orc (...) stored as orc; 3. Populate the data into equivalent ORC table insert overwrite table <tablename>_orc select * from <tablename>_txt; I have used this in the past and worked for me. ... View more

You can delete Hive tables by calling "drop table <tablename> purge;", this will skip the trash. If this is for testing purposes you can temporarily set fs.trash.interval to 0 and restart namenode. This will globally disable trash collection on HDFS so should only be employed during testing. On your last question about the support of TDE feature, it was available starting HDP 2.3. ... View more