For enabling the SQL Std Auth manually you would need to set the following settings in the hive-site.xml before restarting the HiveServer2. hive.server2.enable.doAs=false hive.security.authorization.enabled=true hive.security.authorization.manager=org.apache.hadoop.hive.ql.security.authorization.plugin.sqlstd.SQLStdHiveAuthorizerFactory hive.security.authenticator.manager=org.apache.hadoop.hive.ql.security.SessionStateUserAuthenticator hive.users.in.admin.role=<admin user> In the above <admin user> would be replaced by the user you want as admin. Note that you can perform admin operations after you connect to your beeline session as the admin user and then run the following command: set role ADMIN; For an Ambari controlled cluster recommendation would be to enable it through toggle on the Hive configs page. ... View more

@John Smith I edited the answer to format the code. ... View more

I got the same issue in hortonworks sandbox environment. Script was correct but was throwing this error Unable to open iterator foralias I found Jobhistory server was not working by default. I could not relate the connection between the two but after starting histoyserver , my pig script worked in both tez and mapreduce mode. Try it if it works for yoou as well. [mapred@sandbox ~]$ cd /usr/hdp/current/hadoop-mapreduce-historyserver/sbin [mapred@sandbox sbin]$ ls mr-jobhistory-daemon.sh [mapred@sandbox sbin]$ mr-jobhistory-daemon.sh start historyserver ... View more

@John Smith really great job, I was not aware of 2nd AvroStorage package. @Predrag Minovic @Benjamin Leonhardi you might find this of use? ... View more

excellent, just FYI, marking your own answer as best will not earn you points. ... View more

@John Smith correct, you can override the output with multipleoutputs and define path as you wish in Java. In Pig it is not possible, perhaps you'd like to open an enhancement Jira? To store results into normal FS, you need to launch the script in local mode or specify full path file:///path. Vice versa for Tez/MR mode, then you specify hdfs:// in local mode for hdfs FS. ... View more