Pig on spark is a very new feature, and it still not part of an official apache release. It is likely to be take more time before it would be widely used in production and reccomended for production use. Pig on tez has been around for sometime and has been used in production many large installations. I would reccomend using that over pig on spark. ... View more

You can also use following command to retrieve the password - sudo java -cp "/usr/hdp/current/ranger-tagsync/lib/*" org.apache.ranger.credentialapi.buildks get javax.jdo.option.connectionpassword -provider jceks://file/etc/hive/conf/conf.server/hive-site.jceks ... View more

"localhost" doesn't work with kerberos authentication, you need the actual hostname in URL. @Jonas Straub can you please edit ? ... View more

Look for "Hortonworks Sandbox Archive" under https://hortonworks.com/downloads/#sandbox and click on "Expand" to find older versions of sandbox. ... View more

User.name would be ignored during kerberos mode. The credentials via kinit is what gets used. ... View more

Running the command with "-verbose" will give more information. Looks like the error is "Specified key was too long; max key length is 1000 bytes" . It seems like you might be using myisam instead of innodb as the engine for some table. You might want to see if suggestions to change type to innodb as mentioned here works for you - http://stackoverflow.com/questions/3489041/mysqlerror-specified-key-was-too-long-max-key-length-is-1000-bytes The tables do explicitly specify innodb engine type, so not sure why you are seeing this issue. Are you on a very old version of mysql ? See supported versions here - https://cwiki.apache.org/confluence/display/Hive/AdminManual+MetastoreAdmin#AdminManualMetastoreAdmin-SupportedBackendDatabasesforMetastore ... View more

I would not reccomend using derby for any production workload. ... View more

Can you please include the stack trace you see ? ... View more

Thanks for sharing. What query is this ? Is this performance of reads or writes ? ... View more

With HDP 2.3.4 and later releases, you don't need to specify any additional options as it includes the changes in HIVE-11581. Just the first URL is sufficient - jdbc:hive2://<zookeeper quorum>/;serviceDiscoveryMode=zooKeeper;zooKeeperNamespace=hiveserver2. See the hiveserver2 client doc Also make sure you have the url within quotes if you are specifying it in commandline. ie, beeline -u 'hive2...' ... View more

Use hive.execution.engine=tez for better performance ... View more

can you paste the full exception stack trace ? ... View more

I am wondering if it could be be cause of Hbase configuration not being available in the HS2 oozie action. ... View more