As far as the cluster is defined into configs files I do not see why not. and when you put in the location put in hdfs://{Name service on second cluster}/ Also make sure permissions are consistent (ie kerberos realms are trusted) and the staging directory setting points to the location of data ... View more

You can use Ambari API to achieve this. Please review this https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=41812517 ... View more

It really depends on your job. The default is usually 3 executors (which maps to three containers). Essentially you would have need to be able to fit your working data in memory. Example, if your table is 300 GB a then you would want to be able to fit that table in memory for optimal processing. If you are doing CPU intensive work then do something like 30 containers at 10 GB with 2 vCores. I would suggest you play around and optimize on per job basis ... View more

As far as you create a oneway trust between your MIT Kerberos KDC and and your LDAP's Kerberos then you are fine. ... View more

Try copying the /etc/krb5.conf to your local so your local machine can see the sandbox's KDC. After that kinit and try it ... View more