Member since
02-13-2017
9
Posts
2
Kudos Received
0
Solutions
05-24-2017
06:40 PM
As far as the cluster is defined into configs files I do not see why not. and when you put in the location put in hdfs://{Name service on second cluster}/ Also make sure permissions are consistent (ie kerberos realms are trusted) and the staging directory setting points to the location of data
... View more
05-24-2017
06:38 PM
Is this a kerberos enabled cluster? Also did you configure the oozie proxy user? https://oozie.apache.org/docs/3.2.0-incubating/AG_Install.html#User_ProxyUser_Configuration
... View more
05-24-2017
06:31 PM
You can use Ambari API to achieve this. Please review this https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=41812517
... View more
05-24-2017
06:29 PM
1 Kudo
So JDBC ships with Ambari server be default I believe. look into /var/lib/ambari-server/resoruces you will find the JDBC there I believe If not use this page to down the JDBC https://jdbc.postgresql.org/download.html
... View more
05-24-2017
06:25 PM
1 Kudo
It really depends on your job. The default is usually 3 executors (which maps to three containers). Essentially you would have need to be able to fit your working data in memory. Example, if your table is 300 GB a then you would want to be able to fit that table in memory for optimal processing. If you are doing CPU intensive work then do something like 30 containers at 10 GB with 2 vCores. I would suggest you play around and optimize on per job basis
... View more
05-24-2017
06:23 PM
Can you install Ambari agent on those machines? Or any package from your repo
... View more
05-24-2017
06:19 PM
As far as you create a oneway trust between your MIT Kerberos KDC and and your LDAP's Kerberos then you are fine.
... View more
05-24-2017
06:15 PM
Try copying the /etc/krb5.conf to your local so your local machine can see the sandbox's KDC. After that kinit and try it
... View more
05-24-2017
06:10 PM
Can you check if you can SSH from the Ambari Server to the Agents? You might have some DNS issues or it is not able to SSH
... View more