Member since
09-24-2015
816
Posts
488
Kudos Received
189
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
2663 | 12-25-2018 10:42 PM | |
12195 | 10-09-2018 03:52 AM | |
4200 | 02-23-2018 11:46 PM | |
1888 | 09-02-2017 01:49 AM | |
2208 | 06-21-2017 12:06 AM |
02-10-2017
01:05 PM
Here are steps to move SHS from one node to another. Replace admin:admpw with your user-name:password. Run on the Ambari server, or replace localhost with your Ambari server FQDN. Replace "mycluster" with your cluster name. Replace host2.example.com with your target node FQDN. Delete SHS component (it looks like you already did this so you can skip this step) $ curl -i -H "X-Requested-By:ambari" -u admin:admpw -X DELETE http://localhost:8080/api/v1/clusters/mycluster/services/SPARK/components/SPARK_JOBHISTORYSERVER Add SHS again $ curl -i -H "X-Requested-By:ambari" -u admin:admpw -X POST http://localhost:8080/api/v1/clusters/mycluster/services/SPARK/components/SPARK_JOBHISTORYSERVER Install host component on the new node: host2.example.com $ curl -i -u admin:admpw -H "X-Requested-By:ambari" -i -X POST -d '{"host_components" : [{"HostRoles":{"component_name":"SPARK_JOBHISTORYSERVER"}}] }'
http://localhost:8080/api/v1/clusters/mycluster/hosts?Hosts/host_name=host2.example.com In Ambari, Hosts --> host2.example.com, click on Spark History Server, and then "Reinstall" button In Ambari-->Spark, start Spark service, and run Spark service check
... View more
02-10-2017
10:14 AM
1 Kudo
Yes, you can combine services on the same master, including HA instances and search apps. You just try to distribute them so that all 3 masters are about equally busy. Here is one layout: M1: Ambari, AMS Collector, Hue, Oozie M2: NN1, RM1, ATS, Spark History Server, Spark Thrift Server, SOLR M3: NN2, RM2, MR2 JHS, Hive HS2 + Metastore + DB, ES with Zookeepers and Journal nodes on all 3 masters. If you want to test SOLR and ES extensively you may wish to place them on the 4th master. If you want to add more services (HBase, Falcon, Atlas), just distribute their master components on available masters.
... View more
02-10-2017
04:03 AM
The "historical period" or TTL of Yarn logs is controlled by yarn.timeline-service.ttl-enable, and if "true", then by yarn.timeline-service.ttl-ms. By default it's enabled and TTL is 31 days.
... View more
02-09-2017
06:30 AM
2 Kudos
The newer the version of Ambari, the more "Move" options you have. For example, in latest Ambari-2.4.2 you can move using Ambari: NN, RM, ATS, MR2 History server, Hive HS2, Metastore, WebHCat, MySql server, Oozie server, AMS Collector. To move a Journal node search for an article on HCC. To move a Zookeeper node, add a new one to the target node, then delete the one on the source node. Also, in the latest Ambari, you can consider moving a non-supported component, like Falcon or Atlas, by deleting a service, and installing it again on the target node. This might have some negative side-effects, so be sure you understand what's going on.
... View more
02-08-2017
08:27 AM
Oh, great! That worked, I used "ambari-server setup-security" and opted not to persist the master-key. Thanks!
... View more
02-08-2017
08:05 AM
That's authentication.ldap.managerPassword in /etc/ambari-server/ambari.properties. After running "ambari-server setup-ldap" it's stored as plain text in /etc/ambari-server/conf/ldap-password.dat. The best I can do is to change the file's ACL to 600, but I'd like to hide it.
... View more
Labels:
- Labels:
-
Apache Ambari
02-08-2017
06:58 AM
1 Kudo
It looks like your app cannot locate HBase master and/or Region Servers, meaning that you haven't provided HBase configuration. Here are some examples how to do that.
... View more
02-07-2017
10:59 PM
Try "yarn application -list" to get a list of all Yarn apps, followed by "yarn logs -applicationId" to get logs for a particular app. You can find details about these and other yarn commands here.
... View more
02-07-2017
10:54 PM
Maybe you try troubleshooting your Job History server instead. It's not supposed to be down. A busy Job History server requires a reasonable amount of memory, like 8G or more.
... View more