I have written ambari-admin utility to simplify efforts required to find and trigger API curl call. I'm planning to add many more features than ambari-shell. Currently below features are supported. Demo on multinode cluster: 1. Clone our github repo to your local machine or any of the node in your cluster.
[root@sme-ambari-server ~]# git clone https://github.com/crazyadmins/useful-scripts.git
Initialized empty Git repository in /root/useful-scripts/.git/
remote: Counting objects: 106, done.
remote: Total 106 (delta 0), reused 0 (delta 0), pack-reused 106
Receiving objects: 100% (106/106), 16.89 KiB, done.
Resolving deltas: 100% (37/37), done.
2. Goto useful-scripts/ambari/
[root@sme-ambari-server ~]# cd useful-scripts/ambari/
3. Edit ambari.props and modify value of below parameters as per your cluster environment
[root@sme-ambari-server ambari]# cat ambari.props
CLUSTER_NAME=sme
AMBARI_ADMIN_USER=admin
AMBARI_ADMIN_PASSWORD=admin
AMBARI_HOST=sme-ambari-server.hwxblr.com
KDC_HOST=sme-ambari-server.hwxblr.com
REALM=HWX.COM
KERBEROS_CLIENTS=sme-ambari-server.hwxblr.com,kknew1.hwxblr.com,kknew2.hwxblr.com,kknew3.hwxblr.com
##### Notes #####
#1. KERBEROS_CLIENTS - Comma separated list of Kerberos clients in case of multinode cluster
#2. Admin princial is admin/admin and password is hadoop
Note - You can ignore Kerberos related parameters for now, in future this script will have functionality to setup Kerberos. 4. To print usage you can run ambari-admin.sh without any argument
Please refer first screenshot provided at the beginning of this article. 5. Stop All services
[root@sme-ambari-server ambari]# ./ambari-admin.sh stopall
HTTP/1.1 202 Accepted
X-Frame-Options: DENY
X-XSS-Protection: 1; mode=block
User: admin
Set-Cookie: AMBARISESSIONID=14oisfe8i5bclm8tdk3npm390;Path=/;HttpOnly
Expires: Thu, 01 Jan 1970 00:00:00 GMT
Content-Type: text/plain
Vary: Accept-Encoding, User-Agent
Content-Length: 152
Server: Jetty(8.1.17.v20150415)
{
"href" : "http://sme-ambari-server.hwxblr.com:8080/api/v1/clusters/sme/requests/61",
"Requests" : {
"id" : 61,
"status" : "Accepted"
}
6. Start all the services
[root@sme-ambari-server ambari]# ./ambari-admin.sh startall
HTTP/1.1 202 Accepted
X-Frame-Options: DENY
X-XSS-Protection: 1; mode=block
User: admin
Set-Cookie: AMBARISESSIONID=1lo2x6u1r5xq319suwh8xiiquw;Path=/;HttpOnly
Expires: Thu, 01 Jan 1970 00:00:00 GMT
Content-Type: text/plain
Vary: Accept-Encoding, User-Agent
Content-Length: 152
Server: Jetty(8.1.17.v20150415)
{
"href" : "http://sme-ambari-server.hwxblr.com:8080/api/v1/clusters/sme/requests/62",
"Requests" : {
"id" : 62,
"status" : "Accepted"
}
7. Get list of all services installed in your cluster, script also shows list of installed components host_wise
[root@sme-ambari-server ambari]# ./ambari-admin.sh listall
Below is the list of installed services in your cluster:
HDFS
MAPREDUCE2
SMARTSENSE
TEZ
YARN
ZOOKEEPER
########################### List of Host-wise installed components ###########################
kknew1.hwxblr.com
"component_name" | "DATANODE"
"component_name" | "HDFS_CLIENT"
"component_name" | "HST_AGENT"
"component_name" | "HST_SERVER"
"component_name" | "MAPREDUCE2_CLIENT"
"component_name" | "NAMENODE"
"component_name" | "NODEMANAGER"
"component_name" | "YARN_CLIENT"
"component_name" | "ZOOKEEPER_CLIENT"
kknew2.hwxblr.com
"component_name" | "DATANODE"
"component_name" | "HDFS_CLIENT"
"component_name" | "HST_AGENT"
"component_name" | "MAPREDUCE2_CLIENT"
"component_name" | "NODEMANAGER"
"component_name" | "SECONDARY_NAMENODE"
"component_name" | "YARN_CLIENT"
"component_name" | "ZOOKEEPER_CLIENT"
"component_name" | "ZOOKEEPER_SERVER"
kknew3.hwxblr.com
"component_name" | "APP_TIMELINE_SERVER"
"component_name" | "DATANODE"
"component_name" | "HDFS_CLIENT"
"component_name" | "HISTORYSERVER"
"component_name" | "HST_AGENT"
"component_name" | "MAPREDUCE2_CLIENT"
"component_name" | "NODEMANAGER"
"component_name" | "RESOURCEMANAGER"
"component_name" | "TEZ_CLIENT"
"component_name" | "YARN_CLIENT"
"component_name" | "ZOOKEEPER_CLIENT"
"component_name" | "ZOOKEEPER_SERVER"
sme-ambari-server.hwxblr.com
"component_name" | "HDFS_CLIENT"
"component_name" | "HST_AGENT"
"component_name" | "MAPREDUCE2_CLIENT"
"component_name" | "TEZ_CLIENT"
"component_name" | "YARN_CLIENT"
"component_name" | "ZOOKEEPER_CLIENT"
8. Stop individual service
[root@sme-ambari-server ambari]# ./ambari-admin.sh stop yarn
HTTP/1.1 202 Accepted
X-Frame-Options: DENY
X-XSS-Protection: 1; mode=block
User: admin
Set-Cookie: AMBARISESSIONID=10tyime2kd7pr1e0o4t8gwg2jv;Path=/;HttpOnly
Expires: Thu, 01 Jan 1970 00:00:00 GMT
Content-Type: text/plain
Vary: Accept-Encoding, User-Agent
Content-Length: 152
Server: Jetty(8.1.17.v20150415)
{
"href" : "http://sme-ambari-server.hwxblr.com:8080/api/v1/clusters/sme/requests/63",
"Requests" : {
"id" : 63,
"status" : "Accepted"
}
}
9. Start Individual service
[root@sme-ambari-server ambari]# ./ambari-admin.sh start yarn
HTTP/1.1 202 Accepted
X-Frame-Options: DENY
X-XSS-Protection: 1; mode=block
User: admin
Set-Cookie: AMBARISESSIONID=a7wdqn56clk8176d99rm20hz5;Path=/;HttpOnly
Expires: Thu, 01 Jan 1970 00:00:00 GMT
Content-Type: text/plain
Vary: Accept-Encoding, User-Agent
Content-Length: 152
Server: Jetty(8.1.17.v20150415)
{
"href" : "http://sme-ambari-server.hwxblr.com:8080/api/v1/clusters/sme/requests/64",
"Requests" : {
"id" : 64,
"status" : "Accepted"
}
}
10. Stop Individual service component
[root@sme-ambari-server ambari]# ./ambari-admin.sh stop hst_agent kknew2.hwxblr.com
HTTP/1.1 202 Accepted
X-Frame-Options: DENY
X-XSS-Protection: 1; mode=block
User: admin
Set-Cookie: AMBARISESSIONID=vrmnhicrgog42lmu7exfqdm4;Path=/;HttpOnly
Expires: Thu, 01 Jan 1970 00:00:00 GMT
Content-Type: text/plain
Vary: Accept-Encoding, User-Agent
Content-Length: 152
Server: Jetty(8.1.17.v20150415)
{
"href" : "http://sme-ambari-server.hwxblr.com:8080/api/v1/clusters/sme/requests/65",
"Requests" : {
"id" : 65,
"status" : "Accepted"
}
}
11. Start Individual service component
[root@sme-ambari-server ambari]# ./ambari-admin.sh start hst_agent kknew2.hwxblr.com
HTTP/1.1 202 Accepted
X-Frame-Options: DENY
X-XSS-Protection: 1; mode=block
User: admin
Set-Cookie: AMBARISESSIONID=1fqqp5vqpourgjll9ydnyev3e;Path=/;HttpOnly
Expires: Thu, 01 Jan 1970 00:00:00 GMT
Content-Type: text/plain
Vary: Accept-Encoding, User-Agent
Content-Length: 152
Server: Jetty(8.1.17.v20150415)
{
"href" : "http://sme-ambari-server.hwxblr.com:8080/api/v1/clusters/sme/requests/66",
"Requests" : {
"id" : 66,
"status" : "Accepted"
}
}
12. Remove any Hadoop client from any of the host
[root@sme-ambari-server ambari]# ./ambari-admin.sh remove tez_client kknew3.hwxblr.com
13. Add any Hadoop client on any of the host
[root@sme-ambari-server ambari]# ./ambari-admin.sh add tez_client kknew3.hwxblr.com
HTTP/1.1 201 Created
X-Frame-Options: DENY
X-XSS-Protection: 1; mode=block
User: admin
Set-Cookie: AMBARISESSIONID=pl31hyai9aqt1eyeaj5ehe9i;Path=/;HttpOnly
Expires: Thu, 01 Jan 1970 00:00:00 GMT
Content-Type: text/plain
Content-Length: 0
Server: Jetty(8.1.17.v20150415)
HTTP/1.1 202 Accepted
X-Frame-Options: DENY
X-XSS-Protection: 1; mode=block
User: admin
Set-Cookie: AMBARISESSIONID=18tzs8uctj2061pmjegp129aqz;Path=/;HttpOnly
Expires: Thu, 01 Jan 1970 00:00:00 GMT
Content-Type: text/plain
Vary: Accept-Encoding, User-Agent
Content-Length: 152
Server: Jetty(8.1.17.v20150415)
{
"href" : "http://sme-ambari-server.hwxblr.com:8080/api/v1/clusters/sme/requests/67",
"Requests" : {
"id" : 67,
"status" : "Accepted"
}
}
Sleeping for 5 seconds before starting TEZ_CLIENT
HTTP/1.1 200 OK
X-Frame-Options: DENY
X-XSS-Protection: 1; mode=block
User: admin
Set-Cookie: AMBARISESSIONID=1bh3u5foki8vh1fgg240i49h6x;Path=/;HttpOnly
Expires: Thu, 01 Jan 1970 00:00:00 GMT
Content-Type: text/plain
Content-Length: 0
Server: Jetty(8.1.17.v20150415)
14. Backup database for Hive/Oozie/Ambari
Note - Please enter your database password, for e.g. in this demo I have entered default password('bigdata') for Ambari postgresql DB.
[root@sme-ambari-server ambari]# ./ambari-admin.sh backup ambari postgresql sme-ambari-server.hwxblr.com
Password:
[root@sme-ambari-server ambari]# ls -lrt ~/ambari_db_backup_2016_05_22_11_32.sql
-rw-r--r-- 1 root root 6812385 May 22 11:33 /root/ambari_db_backup_2016_05_22_11_32.sql
[root@sme-ambari-server ambari]# date
Sun May 22 11:33:20 UTC 2016
[root@sme-ambari-server ambari]#
Note - I'm planning to add below features to this script, please feel to provide your feedback on this 🙂 Please feel free to suggest if you would like to have any more features! Stay Tuned for Part-2 Happy Hadooping!! 🙂
... View more
