@Michael Bronson If the host where the IP Addresses are supposed to be changed are running Master components like NameNode, Resource Managers ..Hive Server/Metastore ...etc then it is better to restart the whole service. Regarding Stop and Start all Services present in the cluster i copied the commands from: (not tested recently) But it should work well. https://community.hortonworks.com/questions/88211/rest-api-for-stopping-and-starting-all-services-on.html In order to stop all service using ambari API (On the whole cluster) you can do the following: curl -i -u admin:admin -H "X-Requested-By: ambari" -X PUT -d '{"RequestInfo":{"context":"_PARSE_.STOP.ALL_SERVICES","operation_level":{"level":"CLUSTER","cluster_name":"Sandbox"}},"Body":{"ServiceInfo":{"state":"INSTALLED"}}}' http://localhost:8080/api/v1/clusters/Sandbox/services . In order to start all services you can do the following: curl -i -u admin:admin -H "X-Requested-By: ambari" -X PUT -d '{"RequestInfo":{"context":"_PARSE_.STOP.ALL_SERVICES","operation_level":{"level":"CLUSTER","cluster_name":"Sandbox"}},"Body":{"ServiceInfo":{"state":"STARTED"}}}' http://localhost:8080/api/v1/clusters/Sandbox/services . ... View more

@Michael Bronson Shutdown all services on the node including the Ambari Agent Maintenance Windows is required for such critical operations. >>> This is needed because if some components are already running on that host and they have already opened some ports to a specific IPAddress (interface) then changing the IP Address might cause those services to not function properly. It means if componentA on that host is listening on 162.98.23.5:50070 Or 162.98.23.5:8020 Or 162.98.23.50075 ...etc then i do not think that there is a safe way (without having any data corruption) to tell the components to dynamically switch the IP without a restart. Restarting the components that are running on that host and has opened some ports should be the recommended approach. One quick way to check this may be to find out which components are still using old IPs. Example: # cd /var/log/hadoop/hdfs # grep '162.98.23.5' * I am not aware of any other safe way which can be used to dynamically allow changing the running components IPAddress without restart. ... View more

@Swaapnika Guntaka Yes, that error may occur if the "zookeeper-client" is a Directory instead of Symlink. So in that case you need to do this: # mv /usr/hdp/current/zookeeper-client /usr/hdp/current/zookeeper-client_BAK . Then you can either try creating that symlink on your own Or try instsalling the client again. ... View more

@Mudassar Hussain The Default JDK is usually downloaded and extracted by ambari during the "ambari-server setup" in the following location: /usr/jdk64/jdk1.8.0_112/ [root@hdfcluster1 ~]# ambari-server setup Using python /usr/bin/python Setup ambari-server Checking SELinux... SELinux status is 'enabled' SELinux mode is 'permissive' WARNING: SELinux is set to 'permissive' mode and temporarily disabled. OK to continue [y/n] (y)? Customize user account for ambari-server daemon [y/n] (n)? Adjusting ambari-server permissions and ownership... Checking firewall status... Checking JDK... Do you want to change Oracle JDK [y/n] (n)? y [1] Oracle JDK 1.8 + Java Cryptography Extension (JCE) Policy Files 8 [2] Oracle JDK 1.7 + Java Cryptography Extension (JCE) Policy Files 7 [3] Custom JDK ============================================================================== Enter choice (1): 1 JDK already exists, using /var/lib/ambari-server/resources/jdk-8u112-linux-x64.tar.gz Installing JDK to /usr/jdk64/ . ... View more

@Mudassar Hussain Your latest error is related to JAVA_HOME unavailability on the host. So please make sure if the JDK is installed on the path that is being reported in the Posted Screenshot. THis is because looks like you are using Non Default JDK. (meams ambari is not responsible for it to be installed on all the hosts) so in that case you will need to install the JDK on the exact same path on every host. You will need to check your ambari.properties to see which PATH is set for "java.home" and the same path should exist on all the host (If you are using non default Java). Example: # grep 'java.home' /etc/ambari-server/conf/ambari.properties java.home=/usr/jdk64/jdk1.8.0_112 . Or other option will be to either use default java. For more information on setup JAVA please refer to: https://docs.hortonworks.com/HDPDocuments/Ambari-2.6.1.5/bk_ambari-installation/content/setup_options.html ... View more

@Mudassar Hussain It is always great to keep separate issues as part of different HCC threads that helps us in enhancing the community better with One specific query with one specific answer. Thats also helps HCC users to quickly browser the answer for the question that was asked originally in the query. If any of the previous answer helped in resolving your Original issue then it si better to mark this thread as Close by clicking on the "Acctept" Button on that answer and proceed with new hcc thread for new queries. ... View more

@Michael Bronson Yes, Ambari UI --> Ambari Metrics --> Service Actions --> Restart All Metrics service will cause Ambari Metrics Monitor/ Grafana & Metrics Collector restart. ... View more

@Mudassar Hussain Yes, We can add any Host to the cluster at any point. Either during cluster creation or later at any point. Ambari UI --> Hosts --> New Host: https://docs.hortonworks.com/HDPDocuments/Ambari-2.6.1.5/bk_ambari-operations/content/adding_hosts_to_a_cluster.html ... View more