@Michael Bronson Something like this you can try: # curl -u admin:admin -H 'X-Requested-By: ambari' -X GET "http://hdfcluster1.example.com:8080/api/v1/clusters/TestCluster?fields=hosts/Hosts/host_name,hosts/Hosts/host_state" | grep -B1 host_state . OR # curl -u admin:admin -H 'X-Requested-By: ambari' -X GET "http://hdfcluster1.example.com:8080/api/v1/clusters/TestCluster?fields=hosts/Hosts/host_name,hosts/Hosts/host_state" | grep -B1 HEARTBEAT_LOST OUTPUT ------- "host_name" : "hdfcluster4.example.com", "host_state" : "HEARTBEAT_LOST" . For healthy nodes we can grep like: # curl -u admin:admin -H 'X-Requested-By: ambari' -X GET "http://hdfcluster1.example.com:8080/api/v1/clusters/TestCluster?fields=hosts/Hosts/host_name,hosts/Hosts/host_state" | grep -B1 HEALTHY OUTPUT ------- "host_name" : "hdfcluster1.example.com", "host_state" : "HEALTHY" -- "host_name" : "hdfcluster2.example.com", "host_state" : "HEALTHY" -- "host_name" : "hdfcluster3.example.com", "host_state" : "HEALTHY" . ... View more

@Michael Bronson I see 4 messages in your Initial Issue description. Message-1). Verify Cluster Components Exist In Target Repository This kind of message can appear while starting upgrades if we have installed some custom services to our cluster which are not part of the HDP version that we are going to install. For example if you have some third party services installed in your cluster which are not coming from HDP repo then you will have to remove them before you begin the HDP upgrade. Message-2). All service components must be installed This messages indicates that you might have some services installed to your cluster which migth have some components in "INSTALL_FAILED" state. # curl -u admin:admin -H "X-Requested-By: ambari" -X GET http://hdfcluster1.example.com:8080/api/v1/clusters/TestCluster/host_components?HostRoles/state=INSTALL_FAILED If you find any component in install failed state then please install them properly before starting the upgrade. In some cases it might happen if the clients components might not be installed on few cluster hosts. So please check if you have CLIENT components installed properly on your cluster nodes. If not then use the following API aapproach to install the CLIENTs to your cluster nodes. (or install them using Ambari UI) https://community.hortonworks.com/content/supportkb/150098/how-to-install-hadoop-clients-on-all-the-hosts-in.html Message-3). No Service can be in maintenance mode. You can not start HDP upgrade if any of your service is in Maintenance mode so please run the following API call before upgrading HDp to findout if there are any Services in Maintenance Mode or not? Also similar approach you will need to use to check that all Host Components are also not in Maintenance Mode . # curl -u admin:admin -H "X-Requested-By: ambari" -X GET http://hdfcluster1.example.com:8080/api/v1/clusters/TestCluster/services?ServiceInfo/maintenance_state=ON Message-4). All Services must be started. This message indicates that we can not start HDP component upgrades before all the components are already in running state. So we need to make sure that all the components / services are in Started stated. Also please make sure that we must run all the service checks successfully before we begin the HDP component upgrade to verify that all the components are in healthy state.. ... View more