4 Required subjects before upgrade

[#1]

we are in the stage before the upgrade , ( but we see 4 requirements that need to be solve )

message is - You must meet these requirements before you can proceed.

example:

but the requirement not really true

we check the services and we not found any service that is in maintenance mode

second all services in the clsuter are started and up

and nothing that described in requirements is true

so my question is

what we can do in this stage ?

we cant do upgrade! ,

and actually we cant uninstall because we not see any option to uninstall !!!

please advice regarding this case

[#2]

@Jay my feeling is that the requirements not reflect the real situation of the cluster , as you see from my results there are no failed services/components or maintenance mode or services that not start , this is very very not make sense , , second why ambari GUI not have option to fallback ? , this must be basic when we want to fallback because problems ,

[#3]

@Michael Bronson

I will suggest to do a "Stop All" and "Start All" for all services from ambari UI and then try again

We must see some errors/warning in ambari server log or in agent logs ... to understand why The false Warnings are being shown in the UI. Or may be the DB inconsistency would have caused it.

[#4]

Jay , thank you I will do , second do you know any procedure for uninstall ? ( ambari GUI not have this ) , what is option is to remove all new rpm's that installed ( I can see the new rpm's from yum history on each machine ) , but any way we need approved procedure

[#5]

@Michael Bronson

From Ambari side currently we only have features to remove the OLD stacks, as mentioned in the following JIRA and HCC thread:
https://issues.apache.org/jira/browse/AMBARI-18435
https://community.hortonworks.com/questions/21876/how-to-remove-an-old-hdp-version.html
.

But if you want to remove the *all new rpm's* then ambari does not provide that option. You will have to rely on the yum command itself and try something like:

Please be careful with the following command before running the below one. I am assuming you have the new HDP RPMs version as "2.6.4.0-91" then you might want to try something like following ( -y option at the end of below command will make it non interactive mode)

# yum remove "*2.6.4.0-91*"

[#6]

@Jay regarding the problem , I see in amnari-server log the following : (invalid VDF)

as you know we use API to upgrade the HDP and when we do the API without ambari upgrade then evrything is OK

the problem is upgrading by API after ambari upgrade , what is your opinion?

<br>20 Mar 2018 09:58:32,393 ERROR [ambari-client-thread-973] CheckHelper:109 - Check COMPONENTS_INSTALLATION failed
org.apache.ambari.server.AmbariException: Unable to run upgrade checks because of an invalid VDF
        at org.apache.ambari.server.checks.AbstractCheckDescriptor.getServicesInUpgrade(AbstractCheckDescriptor.java:345)
        at org.apache.ambari.server.checks.ComponentsInstallationCheck.perform(ComponentsInstallationCheck.java:69)
        at org.apache.ambari.server.state.CheckHelper.performChecks(CheckHelper.java:104)
        at org.apache.ambari.server.controller.internal.PreUpgradeCheckResourceProvider.getResources(PreUpgradeCheckResourceProvider.java:236)
        at org.apache.ambari.server.controller.internal.ClusterControllerImpl$ExtendedResourceProviderWrapper.queryForResources(ClusterControllerImpl.java:966)
        at org.apache.ambari.server.controller.internal.ClusterControllerImpl.getResources(ClusterControllerImpl.java:141)
        at org.apache.ambari.server.api.query.QueryImpl.doQuery(QueryImpl.java:529)
        at org.apache.ambari.server.api.query.QueryImpl.queryForResources(QueryImpl.java:398)
        at org.apache.ambari.server.api.query.QueryImpl.execute(QueryImpl.java:222)
        at org.apache.ambari.server.api.handlers.ReadHandler.handleRequest(ReadHandler.java:77)
        at org.apache.ambari.server.api.services.BaseRequest.process(BaseRequest.java:144)
        at org.apache.ambari.server.api.services.BaseService.handleRequest(BaseService.java:126)
        at org.apache.ambari.server.api.services.BaseService.handleRequest(BaseService.java:90)
        at org.apache.ambari.server.api.services.PreUpgradeCheckService.getPreUpgradeChecks(PreUpgradeCheckService.java:61)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)

20 Mar 2018 09:56:42,162 ERROR [ambari-client-thread-888] CheckHelper:76 - Unable to determine whether the pre-upgrade check SERVICES_RANGER_PASSWORD_VERIFY is applicable to this upgrade
org.apache.ambari.server.AmbariException: Unable to run upgrade checks because of an invalid VDF

[#7]

@Michael Bronson

As the error says invalid VDF so it is better to check if there is any issue with the VDF before proceeding with the upgrade.

Unable to run upgrade checks because of an invalid VDF

.

[#8]

@Michael Bronson

Inside ambari DB you can find the following entry to see your VDF

# SELECT version_xml FROM repo_version;

.

[#9]

OK , but how to check it , location?

[#10]

@Jay can we search this file on ambari server machine?

[#11]

@Jay I see the fine on ambari server - /var/www/html/HDP/centos7/2.6.4.0-91/HDP-2.6.4.0-91.xml , and file isn't empty , and looks ok , so what we can do else?