Created on 11-14-2016 05:30 PM
SYMPTOM:
During HDP upgrade from 2.3 to 2.5 YARN check is failing due to NoSuchMethodError org.apache.hadoop.yarn.api.records.Resource.getMemorySize()J
ERROR: Below was the error in application logs -
16/11/14 10:30:12 FATAL distributedshell.ApplicationMaster: Error running ApplicationMaster java.lang.NoSuchMethodError: org.apache.hadoop.yarn.api.records.Resource.getMemorySize()J at org.apache.hadoop.yarn.applications.distributedshell.ApplicationMaster.run(ApplicationMaster.java:585) at org.apache.hadoop.yarn.applications.distributedshell.ApplicationMaster.main(ApplicationMaster.java:298)
ROOT CAUSE:
There was issue with classpath where the nodemanager on which the job was running was pointing to older version[ie. 2.3] classpath.
RESOLUTION:
There are two solutions as below -
1. Skip this step in Ambari upgrade UI and proceed. Ambari will take care of setting up the classpath.
2. Modify the classpath manually and confirm the set classpath using "hadoop classpath" command and re-run the service check.