Community Articles

Find and share helpful community-sourced technical articles.
avatar
Super Guru

SYMPTOM:

During HDP upgrade from 2.3 to 2.5 YARN check is failing due to NoSuchMethodError org.apache.hadoop.yarn.api.records.Resource.getMemorySize()J

ERROR: Below was the error in application logs -

16/11/14 10:30:12 FATAL distributedshell.ApplicationMaster: Error running ApplicationMaster
java.lang.NoSuchMethodError: org.apache.hadoop.yarn.api.records.Resource.getMemorySize()J
at org.apache.hadoop.yarn.applications.distributedshell.ApplicationMaster.run(ApplicationMaster.java:585)
at org.apache.hadoop.yarn.applications.distributedshell.ApplicationMaster.main(ApplicationMaster.java:298)

ROOT CAUSE:

There was issue with classpath where the nodemanager on which the job was running was pointing to older version[ie. 2.3] classpath.

RESOLUTION:

There are two solutions as below -

1. Skip this step in Ambari upgrade UI and proceed. Ambari will take care of setting up the classpath.

2. Modify the classpath manually and confirm the set classpath using "hadoop classpath" command and re-run the service check.

1,552 Views