Community Articles

Find and share helpful community-sourced technical articles.

SYMPTOM:

During HDP upgrade from 2.3 to 2.5 YARN check is failing due to NoSuchMethodError org.apache.hadoop.yarn.api.records.Resource.getMemorySize()J

ERROR: Below was the error in application logs -

16/11/14 10:30:12 FATAL distributedshell.ApplicationMaster: Error running ApplicationMaster
java.lang.NoSuchMethodError: org.apache.hadoop.yarn.api.records.Resource.getMemorySize()J
at org.apache.hadoop.yarn.applications.distributedshell.ApplicationMaster.run(ApplicationMaster.java:585)
at org.apache.hadoop.yarn.applications.distributedshell.ApplicationMaster.main(ApplicationMaster.java:298)

ROOT CAUSE:

There was issue with classpath where the nodemanager on which the job was running was pointing to older version[ie. 2.3] classpath.

RESOLUTION:

There are two solutions as below -

1. Skip this step in Ambari upgrade UI and proceed. Ambari will take care of setting up the classpath.

2. Modify the classpath manually and confirm the set classpath using "hadoop classpath" command and re-run the service check.

780 Views
Take a Tour of the Community
Don't have an account?
Your experience may be limited. Sign in to explore more.
Version history
Last update:
‎11-14-2016 05:30 PM
Updated by:
Contributors
Top Kudoed Authors