Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Node manager is failing again and again on one of the hadoop node

Node manager is failing again and again on one of the hadoop node

We have 5 node Hadoop cluster in which,

One node-manager is failing again and again with following error.

I copied this log from the same host : Nodemanager log diretcory: /var/log/hadoop-yarn/yarn/yarn-yarn-nodemanager-SlaveHostname.log

LOCALIZING 2016-07-12 15:01:10,593 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1467937373251_0002 2016-07-12 15:01:10,594 INFO yarn.YarnShuffleService (YarnShuffleService.java:initializeContainer(183)) - Initializing container container_e16_1467937373251_0002_02_000001 2016-07-12 15:01:10,596 ERROR event.AsyncDispatcher (AsyncDispatcher.java:dispatch(189)) - Error in dispatcher thread java.lang.NoSuchMethodError: org.apache.hadoop.yarn.util.FSDownload.createStatusCacheLoader(Lorg/apache/hadoop/conf/Configuration;)Lcom/google/common/cache/CacheLoader; at org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService.handleInitContainerResources(ResourceLocalizationService.java:442) at org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService.handle(ResourceLocalizationService.java:392) at org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService.handle(ResourceLocalizationService.java:140) at org.apache.hadoop.yarn.event.AsyncDispatcher.dispatch(AsyncDispatcher.java:183) at org.apache.hadoop.yarn.event.AsyncDispatcher$1.run(AsyncDispatcher.java:109) at java.lang.Thread.run(Thread.java:745) 2016-07-12 15:01:10,597 INFO event.AsyncDispatcher (AsyncDispatcher.java:run(290)) - Exiting, bbye.. 2016-07-12 15:01:10,660 INFO ipc.Server (Server.java:run(949)) - IPC Server Responder: starting

Does anyone has any idea about this error ?

2 REPLIES 2

Re: Node manager is failing again and again on one of the hadoop node

Super Guru

@revan wabale

Could be because of missing jar file(s). Can you please compare existing jars with other working nodemanager and see if something is missing?

you can compare jars at below location

/usr/hdp/current/hadoop-yarn-nodemanager/lib/

Re: Node manager is failing again and again on one of the hadoop node

Yes this issue with jar. I has faced same issue. Copy the missing jar from existing working nodemanager and then try to start.

Don't have an account?
Coming from Hortonworks? Activate your account here