Cloudera Community
Announcements
Celebrating as our community reaches 100,000 members! Thank you!
harsha_v
user rank
Explorer
My Accepted Solutions
Show All

Re: CDH5.2: yarn :Error starting yarn nodemanagers

by Explorer in Support Questions
‎02-20-2015 09:55 AM
‎02-20-2015 09:55 AM
Thanks for the update! ... View more

Re: CDH5.2: yarn :Error starting yarn nodemanagers

by Explorer in Support Questions
‎02-18-2015 11:04 AM
‎02-18-2015 11:04 AM
Hi Wilfred, Sorry for the late reply, never got notifed about movement on this thread.. I was able to resolve it then by having the /tmp/.../yarn-nm-state dir deleted and retstarting yarn.. But, to answer your question: The NM was up atleast for a week and there may have been a /tmp cleaner for large files only..   Do you have any more info as to why the issue occurs and timeline when this issue could be fixed?   Thanks     ... View more

Re: Spark sql and Hive tables

by Explorer in Support Questions
‎11-28-2014 07:02 AM
1 Kudo
‎11-28-2014 07:02 AM
1 Kudo
You need to have the hive client jars in your classpath. ... View more

CDH5.2: yarn :Error starting yarn nodemanagers

by Explorer in Support Questions
‎11-17-2014 11:28 AM
1 Kudo
‎11-17-2014 11:28 AM
1 Kudo
  Trying to start yarn when i get the following error on some of the nodes , anyone see this before?  ( Not sure what caused this corruption since yarnm was running ok for a couple of days ) If the files expected are missing, how to recover to prior state ?    Error starting NodeManager org.apache.hadoop.service.ServiceStateException: org.fusesource.leveldbjni.internal.NativeDB$DBException: Corruption: 3 missing files; e.g.: /tmp/hadoop-yarn/yarn-nm-recovery/yarn-nm-state/000032.sst at org.apache.hadoop.service.ServiceStateException.convert(ServiceStateException.java:59) at org.apache.hadoop.service.AbstractService.init(AbstractService.java:172) at org.apache.hadoop.yarn.server.nodemanager.NodeManager.initAndStartRecoveryStore(NodeManager.java:152) at org.apache.hadoop.yarn.server.nodemanager.NodeManager.serviceInit(NodeManager.java:190) at org.apache.hadoop.service.AbstractService.init(AbstractService.java:163) at org.apache.hadoop.yarn.server.nodemanager.NodeManager.initAndStartNodeManager(NodeManager.java:445) at org.apache.hadoop.yarn.server.nodemanager.NodeManager.main(NodeManager.java:492) Caused by: org.fusesource.leveldbjni.internal.NativeDB$DBException: Corruption: 3 missing files; e.g.: /tmp/hadoop-yarn/yarn-nm-recovery/yarn-nm-state/000032.sst at org.fusesource.leveldbjni.internal.NativeDB.checkStatus(NativeDB.java:200) at org.fusesource.leveldbjni.internal.NativeDB.open(NativeDB.java:218) at org.fusesource.leveldbjni.JniDBFactory.open(JniDBFactory.java:168) at org.apache.hadoop.yarn.server.nodemanager.recovery.NMLeveldbStateStoreService.initStorage(NMLeveldbStateStoreService.java:842) at org.apache.hadoop.yarn.server.nodemanager.recovery.NMStateStoreService.serviceInit(NMStateStoreService.java:195) at org.apache.hadoop.service.AbstractService.init(AbstractService.java:163) org.apache.hadoop.service.ServiceStateException: org.fusesource.leveldbjni.internal.NativeDB$DBException: Corruption: 3 missing files; e.g.: /tmp/hadoop-yarn/yarn-nm-recovery/yarn-nm-state/000032.sst       ... View more
Labels:
Contact Me
Online
Offline
Last Visited
‎02-23-2015 12:15 PM
Community Statistics
Member Since ‎10-28-2014 12:33 PM
Last Visited ‎02-23-2015 12:15 PM
Posts 7
Kudos received 2