Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

arnRuntimeException: java.io.FileNotFoundException job.splitmetainfo

arnRuntimeException: java.io.FileNotFoundException job.splitmetainfo

Expert Contributor

job init failed : org.apache.hadoop.yarn.exceptions.YarnRuntimeException: java.io.FileNotFoundException: File does not exist:  job.splitmetainfo

 

Hi, I'm trying to run mapreduce job using console hadoop jar. I get exception:

2015-05-06 17:21:30,305 WARN [main] org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: Job init failed
org.apache.hadoop.yarn.exceptions.YarnRuntimeException: java.io.FileNotFoundException: File does not exist: hdfs://nameservice1/user/devops/.staging/job_1430916274046_0127/job.splitmetainfo
	at org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl$InitTransition.createSplits(JobImpl.java:1566)
	at org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl$InitTransition.transition(JobImpl.java:1430)
	at org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl$InitTransition.transition(JobImpl.java:1388)
	at org.apache.hadoop.yarn.state.StateMachineFactory$MultipleInternalArc.doTransition(StateMachineFactory.java:385)
	at org.apache.hadoop.yarn.state.StateMachineFactory.doTransition(StateMachineFactory.java:302)
	at org.apache.hadoop.yarn.state.StateMachineFactory.access$300(StateMachineFactory.java:46)
	at org.apache.hadoop.yarn.state.StateMachineFactory$InternalStateMachine.doTransition(StateMachineFactory.java:448)
	at org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl.handle(JobImpl.java:996)
	at org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl.handle(JobImpl.java:138)
	at org.apache.hadoop.mapreduce.v2.app.MRAppMaster$JobEventDispatcher.handle(MRAppMaster.java:1272)
	at org.apache.hadoop.mapreduce.v2.app.MRAppMaster.serviceStart(MRAppMaster.java:1045)
	at org.apache.hadoop.service.AbstractService.start(AbstractService.java:193)
	at org.apache.hadoop.mapreduce.v2.app.MRAppMaster$1.run(MRAppMaster.java:1478)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:415)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1642)
	at org.apache.hadoop.mapreduce.v2.app.MRAppMaster.initAndStartAppMaster(MRAppMaster.java:1474)
	at org.apache.hadoop.mapreduce.v2.app.MRAppMaster.main(MRAppMaster.java:1407)
Caused by: java.io.FileNotFoundException: File does not exist: hdfs://nameservice1/user/devops/.staging/job_1430916274046_0127/job.splitmetainfo
	at org.apache.hadoop.hdfs.DistributedFileSystem$17.doCall(DistributedFileSystem.java:1093)
	at org.apache.hadoop.hdfs.DistributedFileSystem$17.doCall(DistributedFileSystem.java:1085)
	at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81)
	at org.apache.hadoop.hdfs.DistributedFileSystem.getFileStatus(DistributedFileSystem.java:1085)
	at org.apache.hadoop.mapreduce.split.SplitMetaInfoReader.readSplitMetaInfo(SplitMetaInfoReader.java:51)
	at org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl$InitTransition.createSplits(JobImpl.java:1561)

 

hdfs://nameservice1/user/devops/.staging/job_1430916274046_0127

contains files:

Found 3 items

-rw-r--r--   3 devops devops        311 2015-05-06 17:21 /user/devops/.staging/job_1430916274046_0127/job_1430916274046_0127.summary

-rw-r--r--   3 devops devops      11529 2015-05-06 17:21 /user/devops/.staging/job_1430916274046_0127/job_1430916274046_0127_1.jhist

-rw-r--r--   3 devops devops     224982 2015-05-06 17:21 /user/devops/.staging/job_1430916274046_0127/job_1430916274046_0127_1_conf.xml

 

What's wrong, what i'm missing?

4 REPLIES 4

Re: arnRuntimeException: java.io.FileNotFoundException job.splitmetainfo

Expert Contributor
solved. there was misconfiguration in gateway

Re: arnRuntimeException: java.io.FileNotFoundException job.splitmetainfo

Community Manager

I am happy to see you sorted out the issue. Thank you for the follow up. :)



Cy Jervis, Community Manager

Was your question answered? Make sure to mark the answer as the accepted solution.
If you find a reply useful, say thanks by clicking on the thumbs up button.

Learn more about the Cloudera Community:
Community Guidelines
How to use the forum
Highlighted

Re: arnRuntimeException: java.io.FileNotFoundException job.splitmetainfo

New Contributor

I am facing the same issue, Can you please elaborate on how the issue was fixed 

Re: arnRuntimeException: java.io.FileNotFoundException job.splitmetainfo

New Contributor

Any one knows solution of above problem ?