Reply
Highlighted
Expert Contributor
Posts: 162
Registered: ‎07-29-2013

arnRuntimeException: java.io.FileNotFoundException job.splitmetainfo

job init failed : org.apache.hadoop.yarn.exceptions.YarnRuntimeException: java.io.FileNotFoundException: File does not exist:  job.splitmetainfo

 

Hi, I'm trying to run mapreduce job using console hadoop jar. I get exception:

2015-05-06 17:21:30,305 WARN [main] org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: Job init failed
org.apache.hadoop.yarn.exceptions.YarnRuntimeException: java.io.FileNotFoundException: File does not exist: hdfs://nameservice1/user/devops/.staging/job_1430916274046_0127/job.splitmetainfo
	at org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl$InitTransition.createSplits(JobImpl.java:1566)
	at org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl$InitTransition.transition(JobImpl.java:1430)
	at org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl$InitTransition.transition(JobImpl.java:1388)
	at org.apache.hadoop.yarn.state.StateMachineFactory$MultipleInternalArc.doTransition(StateMachineFactory.java:385)
	at org.apache.hadoop.yarn.state.StateMachineFactory.doTransition(StateMachineFactory.java:302)
	at org.apache.hadoop.yarn.state.StateMachineFactory.access$300(StateMachineFactory.java:46)
	at org.apache.hadoop.yarn.state.StateMachineFactory$InternalStateMachine.doTransition(StateMachineFactory.java:448)
	at org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl.handle(JobImpl.java:996)
	at org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl.handle(JobImpl.java:138)
	at org.apache.hadoop.mapreduce.v2.app.MRAppMaster$JobEventDispatcher.handle(MRAppMaster.java:1272)
	at org.apache.hadoop.mapreduce.v2.app.MRAppMaster.serviceStart(MRAppMaster.java:1045)
	at org.apache.hadoop.service.AbstractService.start(AbstractService.java:193)
	at org.apache.hadoop.mapreduce.v2.app.MRAppMaster$1.run(MRAppMaster.java:1478)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:415)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1642)
	at org.apache.hadoop.mapreduce.v2.app.MRAppMaster.initAndStartAppMaster(MRAppMaster.java:1474)
	at org.apache.hadoop.mapreduce.v2.app.MRAppMaster.main(MRAppMaster.java:1407)
Caused by: java.io.FileNotFoundException: File does not exist: hdfs://nameservice1/user/devops/.staging/job_1430916274046_0127/job.splitmetainfo
	at org.apache.hadoop.hdfs.DistributedFileSystem$17.doCall(DistributedFileSystem.java:1093)
	at org.apache.hadoop.hdfs.DistributedFileSystem$17.doCall(DistributedFileSystem.java:1085)
	at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81)
	at org.apache.hadoop.hdfs.DistributedFileSystem.getFileStatus(DistributedFileSystem.java:1085)
	at org.apache.hadoop.mapreduce.split.SplitMetaInfoReader.readSplitMetaInfo(SplitMetaInfoReader.java:51)
	at org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl$InitTransition.createSplits(JobImpl.java:1561)

 

hdfs://nameservice1/user/devops/.staging/job_1430916274046_0127

contains files:

Found 3 items

-rw-r--r--   3 devops devops        311 2015-05-06 17:21 /user/devops/.staging/job_1430916274046_0127/job_1430916274046_0127.summary

-rw-r--r--   3 devops devops      11529 2015-05-06 17:21 /user/devops/.staging/job_1430916274046_0127/job_1430916274046_0127_1.jhist

-rw-r--r--   3 devops devops     224982 2015-05-06 17:21 /user/devops/.staging/job_1430916274046_0127/job_1430916274046_0127_1_conf.xml

 

What's wrong, what i'm missing?

Expert Contributor
Posts: 162
Registered: ‎07-29-2013

Re: arnRuntimeException: java.io.FileNotFoundException job.splitmetainfo

solved. there was misconfiguration in gateway
Posts: 965
Kudos: 114
Solutions: 61
Registered: ‎04-06-2015

Re: arnRuntimeException: java.io.FileNotFoundException job.splitmetainfo

I am happy to see you sorted out the issue. Thank you for the follow up. :)



Cy Jervis, Community Manager


Was your question answered? Make sure to mark the answer as the accepted solution.
If you find a reply useful, say thanks by clicking on the thumbs up button.

Learn more about the Cloudera Community:

Terms of Service

Community Guidelines

How to use the forum

New Contributor
Posts: 1
Registered: ‎05-18-2015

Re: arnRuntimeException: java.io.FileNotFoundException job.splitmetainfo

I am facing the same issue, Can you please elaborate on how the issue was fixed 

New Contributor
Posts: 2
Registered: ‎02-15-2016

Re: arnRuntimeException: java.io.FileNotFoundException job.splitmetainfo

Any one knows solution of above problem ?

Announcements