Reply
Highlighted
New Contributor
Posts: 2
Registered: ‎03-31-2016

parsing conf sqoop-site.xml java.io.FileNotFoundException (No such file or directory)

[ Edited ]

We have this error, using oozie action "eval" command sqoop, occurs like a random error, and appears just some times, any idea?

 

Thanks!.

 

 

2018-01-16 01:12:16,333 CommitterEvent Processor #1 INFO org.apache.hadoop.mapreduce.v2.app.commit.CommitterEventHandler - Processing the event EventType: JOB_COMMIT
2018-01-16 01:12:16,357 CommitterEvent Processor #1 FATAL org.apache.hadoop.conf.Configuration - error parsing conf sqoop-site.xml
java.io.FileNotFoundException: /u05/hadoop/yarn/nm/usercache/iecv/appcache/application_1516028139981_1126/container_e13_1516028139981_1126_01_000001/sqoop-site.xml (No such file or directory)
at java.io.FileInputStream.open0(Native Method)
at java.io.FileInputStream.open(FileInputStream.java:195)
at java.io.FileInputStream.<init>(FileInputStream.java:138)
at java.io.FileInputStream.<init>(FileInputStream.java:93)
at sun.net.www.protocol.file.FileURLConnection.connect(FileURLConnection.java:90)
at sun.net.www.protocol.file.FileURLConnection.getInputStream(FileURLConnection.java:188)
at org.apache.hadoop.conf.Configuration.parse(Configuration.java:2483)
at org.apache.hadoop.conf.Configuration.loadResource(Configuration.java:2554)
at org.apache.hadoop.conf.Configuration.loadResources(Configuration.java:2507)
at org.apache.hadoop.conf.Configuration.getProps(Configuration.java:2413)
at org.apache.hadoop.conf.Configuration.get(Configuration.java:984)
at org.apache.hadoop.conf.Configuration.getTrimmed(Configuration.java:1034)
at org.apache.hadoop.conf.Configuration.getInt(Configuration.java:1254)
at org.apache.hadoop.fs.FileSystem.create(FileSystem.java:804)
at org.apache.hadoop.mapreduce.v2.app.commit.CommitterEventHandler$EventProcessor.touchz(CommitterEventHandler.java:268)
at org.apache.hadoop.mapreduce.v2.app.commit.CommitterEventHandler$EventProcessor.handleJobCommit(CommitterEventHandler.java:282)
at org.apache.hadoop.mapreduce.v2.app.commit.CommitterEventHandler$EventProcessor.run(CommitterEventHandler.java:237)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
2018-01-16 01:12:16,357 [uber-SubtaskRunner] WARN org.apache.hadoop.mapred.LocalContainerLauncher - Unable to delete unexpected local file/dir .action.xml.crc: insufficient permissions?
2018-01-16 01:12:16,357 [uber-SubtaskRunner] WARN org.apache.hadoop.mapred.LocalContainerLauncher - Unable to delete unexpected local file/dir .action.xml.crc: insufficient permissions?
2018-01-16 01:12:16,358 CommitterEvent Processor #1 ERROR org.apache.hadoop.mapreduce.v2.app.commit.CommitterEventHandler - Could not commit job
java.lang.RuntimeException: java.io.FileNotFoundException: /u05/hadoop/yarn/nm/usercache/iecv/appcache/application_1516028139981_1126/container_e13_1516028139981_1126_01_000001/sqoop-site.xml (No such file or directory)
at org.apache.hadoop.conf.Configuration.loadResource(Configuration.java:2654)
at org.apache.hadoop.conf.Configuration.loadResources(Configuration.java:2507)
at org.apache.hadoop.conf.Configuration.getProps(Configuration.java:2413)
at org.apache.hadoop.conf.Configuration.get(Configuration.java:984)
at org.apache.hadoop.conf.Configuration.getTrimmed(Configuration.java:1034)
at org.apache.hadoop.conf.Configuration.getInt(Configuration.java:1254)
at org.apache.hadoop.fs.FileSystem.create(FileSystem.java:804)
at org.apache.hadoop.mapreduce.v2.app.commit.CommitterEventHandler$EventProcessor.touchz(CommitterEventHandler.java:268)
at org.apache.hadoop.mapreduce.v2.app.commit.CommitterEventHandler$EventProcessor.handleJobCommit(CommitterEventHandler.java:282)
at org.apache.hadoop.mapreduce.v2.app.commit.CommitterEventHandler$EventProcessor.run(CommitterEventHandler.java:237)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: java.io.FileNotFoundException: /u05/hadoop/yarn/nm/usercache/iecv/appcache/application_1516028139981_1126/container_e13_1516028139981_1126_01_000001/sqoop-site.xml (No such file or directory)
at java.io.FileInputStream.open0(Native Method)
at java.io.FileInputStream.open(FileInputStream.java:195)
at java.io.FileInputStream.<init>(FileInputStream.java:138)
at java.io.FileInputStream.<init>(FileInputStream.java:93)
at sun.net.www.protocol.file.FileURLConnection.connect(FileURLConnection.java:90)
at sun.net.www.protocol.file.FileURLConnection.getInputStream(FileURLConnection.java:188)
at org.apache.hadoop.conf.Configuration.parse(Configuration.java:2483)
at org.apache.hadoop.conf.Configuration.loadResource(Configuration.java:2554)
... 12 more

New Contributor
Posts: 2
Registered: ‎03-31-2016

Re: parsing conf sqoop-site.xml java.io.FileNotFoundException (No such file or directory)

I still have this error, any ideas?.

New Contributor
Posts: 3
Registered: ‎09-02-2016

Re: parsing conf sqoop-site.xml java.io.FileNotFoundException (No such file or directory)

I am fairly convinced it is a race condition caused by oozie uber mode, as described in https://issues.apache.org/jira/browse/OOZIE-2536 - I got the exact same stracktrace occasionally

Announcements