Support Questions
Find answers, ask questions, and share your expertise

Oozie FileNotFoundException /user/hadoop/oozie-oozi/0096779-161228053611925-oozie-oozi-W/Dataset-Instance-Counter--shell/action.xml

Oozie FileNotFoundException /user/hadoop/oozie-oozi/0096779-161228053611925-oozie-oozi-W/Dataset-Instance-Counter--shell/action.xml

New Contributor

Hi team,We are sometimes getting below error and workflows are failing. If we try to simply rerun the workflow or start again, it completes successfully. Any troubleshooting is appreciated.

Oozie Launcher starts
  
  Heart beat
  Failing Oozie Launcher, Main class [org.apache.oozie.action.hadoop.ShellMain], exception invoking main(), File does not exist: hdfs://ip-20-0-3-233.ec2.internal:8020/user/hadoop/oozie-oozi/0096779-161228053611925-oozie-oozi-W/Dataset-Instance-Counter--shell/action.xml
  java.io.FileNotFoundException: File does not exist: hdfs://ip-20-0-3-233.ec2.internal:8020/user/hadoop/oozie-oozi/0096779-161228053611925-oozie-oozi-W/Dataset-Instance-Counter--shell/action.xml
  at org.apache.hadoop.hdfs.DistributedFileSystem$18.doCall(DistributedFileSystem.java:1122)
  at org.apache.hadoop.hdfs.DistributedFileSystem$18.doCall(DistributedFileSystem.java:1114)
  at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81)
  at org.apache.hadoop.hdfs.DistributedFileSystem.getFileStatus(DistributedFileSystem.java:1114)
  at org.apache.hadoop.fs.FileUtil.copy(FileUtil.java:337)
  at org.apache.hadoop.fs.FileUtil.copy(FileUtil.java:289)
  at org.apache.hadoop.fs.FileSystem.copyToLocalFile(FileSystem.java:2018)
  at org.apache.hadoop.fs.FileSystem.copyToLocalFile(FileSystem.java:1987)
  at org.apache.hadoop.fs.FileSystem.copyToLocalFile(FileSystem.java:1963)
  at org.apache.oozie.action.hadoop.LauncherMapper.setupMainConfiguration(LauncherMapper.java:460)
  at org.apache.oozie.action.hadoop.LauncherMapper.map(LauncherMapper.java:177)
  at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:65)
  at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:452)
  at org.apache.hadoop.mapred.MapTask.run(MapTask.java:344)
  at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:171)
  at java.security.AccessController.doPrivileged(Native Method)
  at javax.security.auth.Subject.doAs(Subject.java:415)
  at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1628)
  at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:166)
  
  Oozie Launcher failed, finishing Hadoop job gracefully
  
  Oozie Launcher, uploading action data to HDFS sequence file: hdfs://ip-20-0-3-233.ec2.internal:8020/user/hadoop/oozie-oozi/0096779-161228053611925-oozie-oozi-W/Dataset-Instance-Counter--shell/action-data.seq
2 REPLIES 2

Re: Oozie FileNotFoundException /user/hadoop/oozie-oozi/0096779-161228053611925-oozie-oozi-W/Dataset-Instance-Counter--shell/action.xml

New Contributor

JA018 is the error code I see.

Re: Oozie FileNotFoundException /user/hadoop/oozie-oozi/0096779-161228053611925-oozie-oozi-W/Dataset-Instance-Counter--shell/action.xml

I also faced the same issue with oozie shell action. even-though I configured as specified in Oozie schema I am getting JA018. After I deep dive into my shell script I have noticed that I have add kernel shell instead of bash shell . After removing kernel shell library from shell script. It executed fine.

removed #!/bin/ksh and added #!/bin/bash -e.

Please see if this helps to execute your shell action fine from oozie.