Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Oozie cannot access local filesystem

Highlighted

Oozie cannot access local filesystem

Expert Contributor

I was using Oozie 4.2.0 (hdp2.6) and am now trying Oozie 4.3.1 (hdp 3.0).

One major difference is that one java action could in the past read its jar from the local filesystem, but it looks like it is not possible anymore. The Java action is basic:

<java xmlns="uri:oozie:workflow:0.5">
  <job-tracker>http://something.local:8050</job-tracker>
  <name-node>hdfs://HdfsNameService</name-node>
  <main-class>io.JsonPoster</main-class>
  <file>file:///opt/jsonposter/jsonposter.jar</file>
</java>

The error I get is quite clear:

org.apache.oozie.action.ActionExecutorException: UnsupportedOperationException: Accessing local file system is not allowed

I know I could put the jar on hdfs put I am trying to avoid that for now (because it used to work and all our deployment are done via rpm). I am ready to take the responsibility of having all jars in sync over all datanodes.

I already set oozie.service.HadoopAccessorService.supported.filesystems to *, with no effect.

Is there a way to tell Oozie that yes, I am happy for it to read the local FS?

1 REPLY 1
Highlighted

Re: Oozie cannot access local filesystem

New Contributor


I am also facing the same issue is there any solution found.?

Env

HDP 3.1.0

oozie 4.3.1

Stacktrace

Caused by: java.lang.UnsupportedOperationException: Accessing local file system is not allowed
    at org.apache.hadoop.fs.RawLocalFileSystem.initialize(RawLocalFileSystem.java:48)
    at org.apache.hadoop.fs.LocalFileSystem.initialize(LocalFileSystem.java:47)
    at org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:3303)
    at org.apache.hadoop.fs.FileSystem.access$200(FileSystem.java:124)
    at org.apache.hadoop.fs.FileSystem$Cache.getInternal(FileSystem.java:3352)
    at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:3320)
    at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:479)
    at org.apache.hadoop.fs.FileSystem.getLocal(FileSystem.java:435)
    at org.apache.hadoop.fs.LocalDirAllocator$AllocatorPerContext.confChanged(LocalDirAllocator.java:301)
    at org.apache.hadoop.fs.LocalDirAllocator$AllocatorPerContext.getLocalPathForWrite(LocalDirAllocator.java:378)
Don't have an account?
Coming from Hortonworks? Activate your account here