Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Installing Oozie through CM fails with Filesystem closed exception

Installing Oozie through CM fails with Filesystem closed exception

New Contributor

Hey,

 

I am having a development cluster running CM 5.4.1 and CDH 5.4.2 (upgraded yesterday). The cluster started with CM 5.4.0 and CDH 5.4.0., but since its setup, I am unable to install Oozie properly. The "Install Share Lib" is failing with the following error:

 

SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/vol_01/cloudera/parcels/CDH-5.4.2-1.cdh5.4.2.p0.2/jars/slf4j-log4j12-1.7.5.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/vol_01/cloudera/parcels/CDH-5.4.2-1.cdh5.4.2.p0.2/jars/slf4j-simple-1.7.5.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]

Error: Filesystem closed

Stack trace for the error was (for debug purposes):
--------------------------------------
java.io.IOException: Filesystem closed
at org.apache.hadoop.hdfs.DFSClient.checkOpen(DFSClient.java:794)
at org.apache.hadoop.hdfs.DFSClient.getFileInfo(DFSClient.java:1980)
at org.apache.hadoop.hdfs.DistributedFileSystem$18.doCall(DistributedFileSystem.java:1128)
at org.apache.hadoop.hdfs.DistributedFileSystem$18.doCall(DistributedFileSystem.java:1124)
at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81)
at org.apache.hadoop.hdfs.DistributedFileSystem.getFileStatus(DistributedFileSystem.java:1124)
at org.apache.hadoop.fs.FileSystem.exists(FileSystem.java:1400)
at org.apache.hadoop.fs.FileUtil.checkDest(FileUtil.java:496)
at org.apache.hadoop.fs.FileUtil.copy(FileUtil.java:348)
at org.apache.hadoop.fs.FileUtil.copy(FileUtil.java:356)
at org.apache.hadoop.fs.FileUtil.copy(FileUtil.java:356)
at org.apache.hadoop.fs.FileUtil.copy(FileUtil.java:338)
at org.apache.hadoop.fs.FileSystem.copyFromLocalFile(FileSystem.java:1905)
at org.apache.hadoop.fs.FileSystem.copyFromLocalFile(FileSystem.java:1873)
at org.apache.oozie.tools.OozieSharelibCLI.run(OozieSharelibCLI.java:166)
at org.apache.oozie.tools.OozieSharelibCLI.main(OozieSharelibCLI.java:57)
--------------------------------------

 

I am not sure of resolving this and any help is appreciated.

 

 

Thanks,

3 REPLIES 3

Re: Installing Oozie through CM fails with Filesystem closed exception

Super Collaborator

 

You should be able to install the share lib just using the command from the dropdown in CM: ShareLib install.

Are you seeing the filesystem closed error when you do that?

 

Can you provide a little more info:

- did the first step of the upload finish (create the directories)?

- can you check if the hdfs dir for the oozie user exists and show the content

 

Wilfred

 

Re: Installing Oozie through CM fails with Filesystem closed exception

New Contributor

Hi Wilfred,

 

I am doing the same steps from CM as you mentioned. 

 

Yea while doing this:

 

the first step -> create directories is finishing successfully.

It is failing in the second step; upload share lib is failing

 

Here is the contents of the oozie dir in hdfs:

 

[krk@hadoop1 ~]$ hadoop fs -ls /user/oozie/share/lib
Found 1 items
drwxr-xr-x - oozie oozie 0 2015-06-10 03:10 /user/oozie/share/lib/lib_20150610030612
[krk@hadoop1 ~]$ hadoop fs -ls /user/oozie/share/lib/lib_20150610030612
Found 4 items
drwxr-xr-x - oozie oozie 0 2015-06-10 03:07 /user/oozie/share/lib/lib_20150610030612/distcp
drwxr-xr-x - oozie oozie 0 2015-06-10 03:07 /user/oozie/share/lib/lib_20150610030612/hcatalog
drwxr-xr-x - oozie oozie 0 2015-06-10 03:10 /user/oozie/share/lib/lib_20150610030612/pig
drwxr-xr-x - oozie oozie 0 2015-06-10 03:10 /user/oozie/share/lib/lib_20150610030612/sqoop
[krk@hadoop1 ~]$

 

Note: I also have Kerberos set up in my cluster

 

 

Highlighted

Re: Installing Oozie through CM fails with Filesystem closed exception

Explorer

Hi KarthikR,

 

Try to recreate oozie credential on your Kerberos server. Then rerun oozie "Install ShareLib" wizard.