Reply
New Contributor
Posts: 3
Registered: ‎05-23-2015

Installing Oozie through CM fails with Filesystem closed exception

Hey,

 

I am having a development cluster running CM 5.4.1 and CDH 5.4.2 (upgraded yesterday). The cluster started with CM 5.4.0 and CDH 5.4.0., but since its setup, I am unable to install Oozie properly. The "Install Share Lib" is failing with the following error:

 

SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/vol_01/cloudera/parcels/CDH-5.4.2-1.cdh5.4.2.p0.2/jars/slf4j-log4j12-1.7.5.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/vol_01/cloudera/parcels/CDH-5.4.2-1.cdh5.4.2.p0.2/jars/slf4j-simple-1.7.5.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]

Error: Filesystem closed

Stack trace for the error was (for debug purposes):
--------------------------------------
java.io.IOException: Filesystem closed
at org.apache.hadoop.hdfs.DFSClient.checkOpen(DFSClient.java:794)
at org.apache.hadoop.hdfs.DFSClient.getFileInfo(DFSClient.java:1980)
at org.apache.hadoop.hdfs.DistributedFileSystem$18.doCall(DistributedFileSystem.java:1128)
at org.apache.hadoop.hdfs.DistributedFileSystem$18.doCall(DistributedFileSystem.java:1124)
at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81)
at org.apache.hadoop.hdfs.DistributedFileSystem.getFileStatus(DistributedFileSystem.java:1124)
at org.apache.hadoop.fs.FileSystem.exists(FileSystem.java:1400)
at org.apache.hadoop.fs.FileUtil.checkDest(FileUtil.java:496)
at org.apache.hadoop.fs.FileUtil.copy(FileUtil.java:348)
at org.apache.hadoop.fs.FileUtil.copy(FileUtil.java:356)
at org.apache.hadoop.fs.FileUtil.copy(FileUtil.java:356)
at org.apache.hadoop.fs.FileUtil.copy(FileUtil.java:338)
at org.apache.hadoop.fs.FileSystem.copyFromLocalFile(FileSystem.java:1905)
at org.apache.hadoop.fs.FileSystem.copyFromLocalFile(FileSystem.java:1873)
at org.apache.oozie.tools.OozieSharelibCLI.run(OozieSharelibCLI.java:166)
at org.apache.oozie.tools.OozieSharelibCLI.main(OozieSharelibCLI.java:57)
--------------------------------------

 

I am not sure of resolving this and any help is appreciated.

 

 

Thanks,

Cloudera Employee
Posts: 314
Registered: ‎01-16-2014

Re: Installing Oozie through CM fails with Filesystem closed exception

 

You should be able to install the share lib just using the command from the dropdown in CM: ShareLib install.

Are you seeing the filesystem closed error when you do that?

 

Can you provide a little more info:

- did the first step of the upload finish (create the directories)?

- can you check if the hdfs dir for the oozie user exists and show the content

 

Wilfred

 

New Contributor
Posts: 3
Registered: ‎05-23-2015

Re: Installing Oozie through CM fails with Filesystem closed exception

Hi Wilfred,

 

I am doing the same steps from CM as you mentioned. 

 

Yea while doing this:

 

the first step -> create directories is finishing successfully.

It is failing in the second step; upload share lib is failing

 

Here is the contents of the oozie dir in hdfs:

 

[krk@hadoop1 ~]$ hadoop fs -ls /user/oozie/share/lib
Found 1 items
drwxr-xr-x - oozie oozie 0 2015-06-10 03:10 /user/oozie/share/lib/lib_20150610030612
[krk@hadoop1 ~]$ hadoop fs -ls /user/oozie/share/lib/lib_20150610030612
Found 4 items
drwxr-xr-x - oozie oozie 0 2015-06-10 03:07 /user/oozie/share/lib/lib_20150610030612/distcp
drwxr-xr-x - oozie oozie 0 2015-06-10 03:07 /user/oozie/share/lib/lib_20150610030612/hcatalog
drwxr-xr-x - oozie oozie 0 2015-06-10 03:10 /user/oozie/share/lib/lib_20150610030612/pig
drwxr-xr-x - oozie oozie 0 2015-06-10 03:10 /user/oozie/share/lib/lib_20150610030612/sqoop
[krk@hadoop1 ~]$

 

Note: I also have Kerberos set up in my cluster

 

 

Highlighted
Explorer
Posts: 10
Registered: ‎03-24-2015

Re: Installing Oozie through CM fails with Filesystem closed exception

Hi KarthikR,

 

Try to recreate oozie credential on your Kerberos server. Then rerun oozie "Install ShareLib" wizard.

Announcements