Reply
New Contributor
Posts: 1
Registered: ‎05-08-2014
Accepted Solution

Is hdfs symbolic link available?

Per https://issues.apache.org/jira/browse/HDFS-245, symbolic link is implemented in hdfs for several years, but cdh5 still not able to recognize "hadoop fs -nl" command.

 

So is symbolic link feature available in hdfs? If so, how to create one?

Posts: 1,903
Kudos: 435
Solutions: 307
Registered: ‎07-31-2013

Re: Is hdfs symbolic link available?

Apache Hadoop's symlink support is not yet production ready. It has been disabled in functionality at the moment, as work on https://issues.apache.org/jira/browse/HDFS-5298 needs to complete before it can be consumed across the platform.
Explorer
Posts: 18
Registered: ‎01-30-2014

Re: Is hdfs symbolic link available?

[ Edited ]

Any update on this?  It SURE would be nice to have symlinks in HDFS!!!!

New Contributor
Posts: 1
Registered: ‎03-09-2016

Re: Is hdfs symbolic link available?

We have been hoping for the reintroduction of HDFS symlinks for several years. 

Q: Is there any development at all going on related to HDFS symlinks? 

 

From a distance, it seems like this should relatively easy ... all pathname resolution takes place on the namenode. 

Q: Does anyone have any simple/brief insight as to why HDFS symlinks might be technically challenging? 

 

New Contributor
Posts: 1
Registered: ‎08-12-2016

Re: Is hdfs symbolic link available?

I might be missing something here but if symbolic links are not supported in HDFS, what is the significance of the method createSymlink in FileContext class?

 

https://hadoop.apache.org/docs/r2.6.3/api/org/apache/hadoop/fs/FileContext.html#createSymlink(org.ap..., org.apache.hadoop.fs.Path, boolean)

Highlighted
Posts: 1,903
Kudos: 435
Solutions: 307
Registered: ‎07-31-2013

Re: Is hdfs symbolic link available?

@jh070784 - Please read my previous response. Support right now is disabled for incompleteness of design/impl., not unavailable. API was added before it was later disabled, and calling it will yield an error as the source reads: https://github.com/cloudera/hadoop-common/blob/cdh5.5.1-release/hadoop-common-project/hadoop-common/...

@michaelthoward - I am not aware of any major pick up of redoing symlink but if you're interested in history reading and contributing changes please start at https://issues.apache.org/jira/browse/HADOOP-10019 which is the parent JIRA listing all the problems faced with its design and current implementation.