Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Is hdfs symbolic link available?

Solved Go to solution

Is hdfs symbolic link available?

New Contributor

Per https://issues.apache.org/jira/browse/HDFS-245, symbolic link is implemented in hdfs for several years, but cdh5 still not able to recognize "hadoop fs -nl" command.

 

So is symbolic link feature available in hdfs? If so, how to create one?

1 ACCEPTED SOLUTION

Accepted Solutions

Re: Is hdfs symbolic link available?

Master Guru
Apache Hadoop's symlink support is not yet production ready. It has been disabled in functionality at the moment, as work on https://issues.apache.org/jira/browse/HDFS-5298 needs to complete before it can be consumed across the platform.
5 REPLIES 5

Re: Is hdfs symbolic link available?

Master Guru
Apache Hadoop's symlink support is not yet production ready. It has been disabled in functionality at the moment, as work on https://issues.apache.org/jira/browse/HDFS-5298 needs to complete before it can be consumed across the platform.

Re: Is hdfs symbolic link available?

Explorer

Any update on this?  It SURE would be nice to have symlinks in HDFS!!!!

Re: Is hdfs symbolic link available?

New Contributor

We have been hoping for the reintroduction of HDFS symlinks for several years. 

Q: Is there any development at all going on related to HDFS symlinks? 

 

From a distance, it seems like this should relatively easy ... all pathname resolution takes place on the namenode. 

Q: Does anyone have any simple/brief insight as to why HDFS symlinks might be technically challenging? 

 

Re: Is hdfs symbolic link available?

New Contributor

I might be missing something here but if symbolic links are not supported in HDFS, what is the significance of the method createSymlink in FileContext class?

 

https://hadoop.apache.org/docs/r2.6.3/api/org/apache/hadoop/fs/FileContext.html#createSymlink(org.ap..., org.apache.hadoop.fs.Path, boolean)

Re: Is hdfs symbolic link available?

Master Guru
@jh070784 - Please read my previous response. Support right now is disabled for incompleteness of design/impl., not unavailable. API was added before it was later disabled, and calling it will yield an error as the source reads: https://github.com/cloudera/hadoop-common/blob/cdh5.5.1-release/hadoop-common-project/hadoop-common/...

@michaelthoward - I am not aware of any major pick up of redoing symlink but if you're interested in history reading and contributing changes please start at https://issues.apache.org/jira/browse/HADOOP-10019 which is the parent JIRA listing all the problems faced with its design and current implementation.