Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

HDFS Federation and ViewFS support for multiple clusters

Highlighted

HDFS Federation and ViewFS support for multiple clusters

New Contributor

Customer is running two clusters: PROD and DR. Both clusters have data and processing.

Each cluster is running a single NameNode (HA) with a single namespace for that cluster. Customer is looking for HDFS Federation and ViewFS support to be able to view files and directories in both clusters using a single interface.

http://hortonworks.com/blog/an-introduction-to-hdfs-federation/

https://hadoop.apache.org/docs/r2.4.1/hadoop-project-dist/hadoop-hdfs/ViewFs.html

I don't believe we support this scenario? Are there any other tools that provide "Windows Explorer" type interface to be able to navigate HDFS files and directories across multiple clusters?

3 REPLIES 3

Re: HDFS Federation and ViewFS support for multiple clusters

@dbaev

You are right on the support part.

Re: HDFS explorer..check out this

Re: HDFS Federation and ViewFS support for multiple clusters

Mentor

@dbaev are you still having problems with this? Can you provide your own solution or accept best answer?

Re: HDFS Federation and ViewFS support for multiple clusters

New Contributor

We are looking at HSFS federation and ViewFS official support in a major HDP release after HDP 2.6. We might also support NFSv3 working with ViewFS and if you have NFS clients, you should be able to browse the tree structure.