Created 01-21-2016 03:20 AM
Customer is running two clusters: PROD and DR. Both clusters have data and processing.
Each cluster is running a single NameNode (HA) with a single namespace for that cluster. Customer is looking for HDFS Federation and ViewFS support to be able to view files and directories in both clusters using a single interface.
http://hortonworks.com/blog/an-introduction-to-hdfs-federation/
https://hadoop.apache.org/docs/r2.4.1/hadoop-project-dist/hadoop-hdfs/ViewFs.html
I don't believe we support this scenario? Are there any other tools that provide "Windows Explorer" type interface to be able to navigate HDFS files and directories across multiple clusters?
Created 01-23-2016 12:20 AM
Created 02-02-2016 09:23 PM
@dbaev are you still having problems with this? Can you provide your own solution or accept best answer?
Created 05-05-2017 06:22 AM
We are looking at HSFS federation and ViewFS official support in a major HDP release after HDP 2.6. We might also support NFSv3 working with ViewFS and if you have NFS clients, you should be able to browse the tree structure.