question Re: Configure viewFS with HDFS fedration on CDP-PCB version 7.1.5 in Support Questions

Configure viewFS with HDFS fedration on CDP-PCB version 7.1.5

PrernaU — Fri, 08 Oct 2021 04:36:38 GMT

I am trying to configure Viewfs with HDFS Federation.

I tried this with HDP 3 and I am trying to find the procedure it implement on CDP cluster.

May someone please share the procedure to do the same.

The objective it to share the data between tow CDP clusters.

Thanks

Re: Configure viewFS with HDFS fedration on CDP-PCB version 7.1.5

Tylenol — Thu, 21 Oct 2021 03:56:50 GMT

Hello @PrernaU ,

Unfortunately, ViewFS is not yet a supported feature on CDP as federation is not supported yet.

Re: Configure viewFS with HDFS fedration on CDP-PCB version 7.1.5

PrernaU — Thu, 21 Oct 2021 06:36:33 GMT

@Tylenol Thanks for sharing the information.

what would be the ideal solution to copy the data between two CDP clusters.

Re: Configure viewFS with HDFS fedration on CDP-PCB version 7.1.5

PabitraDas — Thu, 21 Oct 2021 07:24:03 GMT

@PrernaU just wanted to check if you got a chance to check our blog post on viewFS here - https://blog.cloudera.com/global-view-distributed-file-system-with-mount-points/

You may also refer the community post citing the configuration steps - https://community.cloudera.com/t5/Community-Articles/Enabling-and-configuring-the-ViewHDFS-client-side-mounts-in/ta-p/306752

If you have reviewed the above pages and still getting some issue, let us know.

Re: Configure viewFS with HDFS fedration on CDP-PCB version 7.1.5

PabitraDas — Thu, 21 Oct 2021 07:38:39 GMT

@PrernaU can you provide more details about this - "The objective it to share the data between tow CDP clusters."

Are you trying to copy data between two distinct clusters? Are you looking at some solution like HDFS Replication task? If yes, please have a look at our Replication Manager tool in CDP for that purpose.

- https://docs.cloudera.com/cdp-private-cloud-base/7.1.7/replication-manager/topics/rm-dc-configuring-replication-of-hdfs-data.html

Re: Configure viewFS with HDFS fedration on CDP-PCB version 7.1.5

PrernaU — Fri, 22 Oct 2021 07:25:48 GMT

@PabitraDas The objective is to copy data between two distinct clusters