How to use distcp editor of HUE?

Question

Hello Everyone,

Has anyone tested the Distcp editor available in HUE with CDP 7.1.5?

Currently I see the below screen: distcp screenshot.PNG

In this, I'm not able to manually enter the source cluster path. As soon as I click on the source path text box, it opens a dialog box to select the path from the current cluster HDFS.

Has anybody tested pulling data from another cluster? What config changes are required for getting this to work?

Thanks,

Megh

vidanimegh · Accepted Answer

In my case, though DistCp editor didn't work out, this same thing could be achieved within HUE by using DistCp action in Oozie.

Designed a simple oozie workflow with DistCp action and managed to get it working.

Thanks,

Megh

Daming Xue · Answer

Hello

This HUE distcp editor is designed to replicate data within the cluster and/or with the object store

You can click on the "..." button next to the input box to see what are the directories you account has access to, but within the current cluster scope

For data replication between two clusters, use Cloudera Manager/Replication Manager

https://docs.cloudera.com/cdp/latest/data-migration/topics/rm-dc-data-replication.html

Sign up

Please use your Cloudera account.

Login to the community

Please use your Cloudera account.