Reply
Explorer
Posts: 15
Registered: ‎11-27-2017

Distcp between Insecure cluster to secure cluster.

Hi Team, 

 

Cloud you please let me know how to distcp between Insecure cluster to Secured cluster?

 

Thanks,

 

Highlighted
Expert Contributor
Posts: 133
Registered: ‎01-08-2018

Re: Distcp between Insecure cluster to secure cluster.

You should run the below command on a node of the secure cluster.

If the insecure cluster has HDFS HA enabled, you should check which Namenode is active, and use this one.

hadoop distcp -Dipc.client.fallback-to-simple-auth-allowed=true hdfs://unsecure.cluster.com:8020/user/myuser/source hdfs://secure.cluster.com/user/destuser/destination
Explorer
Posts: 15
Registered: ‎11-27-2017

Re: Distcp between Insecure cluster to secure cluster.

I was able to fix the issue. It was due to firewalls.

Announcements