Support Questions
Find answers, ask questions, and share your expertise

Transfer data over different cluster and different block size using DISTCP

Can we transfer data over different cluster and different block size using DISTCP.
Cluster A : 128 MB Block size
Cluster B: 64 MB Block size

Can we transfer data from Cluster A to Cluster B using DistCP.

2 REPLIES 2

Re: Transfer data over different cluster and different block size using DISTCP

Expert Contributor

Hi @Rahul Gupta,

Yes you can do it, but you need to add the option -update in the command line

https://hadoop.apache.org/docs/r2.7.0/hadoop-distcp/DistCp.html

Michel

Re: Transfer data over different cluster and different block size using DISTCP

Expert Contributor

Hi @Rahul Gupta,

Did you managed this? if yes can you accept the answer? 🙂

Thanks,

Michel