https://community.cloudera.com/t5/Archives-of-Support-Questions/Resource-Utilization-for-Distcp/m-p/202041#M65760 <P>When doing a hadoop distcp command from source to target, Is it possible to check the resource Utilization in both the source and target cluster. </P> Mon, 31 Jul 2017 09:07:23 GMT aljohnmangahas 2017-07-31T09:07:23Z https://community.cloudera.com/t5/Archives-of-Support-Questions/Resource-Utilization-for-Distcp/m-p/202041#M65760 <P>When doing a hadoop distcp command from source to target, Is it possible to check the resource Utilization in both the source and target cluster. </P> Mon, 31 Jul 2017 09:07:23 GMT https://community.cloudera.com/t5/Archives-of-Support-Questions/Resource-Utilization-for-Distcp/m-p/202041#M65760 aljohnmangahas 2017-07-31T09:07:23Z https://community.cloudera.com/t5/Archives-of-Support-Questions/Resource-Utilization-for-Distcp/m-p/202042#M65761 <P><A rel="user" href="https://community.cloudera.com/users/18358/aljohnmangahas.html" nodeid="18358">@Al John Mangahas</A> </P><P>Distcp spins off MapReduce jobs on the cluster it is running on/from. You can use the Yarn UI on that cluster to monitor the job progress and utilization. </P><P>Having said that, if you are copying from a Prod cluster to a DR cluster, and are worried about resource usage, then you can actually run the Distcp job on the DR cluster and have it "pull" the data from Prod. That way, the impact in terms of resources on Prod is minimal. </P> Tue, 01 Aug 2017 01:55:18 GMT https://community.cloudera.com/t5/Archives-of-Support-Questions/Resource-Utilization-for-Distcp/m-p/202042#M65761 egarelnabi 2017-08-01T01:55:18Z