Our Community is getting an upgrade! To get everything ready for the relaunch, we’ll be placing the site in read-only mode starting September 21st.
We really appreciate your understanding while we get things set up behind the scenes. Catch up on all the exciting details about the move here.
Need help or have questions? Drop us a line at [email protected]
Created on 05-01-2015 09:24 AM - edited 09-16-2022 02:27 AM
I'm transferring files using distcp on Cloudera 5.3.x, and I can't get it to distribute the transfer using MR2.
I don't have MR1 installed at all. I'd rather not because it'll hide issues.
My command line looks like this, and it runs just fine, it just copies every file in series:
mapred distcp s3n://key:[email protected]/source/2015/04/28/ hdfs://nameservice/target/dir/2015/04/28
Is there a configuration item that I missed?
Created 05-01-2015 10:56 AM
Created 05-01-2015 10:56 AM
Created 05-01-2015 02:30 PM
That was it! Thank you!