[ SOLVED ] After posting this request for help, it got me thinking about re-wording my Google search parameters which led me to a Horton site for copying data between Horton and S3 buckets. It didn't have an exact answer, but what it did have was the field for specifying an end point. It was exactly what I needed to add to my cli command. Here is the complete command I used to get distcp working for s3-govcloud to hdfs. Opposite also works, hdfs to s3-govcloud. #AWS_SECRET=xxxxxxxxx #AWS_KEY_ID=xxxxxxxxx #AWS_BUCKET=xxxxxxxx <-- name of your govcloud bucket #hadoop distcp -D fs.s3a.bucket.#AWS_BUCKET.endpoint=s3-us-gov-west-1.amazonaws.com -D fs.s3a.awsAccessKeyId=$AWS_KEY_ID -D fs.s3a.awsSecretAccessKey=$AWS_SECRET s3a://$AWS_BUCKET/path/to/files/ /path/to/hdfs/files/ Links I used for reference: AWS GovCloud Endpoints http://docs.aws.amazon.com/govcloud-us/latest/UserGuide/using-govcloud-endpoints.html Horton Amazon S3 Bucket Configuration https://hortonworks.github.io/hdp-aws/s3-copy-data/index.html
... View more
