Member since
12-04-2014
3
Posts
0
Kudos Received
0
Solutions
06-13-2017
08:05 AM
We are currently trying to backup data from CDH cluster to S3 for backup and it works fine. However when we want to use AWS KMS encryption to encrypt data at AWS side. Typically this should be switch to encrypt with codes like below, hadoop distcp \ -Dfs.s3a.access.key=<Access Key> \ -Dfs.s3a.secret.key=<Secret Key> \ -Dfs.s3a.server-side-encryption-algorithm=aws:kms \ -Dfs.s3a.server-side-encryption-key=<encryption-key> \ -Dcom.amazonaws.services.s3.disablePutObjectMD5Validation=true \ hdfs://<name-node>:8020/tmp/ \ s3a://<bucket-name>/temp1/ However I keep getting error related to hash code mismatch. Anybody has any luck in this please?
... View more
Labels:
- Labels:
-
HDFS