Member since
02-17-2016
12
Posts
16
Kudos Received
3
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
1735 | 09-12-2016 06:35 AM | |
9003 | 07-07-2016 01:19 PM | |
4683 | 07-07-2016 06:30 AM |
02-18-2016
09:48 AM
3 Kudos
Nishant, have you seen this thread on StackOverflow? It advises that distcp to S3 is secure by default. http://stackoverflow.com/questions/28375771/securely-transferring-data-from-hdfs-to-amazon-s3-using-distcp
StackOverflow user NachoNachoMan suggested you can test this by placing a policy on the bucket that prevents putobject when securetransport=false. Also, you'll probably want to use 's3a' in your put command "s3n://path-to-s3" https://wiki.apache.org/hadoop/AmazonS3
... View more