Posts: 12
Registered: ‎01-16-2017

Distcp HDFS Encrypted data to Azure Blob Storage



Is it possible to DistCp from an HDFS Encryption zone into Azure Blob Storage (or S3) without decrypting the data?


I am refering to the section here:


The documentation mentions: "make sure you preserve extended attributes with the -px flag" but I can't find any information about whether the storage supports these attributes and when doing a distcp via wasbs whether they will be preserved.


Has anyone tried this or know if it will work? I know Blob storage supports encryption but I'd rather not decrypt, transfer over SSL unencrypted and store encrypted.


Many thanks,