Reply
Highlighted
Explorer
Posts: 12
Registered: ‎01-16-2017

Distcp HDFS Encrypted data to Azure Blob Storage

Hi,

 

Is it possible to DistCp from an HDFS Encryption zone into Azure Blob Storage (or S3) without decrypting the data?

 

I am refering to the section here:
https://www.cloudera.com/documentation/enterprise/latest/topics/sg_hdfs_encryption_keys_zones.html#c...

 

The documentation mentions: "make sure you preserve extended attributes with the -px flag" but I can't find any information about whether the storage supports these attributes and when doing a distcp via wasbs whether they will be preserved.

 

Has anyone tried this or know if it will work? I know Blob storage supports encryption but I'd rather not decrypt, transfer over SSL unencrypted and store encrypted.

 

Many thanks,

 

Alex

Announcements