Support Questions
Find answers, ask questions, and share your expertise

Distcp HDFS Encrypted data to Azure Blob Storage

Distcp HDFS Encrypted data to Azure Blob Storage

Explorer

Hi,

 

Is it possible to DistCp from an HDFS Encryption zone into Azure Blob Storage (or S3) without decrypting the data?

 

I am refering to the section here:
https://www.cloudera.com/documentation/enterprise/latest/topics/sg_hdfs_encryption_keys_zones.html#c...

 

The documentation mentions: "make sure you preserve extended attributes with the -px flag" but I can't find any information about whether the storage supports these attributes and when doing a distcp via wasbs whether they will be preserved.

 

Has anyone tried this or know if it will work? I know Blob storage supports encryption but I'd rather not decrypt, transfer over SSL unencrypted and store encrypted.

 

Many thanks,

 

Alex