Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Distcp HDFS Encrypted data to Azure Blob Storage

Distcp HDFS Encrypted data to Azure Blob Storage

Explorer

Hi,

 

Is it possible to DistCp from an HDFS Encryption zone into Azure Blob Storage (or S3) without decrypting the data?

 

I am refering to the section here:
https://www.cloudera.com/documentation/enterprise/latest/topics/sg_hdfs_encryption_keys_zones.html#c...

 

The documentation mentions: "make sure you preserve extended attributes with the -px flag" but I can't find any information about whether the storage supports these attributes and when doing a distcp via wasbs whether they will be preserved.

 

Has anyone tried this or know if it will work? I know Blob storage supports encryption but I'd rather not decrypt, transfer over SSL unencrypted and store encrypted.

 

Many thanks,

 

Alex

Don't have an account?
Coming from Hortonworks? Activate your account here