Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

What methods are available for moving files into an HDFS Encryption Zone?

Solved Go to solution
Highlighted

What methods are available for moving files into an HDFS Encryption Zone?

New Contributor

is distcp the best/only mechanism for moving files into an encryption zone? The documentation says so. But would an hdfs mv or cp also work just fine?

1 ACCEPTED SOLUTION

Accepted Solutions

Re: What methods are available for moving files into an HDFS Encryption Zone?

The 'hadoop' command-line natively supports Encryption Zones so most file system operations (copyFromLocal, put, distCp) will work.

See more example usage in the Apache Hadoop docs.

And note that there are some considerations for copying between encrypted and unencrypted locations.

3 REPLIES 3

Re: What methods are available for moving files into an HDFS Encryption Zone?

Contributor

You should be use copyFromLocal or any other commands as well to copy files into EZ. You would not be able to use mv from an EZ

Re: What methods are available for moving files into an HDFS Encryption Zone?

The 'hadoop' command-line natively supports Encryption Zones so most file system operations (copyFromLocal, put, distCp) will work.

See more example usage in the Apache Hadoop docs.

And note that there are some considerations for copying between encrypted and unencrypted locations.

Re: What methods are available for moving files into an HDFS Encryption Zone?

With distcp, you'll be able to encrypt a large set of data faster.

Don't forget to add the distcp command options:

--skipcrccheck --update

Don't have an account?
Coming from Hortonworks? Activate your account here