Archives of Support Questions (Read Only)

This is an archived board for historical reference. Information and links may no longer be available or relevant
Announcements
This board is archived and read-only for historical reference. To ask a new question, please post a new topic on the appropriate active board.

What methods are available for moving files into an HDFS Encryption Zone?

avatar
New Member

is distcp the best/only mechanism for moving files into an encryption zone? The documentation says so. But would an hdfs mv or cp also work just fine?

1 ACCEPTED SOLUTION

avatar

The 'hadoop' command-line natively supports Encryption Zones so most file system operations (copyFromLocal, put, distCp) will work.

See more example usage in the Apache Hadoop docs.

And note that there are some considerations for copying between encrypted and unencrypted locations.

View solution in original post

3 REPLIES 3

avatar
Rising Star

You should be use copyFromLocal or any other commands as well to copy files into EZ. You would not be able to use mv from an EZ

avatar

The 'hadoop' command-line natively supports Encryption Zones so most file system operations (copyFromLocal, put, distCp) will work.

See more example usage in the Apache Hadoop docs.

And note that there are some considerations for copying between encrypted and unencrypted locations.

avatar

With distcp, you'll be able to encrypt a large set of data faster.

Don't forget to add the distcp command options:

--skipcrccheck --update