- Subscribe to RSS Feed
- Mark Question as New
- Mark Question as Read
- Float this Question for Current User
- Bookmark
- Subscribe
- Mute
- Printer Friendly Page
What methods are available for moving files into an HDFS Encryption Zone?
Created ‎09-28-2015 10:19 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
is distcp the best/only mechanism for moving files into an encryption zone? The documentation says so. But would an hdfs mv or cp also work just fine?
Created ‎09-28-2015 10:42 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
The 'hadoop' command-line natively supports Encryption Zones so most file system operations (copyFromLocal, put, distCp) will work.
See more example usage in the Apache Hadoop docs.
And note that there are some considerations for copying between encrypted and unencrypted locations.
Created ‎09-28-2015 10:23 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
You should be use copyFromLocal or any other commands as well to copy files into EZ. You would not be able to use mv from an EZ
Created ‎09-28-2015 10:42 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
The 'hadoop' command-line natively supports Encryption Zones so most file system operations (copyFromLocal, put, distCp) will work.
See more example usage in the Apache Hadoop docs.
And note that there are some considerations for copying between encrypted and unencrypted locations.
Created ‎09-29-2015 06:12 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
With distcp, you'll be able to encrypt a large set of data faster.
Don't forget to add the distcp command options:
--skipcrccheck --update
