- Subscribe to RSS Feed
- Mark Question as New
- Mark Question as Read
- Float this Question for Current User
- Bookmark
- Subscribe
- Mute
- Printer Friendly Page
How to uncompress a zip file which is stored in HDFS?
- Labels:
-
Apache Hadoop
-
Apache Spark
-
HDFS
Created on
‎05-26-2020
02:30 AM
- last edited on
‎05-26-2020
02:40 AM
by
VidyaSargur
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
I have a zip folder stored in HDFS containing multiple video files. I want to unzip the folder in HDFS and want to access individual video file.
Can someone help me to find the solution for this?
Created ‎05-26-2020 04:28 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
You cannot directly unzip the files in HDFS. You would have to uncompress the files on local and then place it on HDFS.
You can use Hue which uses a shell action in oozie to automate this. The files are uncompressed in the local and then uploaded to HDFS.
https://gethue.com/extract-archives-as-oozie-job/
Hope this helps,
Paras
Was your question answered? Make sure to mark the answer as the accepted solution.
If you find a reply useful, say thanks by clicking on the thumbs up button.
Created ‎05-26-2020 04:28 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
You cannot directly unzip the files in HDFS. You would have to uncompress the files on local and then place it on HDFS.
You can use Hue which uses a shell action in oozie to automate this. The files are uncompressed in the local and then uploaded to HDFS.
https://gethue.com/extract-archives-as-oozie-job/
Hope this helps,
Paras
Was your question answered? Make sure to mark the answer as the accepted solution.
If you find a reply useful, say thanks by clicking on the thumbs up button.
