Support Questions
Find answers, ask questions, and share your expertise

WebHDFS Download / Copy to local from HDFS to local path?

Highlighted

WebHDFS Download / Copy to local from HDFS to local path?

Explorer

Hi,

I've implemented a Python wrapper around the webhdfs api (via Knox) for end users to script operations outside the cluster. The one core operation missing I'd like to add is "hadoop fs -copyToLocal'. It seems that only open is supported and possible operations to direct the buffter to a file is possible.

Is there any way to copy an HDFS file to a local path using webhdfs?

1 REPLY 1
Highlighted

Re: WebHDFS Download / Copy to local from HDFS to local path?

Contributor

Not an answer, Wouldn't that be a security issue where the local hdfs gets used up? What is the use case for it. WebHDFS is a REST based app.. you can try exploring adding api.