Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

PutHDFS behind a firewall

PutHDFS behind a firewall

Super Collaborator

Hi All, We have a HDP cluster behind a firewall and would like to use a NiFi flow from a different environment to write files (PutHDFS) to the HDP cluster. What are the approaches to achieve the same.

5 REPLIES 5

Re: PutHDFS behind a firewall

Probably you will need to use InvokeHTTP to issue a curl call to webhdfs.

There is also feature request open in regards to webhdfs processors:

https://issues.apache.org/jira/browse/NIFI-1924

In the mean time use the InvokeHTTP with curl, you might need to pass in an SSLContext into this InvokeHTTP to interact.

Re: PutHDFS behind a firewall

Super Collaborator

Thanks @milind pandit. Any known issues using InvokeHTTP? Is there a limit on the flowfile size?

Re: PutHDFS behind a firewall

Not that I aware of, as it's nifi usecase I hope you are not dealing with very huge files.

Re: PutHDFS behind a firewall

Super Collaborator

@milind pandit : Thanks Again!!

Highlighted

Re: PutHDFS behind a firewall

New Contributor

is there really no direct way???