How to run a remote shell script from a NIFI cluster using NIFI.
Our API calls are written in shell script hosted on a non hadoop server. How can NIFI run that script which calls the API that has files to be imported into hdfs.
The goal is to import those files to HDFS
You can use ExecuteProcess (doesn't allow any incoming connections) (or) ExecuteStreamCommand processors to trigger the shell script.
Create a shell script on NiFi cluster(all nodes of nifi cluster) ssh into the remote machine/server and trigger your Script.
For more info refer to this link.