- last edited on
Hi, In my use case, I want to use NiFi to transfer data from multiple source to multiple target.
In this, we are scheduling a pipeline with multiple hops. One of these hops would be a NiFi Job to carry out the data transfer.
Ex : Hop1 ---> Hop2----> Hop3
Hop1 : Add data to Hadoop.
Hop2 : Using NiFi read from Hadoop, Write to MySQL.
Hop3 : Run the required Job in MySQL.
I am interested in knowing 2 things here.
a. How to start the NiFi Process group through API.
Is there a way we can generate a flow file through a rest call?
b. Know when the transfer process is completed.
The trick here is that the NiFi cluster we are using is 3 node setup. How do we find the convergance/ completion of the flow.