Created 03-18-2018 02:49 AM
Hi,
Is there a way to kick off multiple Nifi jobs in parallel ? For example, when it comes to sqoop we can kick off 10 different sqoop jobs at the same time in oozie, because they are all separate , I can do that, there is no restriction on that, but if I do this in Nifi, how does that work? Appreciate any help.
Created on 03-18-2018 02:09 PM - edited 08-18-2019 12:54 AM
Want to get a detailed solution you have to login/registered on the community
Register/LoginCreated on 03-18-2018 02:09 PM - edited 08-18-2019 12:54 AM
Want to get a detailed solution you have to login/registered on the community
Register/LoginCreated 03-18-2018 04:32 PM
@ Rahul soni - Thanks so much for the detailed explanation.we have a custom scheduler which decides the number of jobs to run and this triggers the oozie API, which triggers the particular workflow like sqoop or Kafka whatever.So this workflow will go get the properties for the respective workflow and run the jobs.We are looking forward to replace the sqoop workflow with nifi.I have been doing some POC’s on nifi lately and realized that it has the capability to handle the load and was not sure how it would work in scheduling jobs like sqoop.Anyway your answer has given me a benefit of hope.