Support Questions
Find answers, ask questions, and share your expertise

NiFi Kafka Consumer processor consume from multi topic sequentially

Contributor

Hi,

 

I created dataflow in NiFi, From two difference sources one from HDFS and another from kafka consumer processor merge those data push it finally put it in HDFS location. Here i need to consume data from two different topic but jobs needs to same, 

For example;

Topic A - if topic A started publishing and i wait for til end publish complete, I started consume data

Topic B - If topic B started publishing and i want to wait till the end publish completed, after that start consume data.

kafka_consumer(A,B topic) -> update attribute     

GetHDFS -> update attribute                             -> merge -> puthdfs

 

Can you please suggest me how can i do that consume from two kafka topic sequentially.