Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

NiFi Kafka Consumer processor consume from multi topic sequentially

NiFi Kafka Consumer processor consume from multi topic sequentially

Contributor

Hi,

 

I created dataflow in NiFi, From two difference sources one from HDFS and another from kafka consumer processor merge those data push it finally put it in HDFS location. Here i need to consume data from two different topic but jobs needs to same, 

For example;

Topic A - if topic A started publishing and i wait for til end publish complete, I started consume data

Topic B - If topic B started publishing and i want to wait till the end publish completed, after that start consume data.

kafka_consumer(A,B topic) -> update attribute     

GetHDFS -> update attribute                             -> merge -> puthdfs

 

Can you please suggest me how can i do that consume from two kafka topic sequentially. 

 

 

 

Don't have an account?
Coming from Hortonworks? Activate your account here