Member since
10-21-2019
1
Post
0
Kudos Received
0
Solutions
10-21-2019
08:57 PM
Hi, I'm a newbie to nifi and i have a scenario where consume kafka record processor fetches 10 million records(not in a single queue/flowfile). The consume kafka records processor runs for a certain amount of time.I need to merge all these flowfiles into a single flowfile. The problem is , when the processor first runs, it fetches few flowfiles and these flowfiles need to be held until the same processor finishes running and gets the remaining flowfiles. Is there a way i can do it. I have tried to pull the 10 million records in a single flowfile which seems not possible and not a best practice either. Please help
... View more
Labels:
- Labels:
-
Apache NiFi