Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Setting a 'Batch Duration' for ExecuteProcess only produces one batch

Highlighted

Setting a 'Batch Duration' for ExecuteProcess only produces one batch

I have set up an ExecuteProcess processor that continuously downloads data. Since the script that it's processing essentially has no end time I want to output the data to NiFi in intervals. I had set 'Batch Duration' to `15 sec` to do exactly this. Unfortunately this leads to only a single FlowFile being produced after roughly 15 seconds. The processor seems to be running but stops outputting any data after that initial FlowFile. Is this a known bug or am I supposed to change another processor parameter in addition to 'Batch Duration' for this to work as described?

Please let me know if you need any more information from my side. Any help is appreciated.

Don't have an account?
Coming from Hortonworks? Activate your account here