Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

NIFI ExecuteSQL processor is returning duplicate in random

Solved Go to solution

NIFI ExecuteSQL processor is returning duplicate in random

New Contributor

Hi,

 

Nifi 1.9.2, single node, single cluster.

 

I am using 5 ExecuteSql processor to bulk collect records from Oracle DB.

(each select query suppose to pick separate set of one fifth of total volume, logic is based on MOD function).

Predecessor for all the executesql processors is same (generateflowfile processor).

 

ExecuteSql processors are configured as ("TIMER Driven", concurrent task=40, run schedule=30 sec, "maximum rows per flowfile"=500 and "output batch size"=1).

We are starting the nifi flow, then generateflowfile processor is generating one flow file which is triggering executeSql processors.

 

But randomly in some of the runs, data is getting duplicated. 

 

Not sure if this is the issue with concurrent tasks or timer driven property.

Please help.

1 ACCEPTED SOLUTION

Accepted Solutions
Highlighted

Re: NIFI ExecuteSQL processor is returning duplicate in random

New Contributor

Please ignore. Problem was not in the configurations. 

View solution in original post

1 REPLY 1
Highlighted

Re: NIFI ExecuteSQL processor is returning duplicate in random

New Contributor

Please ignore. Problem was not in the configurations. 

View solution in original post

Don't have an account?
Coming from Hortonworks? Activate your account here