Is a good practice to share the same DBCPConnectionPool between several process groups or it is better to have one DBCPConnectionPool assigned to each process group? I currently have 16 process groups that share the same DBCPConnectionPool which is at root level. There are 41 processors that are referencing that DBCPConnectionPool. If it is a good practice, what is the recommended configuration so that performance is not affected? I currently have it configured this way: Max Wait Time: 500 millis. Max Total Connections: -1 Minimum Idle Connections: 0 Max Idle Connections: 8 Max Connection Lifetime: -1 Time Between Eviction Runs: -1 Minimum Evictable Idle Time: 30 mins Soft Minimum Evictable Idle Time: -1 Thanks in advance! ... View more

I'm working with NIFI and PutDataBaseRecord to insert records to tables. I am simulating the case that the database is down in order to handle the error (to send an mail indicating connection time out for example ). The problem is when I disconnect the net cable to simulate the error and turns on PutDataBaseRecord the flows do not pass either to the relationship of failure, or to the relationship of retry and the processor sends bulletin error messages continually, it never stops sending messages. I put 10 seconds in the "Max wait time" property with the hope that after that time the processor stops throwing errors and sends the flows to the fault relationship, but it does not work. Thanks in advance! ... View more

I'm migrating a table (2 millions of rows) from DB2 to SQL Server. I'm using the next flow: 1. ExecuteSQL (to select records from the Db2 table). 2. SplitAvro (to split the records. I configured it with Output Size = 1 to control the case that if one fails the rest is inserted without problems. 3. PutDataBaseRecord (to insert the records in the SQL Server table). 4. ExecuteSQL (I need to call a stored procedure that executes update sentences against the same table that PutDataBaseRecord is working to). The problem is the second ExecuteSQL is running before PutDataBaseRecord complete the insertion of all records. How can I tell nifi to run that processor only when the other one finishes? Thanks in advance! ... View more

I need to migrate the data from a db2 table to a mssql table but one column has a different name, but the same datatype. Db2 table: NROCTA,NUMRUT,DIASMORA2 MSSQL table: NROCTA,NUMRUT,DIAMORAS As you see DIAMORAS is different. Im using the following flow: ExecuteSQL -> SplitAvro -> PutDatabaseRecord In PutDataBaseRecord I have as RecordReader an AvroReader configured in this way: Schema Acesss Strategy: Use Embedded Avro Schema. Schema Text: ${avro.schema} The flow just insert the two first columns.¿How I can do the mapping between DIASMORA2 and DIAMORAS columns ? Thanks in advance! ... View more

Hi everybody, please help! I'm working in NIFI with PutDataBaseRecord to insert the data of a csv file to a database table. Everything goes well in the first execution because there is no data in the table. Then I modify the file so it contains new records and existing ones. PutDataBaseRecord fails because of existing records (primary key constraint) but it doesn´t insert the new records. Is there any way to configure the processor to instruct it to insert the new records and ignore the ones that failed? I attached pictures how my processor is configured. Thanks in advance. ... View more

Please help! I'm reading three types of files thru ListFtp, for example: TRB_TIT_D190125.txt TRB_SEG_D190125.txt TRB_ASE_D190125.txt I need to process the "TIT" file in first place. I need to read the data and insert the data to a table. After all the inserts finish I must process the "SEG" and "ASE" files. I'm using wait and notify using fragment.count and fragment.identifier and it works, but I can´t connect Wait to ListFTP to get the files SEG and POS again, because ListFTP doesn't have entry point, it always runs in parallel. I put a second wait to control the flow that process "SEG" and "ASE" files, the but it has no way of knowing fragment.count and fragment.identifier. I am attaching an image that explains the problem. Thanks in advance! Wait configuration. Notify configuration ... View more