Can you elaborate more on what you are trying to split? The transactions in the first and second split you specified seem to be identical. ... View more

Hi,   You can try the following spec:   [ { "operation": "shift", "spec": { "*": "&", "responseData": { "responseList": { "*": { "individualInfo": { "#${UUID()}": "responseData.responseList.[&2].individualInfo.activityUID", "firstName": "responseData.responseList.[&2].individualInfo.&", "middleName": "responseData.responseList.[&2].individualInfo.&", "lastName": "responseData.responseList.[&2].individualInfo.&", "dateOfBirth": "responseData.responseList.[&2].individualInfo.&" } } } } } } ]   If that helps please accept solution. Thanks ... View more

Are you referring to validation failures?  If this is what you are referring to then the answer is, you can't.  If you get failures then you'll need to queue the failures up and validate them manually to see why they failed.  I use xmllint.  For example:  xmllint --noout --schema my_data_schema.xsd my_data.xml     ... View more

Good morning @cotopaul @SAMSAL First of all thank you very much for your time Ok Ok so I see that I missunderstood how QueryDatabaseTable is "triggered". @SAMSAL I knew about those configuration but as I said I thought this processor only do the query when a new record is inserted in the database taking reference the maximum column value. Makes sense now the postgresql log...the querys executed every second since my RunSchedule is on default (0).  What I use minifi for is to load sales from a supermarket then send it via API (and others transformations), so I need this to be in real time as soon as the client paid. I guess I have to define Run Schedule every few seconds. @cotopaul I will take a look at my DBCPConnectionPool, this info it´s helpfull Thank you all.  ... View more

Hi @MWM ,   What you are describing is a classical data enrichment pattern that can be achieved using ForkEnrichment & JoinEnrichment processors. For more information on this please refer to : https://nifi.apache.org/docs/nifi-docs/components/org.apache.nifi/nifi-standard-nar/1.20.0/org.apache.nifi.processors.standard.JoinEnrichment/additionalDetails.html   Based on your scenario the "SQL" strategy of the JoinEnrichment will work the best for you since you can select the main fields (system, name, surname, phone, mail) from the original flowfile data and select proffesion and department from enrichment result:   SELECT o.system, o.name, e.surname,o.phone, o.mail, e.profession, e.department FROM original o LEFT OUTER JOIN enrichment e ON o.name= e.name Since you are splitting the CSV and enrich per record then you can just join by name. If you have an API where you can get a collection of user information then you dont have to split and you can do the enrichment on multiple records from the CSV vs. returned records from the API json output , however be aware that if you have large data set this strategy "... can lead to heap exhaustion and cause stability problems or OutOfMemoryErrors to occur". Please review the link above to see how this can be mitigated.   If you find this is helpful please accept solution. Thanks     ... View more

I see, it work! Thanks for your information ... View more

Hi @Anderosn, Similar question was asked before, see if the following posts can help: https://community.cloudera.com/t5/Support-Questions/How-to-load-json-record-to-postgres-as-json-datatype/m-p/345779#M234644 https://community.cloudera.com/t5/Support-Questions/Apache-Nifi-Insert-json-data-into-table-as-single-column/m-p/363974 https://community.cloudera.com/t5/Support-Questions/nifi-Writing-Inserting-entire-flowfile-content/td-p/205367   If Any of the links work for your case please accept solution. Thanks ... View more

Thanks @SAMSAL  it worked for me... ... View more