question Re: Apache Nifi to do aggregation for the given transformed json based on attribute name in the json in Support Questions https://community.cloudera.com/t5/Support-Questions/Apache-Nifi-to-do-aggregation-for-the-given-transformed-json/m-p/301432#M220666 <P><a href="https://community.cloudera.com/t5/user/viewprofilepage/user-id/78451">@Seetha</a>&nbsp;This is a very common use case for NiFi and JSON processing pipelines.</P><P>&nbsp;</P><P>Here is a link that explains a solution (ExecuteScript) you could use:</P><P>&nbsp;</P><P><A href="https://community.cloudera.com/t5/Support-Questions/Apache-Nifi-How-to-calculate-SUM-or-AVERAGE-of-values-in-a/td-p/164131" target="_blank">https://community.cloudera.com/t5/Support-Questions/Apache-Nifi-How-to-calculate-SUM-or-AVERAGE-of-values-in-a/td-p/164131</A></P><P>&nbsp;</P><P>Additional&nbsp;<a href="https://community.cloudera.com/t5/user/viewprofilepage/user-id/38301">@mburgess</a>&nbsp;&nbsp;in that posts links a JIRA for a new Processor he was trying to work on at the time. &nbsp;The end result of that JIRA is his recommendation that QueryRecord processor should give you the ability to calculate the sum. &nbsp; Using QueryRecord you would read the values and be able to create a fabricated sql query to calculate the sums. &nbsp;Then you would use a RecordWriter to re-write the orginal json object with the sums, or to create completely different json object with the sums.</P><P>&nbsp;</P><P>&nbsp;</P><P>If this answer resolves your issue or allows you to move forward, please choose to ACCEPT this solution and close this topic. If you have further dialogue on this topic please comment here or feel free to private message me. If you have new questions related to your Use Case please create separate topic and feel free to tag me in your post. &nbsp;</P><P>&nbsp;</P><P>Thanks,</P><P><BR />Steven&nbsp;@ DFHZ</P> Thu, 13 Aug 2020 12:04:08 GMT stevenmatison 2020-08-13T12:04:08Z Apache Nifi to do aggregation for the given transformed json based on attribute name in the json https://community.cloudera.com/t5/Support-Questions/Apache-Nifi-to-do-aggregation-for-the-given-transformed-json/m-p/296764#M218404 <P><BR />Hi Team ,</P><P>I need help in converting the given csv to json format .</P><P>This is the input csv.</P><P>EMP,EVSEID,SessionID,Starttime,Endtime,Totalchargeamount,Totalduration,Totalcosts<BR />3023513,AT*HTB*E1002760,b8ed2c41-4a0a-4528-9f14-4c4f040de81e,15:06:56 26.10.2019,15:42:59 26.10.2019,5890,2163,2.592<BR />2899202,AT*HTB*E1001927,ee3a1d64-2a69-4d43-87a4-4e23cb992660,16:24:11 08.10.2019,19:00:24 08.10.2019,6430,9373,3.78<BR />2974330,DE*BOX*EAC0016,25543dea-6d58-4c27-a924-dacc01a83162,12:33:09 19.10.2019,15:29:58 19.10.2019,13700,10609,6.028.</P><P><BR />I am able to convert the given csv to json output .</P><P>Need to add additional<BR />header and footer tag, Footer tag will be holding the aggregated value of the totalcosts given in the csv file.</P><P>I am stuck in the process of performing aggregation based on the totalcosts.</P><P>&nbsp;</P><P>Attached the generated json and expected json format</P><P>&nbsp;</P><P>Below table is having generated json.</P><LI-CODE lang="markup">[ { "record" : { "EMP" : "3023513", "EVSEID" : "AT*HTB*E1002760", "SessionID" : "b8ed2c41-4a0a-4528-9f14-4c4f040de81e", "Starttime" : "15:06:56 26.10.2019", "Endtime" : "15:42:59 26.10.2019", "Totalchargeamount" : "5890", "Totalduration" : "2163", "Totalcosts" : 2.592 } }, { "record" : { "EMP" : "2899202", "EVSEID" : "AT*HTB*E1001927", "SessionID" : "ee3a1d64-2a69-4d43-87a4-4e23cb992660", "Starttime" : "16:24:11 08.10.2019", "Endtime" : "19:00:24 08.10.2019", "Totalchargeamount" : "6430", "Totalduration" : "9373", "Totalcosts" : 3.78 } }, { "record" : { "EMP" : "2974330", "EVSEID" : "DE*BOX*EAC0016", "SessionID" : "25543dea-6d58-4c27-a924-dacc01a83162", "Starttime" : "12:33:09 19.10.2019", "Endtime" : "15:29:58 19.10.2019", "Totalchargeamount" : "13700", "Totalduration" : "10609", "Totalcosts" : 6.028 } }, { "record" : { "EMP" : "2871249", "EVSEID" : "DE*EWE*E0237*1", "SessionID" : "ccc5050c-c708-4f5e-b240-70ecb248a491", "Starttime" : "11:24:41 04.10.2019", "Endtime" : "12:44:07 04.10.2019", "Totalchargeamount" : "6117", "Totalduration" : "4766", "Totalcosts" : 6 } }, { "record" : { "EMP" : "2928555", "EVSEID" : "AT*HTB*E1000955", "SessionID" : "a3941853-55f8-4c01-93ef-cd3b03f6c466", "Starttime" : "11:20:02 13.10.2019", "Endtime" : "11:39:12 13.10.2019", "Totalchargeamount" : "14000", "Totalduration" : "1150", "Totalcosts" : 7.7 } }</LI-CODE><P>&nbsp;</P><P>Expected output is as below</P><LI-CODE lang="markup">Extra tag needs to be added along with the above json numberOfRecords - sum of all therecords totalCosts : sum of all the costs in individual records { "dataRecordTrailer": { "numberOfRecords": "6", "totalCosts": 27.1 } }</LI-CODE><P>Flow file template details</P><LI-CODE lang="markup">&lt;?xml version="1.0" encoding="UTF-8" standalone="yes"?&gt; &lt;template encoding-version="1.3"&gt; &lt;description&gt;&lt;/description&gt; &lt;groupId&gt;276b7fbd-0172-1000-60f9-afcd61d29acf&lt;/groupId&gt; &lt;name&gt;Sprint7PocTemplate&lt;/name&gt; &lt;snippet&gt; &lt;controllerServices&gt; &lt;id&gt;5f712eb5-b76b-3e9f-0000-000000000000&lt;/id&gt; &lt;parentGroupId&gt;247dfa5d-d32a-3c9d-0000-000000000000&lt;/parentGroupId&gt; &lt;bundle&gt; &lt;artifact&gt;nifi-record-serialization-services-nar&lt;/artifact&gt; &lt;group&gt;org.apache.nifi&lt;/group&gt; &lt;version&gt;1.11.4&lt;/version&gt; &lt;/bundle&gt; &lt;comments&gt;&lt;/comments&gt; &lt;descriptors&gt; &lt;entry&gt; &lt;key&gt;ignore-csv-header&lt;/key&gt; &lt;value&gt; &lt;name&gt;ignore-csv-header&lt;/name&gt; &lt;/value&gt; &lt;/entry&gt; &lt;entry&gt; &lt;key&gt;schema-branch&lt;/key&gt; &lt;value&gt; &lt;name&gt;schema-branch&lt;/name&gt; &lt;/value&gt; &lt;/entry&gt; &lt;entry&gt; &lt;key&gt;CSV Format&lt;/key&gt; &lt;value&gt; &lt;name&gt;CSV Format&lt;/name&gt; &lt;/value&gt; &lt;/entry&gt; &lt;entry&gt; &lt;key&gt;Quote Character&lt;/key&gt; &lt;value&gt; &lt;name&gt;Quote Character&lt;/name&gt; &lt;/value&gt; &lt;/entry&gt; &lt;entry&gt; &lt;key&gt;Value Separator&lt;/key&gt; &lt;value&gt; &lt;name&gt;Value Separator&lt;/name&gt; &lt;/value&gt; &lt;/entry&gt; &lt;entry&gt; &lt;key&gt;Timestamp Format&lt;/key&gt; &lt;value&gt; &lt;name&gt;Timestamp Format&lt;/name&gt; &lt;/value&gt; &lt;/entry&gt; &lt;entry&gt; &lt;key&gt;Escape Character&lt;/key&gt; &lt;value&gt; &lt;name&gt;Escape Character&lt;/name&gt; &lt;/value&gt; &lt;/entry&gt; &lt;entry&gt; &lt;key&gt;Date Format&lt;/key&gt; &lt;value&gt; &lt;name&gt;Date Format&lt;/name&gt; &lt;/value&gt; &lt;/entry&gt; &lt;entry&gt; &lt;key&gt;Null String&lt;/key&gt; &lt;value&gt; &lt;name&gt;Null String&lt;/name&gt; &lt;/value&gt; &lt;/entry&gt; &lt;entry&gt; &lt;key&gt;Skip Header Line&lt;/key&gt; &lt;value&gt; &lt;name&gt;Skip Header Line&lt;/name&gt; &lt;/value&gt; &lt;/entry&gt; &lt;entry&gt; &lt;key&gt;Trim Fields&lt;/key&gt; &lt;value&gt; &lt;name&gt;Trim Fields&lt;/name&gt; &lt;/value&gt; &lt;/entry&gt; &lt;entry&gt; &lt;key&gt;schema-name&lt;/key&gt; &lt;value&gt; &lt;name&gt;schema-name&lt;/name&gt; &lt;/value&gt; &lt;/entry&gt; &lt;entry&gt; &lt;key&gt;schema-registry&lt;/key&gt; &lt;value&gt; &lt;identifiesControllerService&gt;org.apache.nifi.schemaregistry.services.SchemaRegistry&lt;/identifiesControllerService&gt; &lt;name&gt;schema-registry&lt;/name&gt; &lt;/value&gt; &lt;/entry&gt; &lt;entry&gt; &lt;key&gt;csv-reader-csv-parser&lt;/key&gt; &lt;value&gt; &lt;name&gt;csv-reader-csv-parser&lt;/name&gt; &lt;/value&gt; &lt;/entry&gt; &lt;entry&gt; &lt;key&gt;Time Format&lt;/key&gt; &lt;value&gt; &lt;name&gt;Time Format&lt;/name&gt; &lt;/value&gt; &lt;/entry&gt; &lt;entry&gt; &lt;key&gt;Comment Marker&lt;/key&gt; &lt;value&gt; &lt;name&gt;Comment Marker&lt;/name&gt; &lt;/value&gt; &lt;/entry&gt; &lt;entry&gt; &lt;key&gt;schema-access-strategy&lt;/key&gt; &lt;value&gt; &lt;name&gt;schema-access-strategy&lt;/name&gt; &lt;/value&gt; &lt;/entry&gt; &lt;entry&gt; &lt;key&gt;schema-version&lt;/key&gt; &lt;value&gt; &lt;name&gt;schema-version&lt;/name&gt; &lt;/value&gt; &lt;/entry&gt; &lt;entry&gt; &lt;key&gt;csvutils-character-set&lt;/key&gt; &lt;value&gt; &lt;name&gt;csvutils-character-set&lt;/name&gt; &lt;/value&gt; &lt;/entry&gt; &lt;entry&gt; &lt;key&gt;schema-text&lt;/key&gt; &lt;value&gt; &lt;name&gt;schema-text&lt;/name&gt; &lt;/value&gt; &lt;/entry&gt; &lt;/descriptors&gt; &lt;name&gt;DemoCSVReader&lt;/name&gt; &lt;persistsState&gt;false&lt;/persistsState&gt; &lt;properties&gt; &lt;entry&gt; &lt;key&gt;ignore-csv-header&lt;/key&gt; &lt;value&gt;false&lt;/value&gt; &lt;/entry&gt; &lt;entry&gt; &lt;key&gt;schema-branch&lt;/key&gt; &lt;/entry&gt; &lt;entry&gt; &lt;key&gt;CSV Format&lt;/key&gt; &lt;value&gt;custom&lt;/value&gt; &lt;/entry&gt; &lt;entry&gt; &lt;key&gt;Quote Character&lt;/key&gt; &lt;value&gt;"&lt;/value&gt; &lt;/entry&gt; &lt;entry&gt; &lt;key&gt;Value Separator&lt;/key&gt; &lt;value&gt;,&lt;/value&gt; &lt;/entry&gt; &lt;entry&gt; &lt;key&gt;Timestamp Format&lt;/key&gt; &lt;/entry&gt; &lt;entry&gt; &lt;key&gt;Escape Character&lt;/key&gt; &lt;value&gt;\&lt;/value&gt; &lt;/entry&gt; &lt;entry&gt; &lt;key&gt;Date Format&lt;/key&gt; &lt;/entry&gt; &lt;entry&gt; &lt;key&gt;Null String&lt;/key&gt; &lt;/entry&gt; &lt;entry&gt; &lt;key&gt;Skip Header Line&lt;/key&gt; &lt;value&gt;true&lt;/value&gt; &lt;/entry&gt; &lt;entry&gt; &lt;key&gt;Trim Fields&lt;/key&gt; &lt;value&gt;true&lt;/value&gt; &lt;/entry&gt; &lt;entry&gt; &lt;key&gt;schema-name&lt;/key&gt; &lt;value&gt;${rejectionreport}&lt;/value&gt; &lt;/entry&gt; &lt;entry&gt; &lt;key&gt;schema-registry&lt;/key&gt; &lt;value&gt;d3aa8327-7bdb-3fca-0000-000000000000&lt;/value&gt; &lt;/entry&gt; &lt;entry&gt; &lt;key&gt;csv-reader-csv-parser&lt;/key&gt; &lt;value&gt;commons-csv&lt;/value&gt; &lt;/entry&gt; &lt;entry&gt; &lt;key&gt;Time Format&lt;/key&gt; &lt;/entry&gt; &lt;entry&gt; &lt;key&gt;Comment Marker&lt;/key&gt; &lt;/entry&gt; &lt;entry&gt; &lt;key&gt;schema-access-strategy&lt;/key&gt; &lt;value&gt;csv-header-derived&lt;/value&gt; &lt;/entry&gt; &lt;entry&gt; &lt;key&gt;schema-version&lt;/key&gt; &lt;/entry&gt; &lt;entry&gt; &lt;key&gt;csvutils-character-set&lt;/key&gt; &lt;value&gt;UTF-8&lt;/value&gt; &lt;/entry&gt; &lt;entry&gt; &lt;key&gt;schema-text&lt;/key&gt; &lt;/entry&gt; &lt;/properties&gt; &lt;state&gt;ENABLED&lt;/state&gt; &lt;type&gt;org.apache.nifi.csv.CSVReader&lt;/type&gt; &lt;/controllerServices&gt; &lt;controllerServices&gt; &lt;id&gt;d3aa8327-7bdb-3fca-0000-000000000000&lt;/id&gt; &lt;parentGroupId&gt;247dfa5d-d32a-3c9d-0000-000000000000&lt;/parentGroupId&gt; &lt;bundle&gt; &lt;artifact&gt;nifi-registry-nar&lt;/artifact&gt; &lt;group&gt;org.apache.nifi&lt;/group&gt; &lt;version&gt;1.11.4&lt;/version&gt; &lt;/bundle&gt; &lt;comments&gt;&lt;/comments&gt; &lt;descriptors&gt; &lt;entry&gt; &lt;key&gt;avro-reg-validated-field-names&lt;/key&gt; &lt;value&gt; &lt;name&gt;avro-reg-validated-field-names&lt;/name&gt; &lt;/value&gt; &lt;/entry&gt; &lt;entry&gt; &lt;key&gt;rejectionreport&lt;/key&gt; &lt;value&gt; &lt;name&gt;rejectionreport&lt;/name&gt; &lt;/value&gt; &lt;/entry&gt; &lt;/descriptors&gt; &lt;name&gt;DemoAvroSchemaRegistry&lt;/name&gt; &lt;persistsState&gt;false&lt;/persistsState&gt; &lt;properties&gt; &lt;entry&gt; &lt;key&gt;avro-reg-validated-field-names&lt;/key&gt; &lt;value&gt;true&lt;/value&gt; &lt;/entry&gt; &lt;entry&gt; &lt;key&gt;rejectionreport&lt;/key&gt; &lt;value&gt;{ "name": "rejectionreport", "namespace": "org.apache.avro", "type": "record", "fields": [ {"name": "EMP" , "type" : "string"}, {"name": "EVSEID" , "type" : "string"}, {"name": "SessionID" , "type" : "string"}, {"name": "Starttime" , "type" : "string"}, {"name": "Endtime" , "type" : "string"}, {"name": "Totalchargeamount" , "type" : "string"}, {"name": "Totalduration" , "type" : "string"}, {"name": "Totalcosts" , "type" : "string"} ] }&lt;/value&gt; &lt;/entry&gt; &lt;/properties&gt; &lt;state&gt;ENABLED&lt;/state&gt; &lt;type&gt;org.apache.nifi.schemaregistry.services.AvroSchemaRegistry&lt;/type&gt; &lt;/controllerServices&gt; &lt;controllerServices&gt; &lt;id&gt;f3c04453-2b4a-37bc-0000-000000000000&lt;/id&gt; &lt;parentGroupId&gt;247dfa5d-d32a-3c9d-0000-000000000000&lt;/parentGroupId&gt; &lt;bundle&gt; &lt;artifact&gt;nifi-record-serialization-services-nar&lt;/artifact&gt; &lt;group&gt;org.apache.nifi&lt;/group&gt; &lt;version&gt;1.11.4&lt;/version&gt; &lt;/bundle&gt; &lt;comments&gt;&lt;/comments&gt; &lt;descriptors&gt; &lt;entry&gt; &lt;key&gt;schema-branch&lt;/key&gt; &lt;value&gt; &lt;name&gt;schema-branch&lt;/name&gt; &lt;/value&gt; &lt;/entry&gt; &lt;entry&gt; &lt;key&gt;compression-level&lt;/key&gt; &lt;value&gt; &lt;name&gt;compression-level&lt;/name&gt; &lt;/value&gt; &lt;/entry&gt; &lt;entry&gt; &lt;key&gt;schema-cache&lt;/key&gt; &lt;value&gt; &lt;identifiesControllerService&gt;org.apache.nifi.serialization.RecordSchemaCacheService&lt;/identifiesControllerService&gt; &lt;name&gt;schema-cache&lt;/name&gt; &lt;/value&gt; &lt;/entry&gt; &lt;entry&gt; &lt;key&gt;Timestamp Format&lt;/key&gt; &lt;value&gt; &lt;name&gt;Timestamp Format&lt;/name&gt; &lt;/value&gt; &lt;/entry&gt; &lt;entry&gt; &lt;key&gt;Date Format&lt;/key&gt; &lt;value&gt; &lt;name&gt;Date Format&lt;/name&gt; &lt;/value&gt; &lt;/entry&gt; &lt;entry&gt; &lt;key&gt;Pretty Print JSON&lt;/key&gt; &lt;value&gt; &lt;name&gt;Pretty Print JSON&lt;/name&gt; &lt;/value&gt; &lt;/entry&gt; &lt;entry&gt; &lt;key&gt;compression-format&lt;/key&gt; &lt;value&gt; &lt;name&gt;compression-format&lt;/name&gt; &lt;/value&gt; &lt;/entry&gt; &lt;entry&gt; &lt;key&gt;Schema Write Strategy&lt;/key&gt; &lt;value&gt; &lt;name&gt;Schema Write Strategy&lt;/name&gt; &lt;/value&gt; &lt;/entry&gt; &lt;entry&gt; &lt;key&gt;suppress-nulls&lt;/key&gt; &lt;value&gt; &lt;name&gt;suppress-nulls&lt;/name&gt; &lt;/value&gt; &lt;/entry&gt; &lt;entry&gt; &lt;key&gt;output-grouping&lt;/key&gt; &lt;value&gt; &lt;name&gt;output-grouping&lt;/name&gt; &lt;/value&gt; &lt;/entry&gt; &lt;entry&gt; &lt;key&gt;schema-name&lt;/key&gt; &lt;value&gt; &lt;name&gt;schema-name&lt;/name&gt; &lt;/value&gt; &lt;/entry&gt; &lt;entry&gt; &lt;key&gt;schema-registry&lt;/key&gt; &lt;value&gt; &lt;identifiesControllerService&gt;org.apache.nifi.schemaregistry.services.SchemaRegistry&lt;/identifiesControllerService&gt; &lt;name&gt;schema-registry&lt;/name&gt; &lt;/value&gt; &lt;/entry&gt; &lt;entry&gt; &lt;key&gt;Time Format&lt;/key&gt; &lt;value&gt; &lt;name&gt;Time Format&lt;/name&gt; &lt;/value&gt; &lt;/entry&gt; &lt;entry&gt; &lt;key&gt;schema-access-strategy&lt;/key&gt; &lt;value&gt; &lt;name&gt;schema-access-strategy&lt;/name&gt; &lt;/value&gt; &lt;/entry&gt; &lt;entry&gt; &lt;key&gt;schema-version&lt;/key&gt; &lt;value&gt; &lt;name&gt;schema-version&lt;/name&gt; &lt;/value&gt; &lt;/entry&gt; &lt;entry&gt; &lt;key&gt;schema-text&lt;/key&gt; &lt;value&gt; &lt;name&gt;schema-text&lt;/name&gt; &lt;/value&gt; &lt;/entry&gt; &lt;/descriptors&gt; &lt;name&gt;DemoJsonRecordSetWriter&lt;/name&gt; &lt;persistsState&gt;false&lt;/persistsState&gt; &lt;properties&gt; &lt;entry&gt; &lt;key&gt;schema-branch&lt;/key&gt; &lt;/entry&gt; &lt;entry&gt; &lt;key&gt;compression-level&lt;/key&gt; &lt;value&gt;1&lt;/value&gt; &lt;/entry&gt; &lt;entry&gt; &lt;key&gt;schema-cache&lt;/key&gt; &lt;/entry&gt; &lt;entry&gt; &lt;key&gt;Timestamp Format&lt;/key&gt; &lt;/entry&gt; &lt;entry&gt; &lt;key&gt;Date Format&lt;/key&gt; &lt;/entry&gt; &lt;entry&gt; &lt;key&gt;Pretty Print JSON&lt;/key&gt; &lt;value&gt;true&lt;/value&gt; &lt;/entry&gt; &lt;entry&gt; &lt;key&gt;compression-format&lt;/key&gt; &lt;value&gt;none&lt;/value&gt; &lt;/entry&gt; &lt;entry&gt; &lt;key&gt;Schema Write Strategy&lt;/key&gt; &lt;value&gt;schema-name&lt;/value&gt; &lt;/entry&gt; &lt;entry&gt; &lt;key&gt;suppress-nulls&lt;/key&gt; &lt;value&gt;never-suppress&lt;/value&gt; &lt;/entry&gt; &lt;entry&gt; &lt;key&gt;output-grouping&lt;/key&gt; &lt;value&gt;output-array&lt;/value&gt; &lt;/entry&gt; &lt;entry&gt; &lt;key&gt;schema-name&lt;/key&gt; &lt;value&gt;rejectionreport&lt;/value&gt; &lt;/entry&gt; &lt;entry&gt; &lt;key&gt;schema-registry&lt;/key&gt; &lt;value&gt;d3aa8327-7bdb-3fca-0000-000000000000&lt;/value&gt; &lt;/entry&gt; &lt;entry&gt; &lt;key&gt;Time Format&lt;/key&gt; &lt;/entry&gt; &lt;entry&gt; &lt;key&gt;schema-access-strategy&lt;/key&gt; &lt;value&gt;schema-name&lt;/value&gt; &lt;/entry&gt; &lt;entry&gt; &lt;key&gt;schema-version&lt;/key&gt; &lt;/entry&gt; &lt;entry&gt; &lt;key&gt;schema-text&lt;/key&gt; &lt;/entry&gt; &lt;/properties&gt; &lt;state&gt;ENABLED&lt;/state&gt; &lt;type&gt;org.apache.nifi.json.JsonRecordSetWriter&lt;/type&gt; &lt;/controllerServices&gt; &lt;processGroups&gt; &lt;id&gt;5db4d3b6-1a02-390f-0000-000000000000&lt;/id&gt; &lt;parentGroupId&gt;247dfa5d-d32a-3c9d-0000-000000000000&lt;/parentGroupId&gt; &lt;position&gt; &lt;x&gt;0.0&lt;/x&gt; &lt;y&gt;0.0&lt;/y&gt; &lt;/position&gt; &lt;comments&gt;&lt;/comments&gt; &lt;contents&gt; &lt;connections&gt; &lt;id&gt;56a67400-a9c8-3de8-0000-000000000000&lt;/id&gt; &lt;parentGroupId&gt;5db4d3b6-1a02-390f-0000-000000000000&lt;/parentGroupId&gt; &lt;backPressureDataSizeThreshold&gt;1 GB&lt;/backPressureDataSizeThreshold&gt; &lt;backPressureObjectThreshold&gt;10000&lt;/backPressureObjectThreshold&gt; &lt;destination&gt; &lt;groupId&gt;5db4d3b6-1a02-390f-0000-000000000000&lt;/groupId&gt; &lt;id&gt;d80993a9-f700-3ce7-0000-000000000000&lt;/id&gt; &lt;type&gt;PROCESSOR&lt;/type&gt; &lt;/destination&gt; &lt;flowFileExpiration&gt;0 sec&lt;/flowFileExpiration&gt; &lt;labelIndex&gt;1&lt;/labelIndex&gt; &lt;loadBalanceCompression&gt;DO_NOT_COMPRESS&lt;/loadBalanceCompression&gt; &lt;loadBalancePartitionAttribute&gt;&lt;/loadBalancePartitionAttribute&gt; &lt;loadBalanceStatus&gt;LOAD_BALANCE_NOT_CONFIGURED&lt;/loadBalanceStatus&gt; &lt;loadBalanceStrategy&gt;DO_NOT_LOAD_BALANCE&lt;/loadBalanceStrategy&gt; &lt;name&gt;&lt;/name&gt; &lt;selectedRelationships&gt;success&lt;/selectedRelationships&gt; &lt;source&gt; &lt;groupId&gt;5db4d3b6-1a02-390f-0000-000000000000&lt;/groupId&gt; &lt;id&gt;2e4486df-8884-3693-0000-000000000000&lt;/id&gt; &lt;type&gt;PROCESSOR&lt;/type&gt; &lt;/source&gt; &lt;zIndex&gt;0&lt;/zIndex&gt; &lt;/connections&gt; &lt;connections&gt; &lt;id&gt;749166ab-5510-31a0-0000-000000000000&lt;/id&gt; &lt;parentGroupId&gt;5db4d3b6-1a02-390f-0000-000000000000&lt;/parentGroupId&gt; &lt;backPressureDataSizeThreshold&gt;1 GB&lt;/backPressureDataSizeThreshold&gt; &lt;backPressureObjectThreshold&gt;10000&lt;/backPressureObjectThreshold&gt; &lt;destination&gt; &lt;groupId&gt;5db4d3b6-1a02-390f-0000-000000000000&lt;/groupId&gt; &lt;id&gt;4ed7dc7e-f06c-3a69-0000-000000000000&lt;/id&gt; &lt;type&gt;PROCESSOR&lt;/type&gt; &lt;/destination&gt; &lt;flowFileExpiration&gt;0 sec&lt;/flowFileExpiration&gt; &lt;labelIndex&gt;1&lt;/labelIndex&gt; &lt;loadBalanceCompression&gt;DO_NOT_COMPRESS&lt;/loadBalanceCompression&gt; &lt;loadBalancePartitionAttribute&gt;&lt;/loadBalancePartitionAttribute&gt; &lt;loadBalanceStatus&gt;LOAD_BALANCE_NOT_CONFIGURED&lt;/loadBalanceStatus&gt; &lt;loadBalanceStrategy&gt;DO_NOT_LOAD_BALANCE&lt;/loadBalanceStrategy&gt; &lt;name&gt;&lt;/name&gt; &lt;selectedRelationships&gt;success&lt;/selectedRelationships&gt; &lt;source&gt; &lt;groupId&gt;5db4d3b6-1a02-390f-0000-000000000000&lt;/groupId&gt; &lt;id&gt;d80993a9-f700-3ce7-0000-000000000000&lt;/id&gt; &lt;type&gt;PROCESSOR&lt;/type&gt; &lt;/source&gt; &lt;zIndex&gt;0&lt;/zIndex&gt; &lt;/connections&gt; &lt;connections&gt; &lt;id&gt;d7db5fd5-453f-3841-0000-000000000000&lt;/id&gt; &lt;parentGroupId&gt;5db4d3b6-1a02-390f-0000-000000000000&lt;/parentGroupId&gt; &lt;backPressureDataSizeThreshold&gt;1 GB&lt;/backPressureDataSizeThreshold&gt; &lt;backPressureObjectThreshold&gt;10000&lt;/backPressureObjectThreshold&gt; &lt;destination&gt; &lt;groupId&gt;5db4d3b6-1a02-390f-0000-000000000000&lt;/groupId&gt; &lt;id&gt;15c3c2c4-7a5f-332c-0000-000000000000&lt;/id&gt; &lt;type&gt;PROCESSOR&lt;/type&gt; &lt;/destination&gt; &lt;flowFileExpiration&gt;0 sec&lt;/flowFileExpiration&gt; &lt;labelIndex&gt;1&lt;/labelIndex&gt; &lt;loadBalanceCompression&gt;DO_NOT_COMPRESS&lt;/loadBalanceCompression&gt; &lt;loadBalancePartitionAttribute&gt;&lt;/loadBalancePartitionAttribute&gt; &lt;loadBalanceStatus&gt;LOAD_BALANCE_NOT_CONFIGURED&lt;/loadBalanceStatus&gt; &lt;loadBalanceStrategy&gt;DO_NOT_LOAD_BALANCE&lt;/loadBalanceStrategy&gt; &lt;name&gt;&lt;/name&gt; &lt;selectedRelationships&gt;success&lt;/selectedRelationships&gt; &lt;source&gt; &lt;groupId&gt;5db4d3b6-1a02-390f-0000-000000000000&lt;/groupId&gt; &lt;id&gt;4ed7dc7e-f06c-3a69-0000-000000000000&lt;/id&gt; &lt;type&gt;PROCESSOR&lt;/type&gt; &lt;/source&gt; &lt;zIndex&gt;0&lt;/zIndex&gt; &lt;/connections&gt; &lt;processors&gt; &lt;id&gt;15c3c2c4-7a5f-332c-0000-000000000000&lt;/id&gt; &lt;parentGroupId&gt;5db4d3b6-1a02-390f-0000-000000000000&lt;/parentGroupId&gt; &lt;position&gt; &lt;x&gt;-10784.0&lt;/x&gt; &lt;y&gt;-5800.0&lt;/y&gt; &lt;/position&gt; &lt;bundle&gt; &lt;artifact&gt;nifi-standard-nar&lt;/artifact&gt; &lt;group&gt;org.apache.nifi&lt;/group&gt; &lt;version&gt;1.11.4&lt;/version&gt; &lt;/bundle&gt; &lt;config&gt; &lt;bulletinLevel&gt;WARN&lt;/bulletinLevel&gt; &lt;comments&gt;&lt;/comments&gt; &lt;concurrentlySchedulableTaskCount&gt;1&lt;/concurrentlySchedulableTaskCount&gt; &lt;descriptors&gt; &lt;entry&gt; &lt;key&gt;Group&lt;/key&gt; &lt;value&gt; &lt;name&gt;Group&lt;/name&gt; &lt;/value&gt; &lt;/entry&gt; &lt;entry&gt; &lt;key&gt;Owner&lt;/key&gt; &lt;value&gt; &lt;name&gt;Owner&lt;/name&gt; &lt;/value&gt; &lt;/entry&gt; &lt;entry&gt; &lt;key&gt;Create Missing Directories&lt;/key&gt; &lt;value&gt; &lt;name&gt;Create Missing Directories&lt;/name&gt; &lt;/value&gt; &lt;/entry&gt; &lt;entry&gt; &lt;key&gt;Permissions&lt;/key&gt; &lt;value&gt; &lt;name&gt;Permissions&lt;/name&gt; &lt;/value&gt; &lt;/entry&gt; &lt;entry&gt; &lt;key&gt;Maximum File Count&lt;/key&gt; &lt;value&gt; &lt;name&gt;Maximum File Count&lt;/name&gt; &lt;/value&gt; &lt;/entry&gt; &lt;entry&gt; &lt;key&gt;Last Modified Time&lt;/key&gt; &lt;value&gt; &lt;name&gt;Last Modified Time&lt;/name&gt; &lt;/value&gt; &lt;/entry&gt; &lt;entry&gt; &lt;key&gt;Directory&lt;/key&gt; &lt;value&gt; &lt;name&gt;Directory&lt;/name&gt; &lt;/value&gt; &lt;/entry&gt; &lt;entry&gt; &lt;key&gt;Conflict Resolution Strategy&lt;/key&gt; &lt;value&gt; &lt;name&gt;Conflict Resolution Strategy&lt;/name&gt; &lt;/value&gt; &lt;/entry&gt; &lt;/descriptors&gt; &lt;executionNode&gt;ALL&lt;/executionNode&gt; &lt;lossTolerant&gt;false&lt;/lossTolerant&gt; &lt;penaltyDuration&gt;30 sec&lt;/penaltyDuration&gt; &lt;properties&gt; &lt;entry&gt; &lt;key&gt;Group&lt;/key&gt; &lt;/entry&gt; &lt;entry&gt; &lt;key&gt;Owner&lt;/key&gt; &lt;/entry&gt; &lt;entry&gt; &lt;key&gt;Create Missing Directories&lt;/key&gt; &lt;value&gt;true&lt;/value&gt; &lt;/entry&gt; &lt;entry&gt; &lt;key&gt;Permissions&lt;/key&gt; &lt;/entry&gt; &lt;entry&gt; &lt;key&gt;Maximum File Count&lt;/key&gt; &lt;/entry&gt; &lt;entry&gt; &lt;key&gt;Last Modified Time&lt;/key&gt; &lt;/entry&gt; &lt;entry&gt; &lt;key&gt;Directory&lt;/key&gt; &lt;value&gt;C://seetha/syniverse/mediationsystem/output/&lt;/value&gt; &lt;/entry&gt; &lt;entry&gt; &lt;key&gt;Conflict Resolution Strategy&lt;/key&gt; &lt;value&gt;fail&lt;/value&gt; &lt;/entry&gt; &lt;/properties&gt; &lt;runDurationMillis&gt;0&lt;/runDurationMillis&gt; &lt;schedulingPeriod&gt;0 sec&lt;/schedulingPeriod&gt; &lt;schedulingStrategy&gt;TIMER_DRIVEN&lt;/schedulingStrategy&gt; &lt;yieldDuration&gt;1 sec&lt;/yieldDuration&gt; &lt;/config&gt; &lt;executionNodeRestricted&gt;false&lt;/executionNodeRestricted&gt; &lt;name&gt;PutFile&lt;/name&gt; &lt;relationships&gt; &lt;autoTerminate&gt;true&lt;/autoTerminate&gt; &lt;name&gt;failure&lt;/name&gt; &lt;/relationships&gt; &lt;relationships&gt; &lt;autoTerminate&gt;true&lt;/autoTerminate&gt; &lt;name&gt;success&lt;/name&gt; &lt;/relationships&gt; &lt;state&gt;STOPPED&lt;/state&gt; &lt;style/&gt; &lt;type&gt;org.apache.nifi.processors.standard.PutFile&lt;/type&gt; &lt;/processors&gt; &lt;processors&gt; &lt;id&gt;2e4486df-8884-3693-0000-000000000000&lt;/id&gt; &lt;parentGroupId&gt;5db4d3b6-1a02-390f-0000-000000000000&lt;/parentGroupId&gt; &lt;position&gt; &lt;x&gt;-10768.0&lt;/x&gt; &lt;y&gt;-6464.0&lt;/y&gt; &lt;/position&gt; &lt;bundle&gt; &lt;artifact&gt;nifi-standard-nar&lt;/artifact&gt; &lt;group&gt;org.apache.nifi&lt;/group&gt; &lt;version&gt;1.11.4&lt;/version&gt; &lt;/bundle&gt; &lt;config&gt; &lt;bulletinLevel&gt;WARN&lt;/bulletinLevel&gt; &lt;comments&gt;&lt;/comments&gt; &lt;concurrentlySchedulableTaskCount&gt;1&lt;/concurrentlySchedulableTaskCount&gt; &lt;descriptors&gt; &lt;entry&gt; &lt;key&gt;Keep Source File&lt;/key&gt; &lt;value&gt; &lt;name&gt;Keep Source File&lt;/name&gt; &lt;/value&gt; &lt;/entry&gt; &lt;entry&gt; &lt;key&gt;Minimum File Age&lt;/key&gt; &lt;value&gt; &lt;name&gt;Minimum File Age&lt;/name&gt; &lt;/value&gt; &lt;/entry&gt; &lt;entry&gt; &lt;key&gt;Polling Interval&lt;/key&gt; &lt;value&gt; &lt;name&gt;Polling Interval&lt;/name&gt; &lt;/value&gt; &lt;/entry&gt; &lt;entry&gt; &lt;key&gt;Input Directory&lt;/key&gt; &lt;value&gt; &lt;name&gt;Input Directory&lt;/name&gt; &lt;/value&gt; &lt;/entry&gt; &lt;entry&gt; &lt;key&gt;Maximum File Age&lt;/key&gt; &lt;value&gt; &lt;name&gt;Maximum File Age&lt;/name&gt; &lt;/value&gt; &lt;/entry&gt; &lt;entry&gt; &lt;key&gt;Batch Size&lt;/key&gt; &lt;value&gt; &lt;name&gt;Batch Size&lt;/name&gt; &lt;/value&gt; &lt;/entry&gt; &lt;entry&gt; &lt;key&gt;Maximum File Size&lt;/key&gt; &lt;value&gt; &lt;name&gt;Maximum File Size&lt;/name&gt; &lt;/value&gt; &lt;/entry&gt; &lt;entry&gt; &lt;key&gt;Minimum File Size&lt;/key&gt; &lt;value&gt; &lt;name&gt;Minimum File Size&lt;/name&gt; &lt;/value&gt; &lt;/entry&gt; &lt;entry&gt; &lt;key&gt;Ignore Hidden Files&lt;/key&gt; &lt;value&gt; &lt;name&gt;Ignore Hidden Files&lt;/name&gt; &lt;/value&gt; &lt;/entry&gt; &lt;entry&gt; &lt;key&gt;Recurse Subdirectories&lt;/key&gt; &lt;value&gt; &lt;name&gt;Recurse Subdirectories&lt;/name&gt; &lt;/value&gt; &lt;/entry&gt; &lt;entry&gt; &lt;key&gt;File Filter&lt;/key&gt; &lt;value&gt; &lt;name&gt;File Filter&lt;/name&gt; &lt;/value&gt; &lt;/entry&gt; &lt;entry&gt; &lt;key&gt;Path Filter&lt;/key&gt; &lt;value&gt; &lt;name&gt;Path Filter&lt;/name&gt; &lt;/value&gt; &lt;/entry&gt; &lt;/descriptors&gt; &lt;executionNode&gt;ALL&lt;/executionNode&gt; &lt;lossTolerant&gt;false&lt;/lossTolerant&gt; &lt;penaltyDuration&gt;30 sec&lt;/penaltyDuration&gt; &lt;properties&gt; &lt;entry&gt; &lt;key&gt;Keep Source File&lt;/key&gt; &lt;value&gt;false&lt;/value&gt; &lt;/entry&gt; &lt;entry&gt; &lt;key&gt;Minimum File Age&lt;/key&gt; &lt;value&gt;0 sec&lt;/value&gt; &lt;/entry&gt; &lt;entry&gt; &lt;key&gt;Polling Interval&lt;/key&gt; &lt;value&gt;0 sec&lt;/value&gt; &lt;/entry&gt; &lt;entry&gt; &lt;key&gt;Input Directory&lt;/key&gt; &lt;value&gt;C://seetha/syniverse/mediationsystem/input/&lt;/value&gt; &lt;/entry&gt; &lt;entry&gt; &lt;key&gt;Maximum File Age&lt;/key&gt; &lt;/entry&gt; &lt;entry&gt; &lt;key&gt;Batch Size&lt;/key&gt; &lt;value&gt;10&lt;/value&gt; &lt;/entry&gt; &lt;entry&gt; &lt;key&gt;Maximum File Size&lt;/key&gt; &lt;/entry&gt; &lt;entry&gt; &lt;key&gt;Minimum File Size&lt;/key&gt; &lt;value&gt;0 B&lt;/value&gt; &lt;/entry&gt; &lt;entry&gt; &lt;key&gt;Ignore Hidden Files&lt;/key&gt; &lt;value&gt;true&lt;/value&gt; &lt;/entry&gt; &lt;entry&gt; &lt;key&gt;Recurse Subdirectories&lt;/key&gt; &lt;value&gt;true&lt;/value&gt; &lt;/entry&gt; &lt;entry&gt; &lt;key&gt;File Filter&lt;/key&gt; &lt;value&gt;[^\.].*&lt;/value&gt; &lt;/entry&gt; &lt;entry&gt; &lt;key&gt;Path Filter&lt;/key&gt; &lt;/entry&gt; &lt;/properties&gt; &lt;runDurationMillis&gt;0&lt;/runDurationMillis&gt; &lt;schedulingPeriod&gt;0 sec&lt;/schedulingPeriod&gt; &lt;schedulingStrategy&gt;TIMER_DRIVEN&lt;/schedulingStrategy&gt; &lt;yieldDuration&gt;1 sec&lt;/yieldDuration&gt; &lt;/config&gt; &lt;executionNodeRestricted&gt;false&lt;/executionNodeRestricted&gt; &lt;name&gt;GetFile&lt;/name&gt; &lt;relationships&gt; &lt;autoTerminate&gt;false&lt;/autoTerminate&gt; &lt;name&gt;success&lt;/name&gt; &lt;/relationships&gt; &lt;state&gt;STOPPED&lt;/state&gt; &lt;style/&gt; &lt;type&gt;org.apache.nifi.processors.standard.GetFile&lt;/type&gt; &lt;/processors&gt; &lt;processors&gt; &lt;id&gt;4ed7dc7e-f06c-3a69-0000-000000000000&lt;/id&gt; &lt;parentGroupId&gt;5db4d3b6-1a02-390f-0000-000000000000&lt;/parentGroupId&gt; &lt;position&gt; &lt;x&gt;-10776.0&lt;/x&gt; &lt;y&gt;-6024.0&lt;/y&gt; &lt;/position&gt; &lt;bundle&gt; &lt;artifact&gt;nifi-update-attribute-nar&lt;/artifact&gt; &lt;group&gt;org.apache.nifi&lt;/group&gt; &lt;version&gt;1.11.4&lt;/version&gt; &lt;/bundle&gt; &lt;config&gt; &lt;bulletinLevel&gt;WARN&lt;/bulletinLevel&gt; &lt;comments&gt;&lt;/comments&gt; &lt;concurrentlySchedulableTaskCount&gt;1&lt;/concurrentlySchedulableTaskCount&gt; &lt;descriptors&gt; &lt;entry&gt; &lt;key&gt;Delete Attributes Expression&lt;/key&gt; &lt;value&gt; &lt;name&gt;Delete Attributes Expression&lt;/name&gt; &lt;/value&gt; &lt;/entry&gt; &lt;entry&gt; &lt;key&gt;filename&lt;/key&gt; &lt;value&gt; &lt;name&gt;filename&lt;/name&gt; &lt;/value&gt; &lt;/entry&gt; &lt;entry&gt; &lt;key&gt;Store State&lt;/key&gt; &lt;value&gt; &lt;name&gt;Store State&lt;/name&gt; &lt;/value&gt; &lt;/entry&gt; &lt;entry&gt; &lt;key&gt;canonical-value-lookup-cache-size&lt;/key&gt; &lt;value&gt; &lt;name&gt;canonical-value-lookup-cache-size&lt;/name&gt; &lt;/value&gt; &lt;/entry&gt; &lt;entry&gt; &lt;key&gt;Stateful Variables Initial Value&lt;/key&gt; &lt;value&gt; &lt;name&gt;Stateful Variables Initial Value&lt;/name&gt; &lt;/value&gt; &lt;/entry&gt; &lt;/descriptors&gt; &lt;executionNode&gt;ALL&lt;/executionNode&gt; &lt;lossTolerant&gt;false&lt;/lossTolerant&gt; &lt;penaltyDuration&gt;30 sec&lt;/penaltyDuration&gt; &lt;properties&gt; &lt;entry&gt; &lt;key&gt;Delete Attributes Expression&lt;/key&gt; &lt;/entry&gt; &lt;entry&gt; &lt;key&gt;filename&lt;/key&gt; &lt;value&gt;${filename}.json&lt;/value&gt; &lt;/entry&gt; &lt;entry&gt; &lt;key&gt;Store State&lt;/key&gt; &lt;value&gt;Do not store state&lt;/value&gt; &lt;/entry&gt; &lt;entry&gt; &lt;key&gt;canonical-value-lookup-cache-size&lt;/key&gt; &lt;value&gt;100&lt;/value&gt; &lt;/entry&gt; &lt;entry&gt; &lt;key&gt;Stateful Variables Initial Value&lt;/key&gt; &lt;/entry&gt; &lt;/properties&gt; &lt;runDurationMillis&gt;0&lt;/runDurationMillis&gt; &lt;schedulingPeriod&gt;0 sec&lt;/schedulingPeriod&gt; &lt;schedulingStrategy&gt;TIMER_DRIVEN&lt;/schedulingStrategy&gt; &lt;yieldDuration&gt;1 sec&lt;/yieldDuration&gt; &lt;/config&gt; &lt;executionNodeRestricted&gt;false&lt;/executionNodeRestricted&gt; &lt;name&gt;UpdateAttribute&lt;/name&gt; &lt;relationships&gt; &lt;autoTerminate&gt;false&lt;/autoTerminate&gt; &lt;name&gt;success&lt;/name&gt; &lt;/relationships&gt; &lt;state&gt;STOPPED&lt;/state&gt; &lt;style/&gt; &lt;type&gt;org.apache.nifi.processors.attributes.UpdateAttribute&lt;/type&gt; &lt;/processors&gt; &lt;processors&gt; &lt;id&gt;d80993a9-f700-3ce7-0000-000000000000&lt;/id&gt; &lt;parentGroupId&gt;5db4d3b6-1a02-390f-0000-000000000000&lt;/parentGroupId&gt; &lt;position&gt; &lt;x&gt;-10768.0&lt;/x&gt; &lt;y&gt;-6240.0&lt;/y&gt; &lt;/position&gt; &lt;bundle&gt; &lt;artifact&gt;nifi-standard-nar&lt;/artifact&gt; &lt;group&gt;org.apache.nifi&lt;/group&gt; &lt;version&gt;1.11.4&lt;/version&gt; &lt;/bundle&gt; &lt;config&gt; &lt;bulletinLevel&gt;WARN&lt;/bulletinLevel&gt; &lt;comments&gt;&lt;/comments&gt; &lt;concurrentlySchedulableTaskCount&gt;1&lt;/concurrentlySchedulableTaskCount&gt; &lt;descriptors&gt; &lt;entry&gt; &lt;key&gt;record-writer&lt;/key&gt; &lt;value&gt; &lt;identifiesControllerService&gt;org.apache.nifi.serialization.RecordSetWriterFactory&lt;/identifiesControllerService&gt; &lt;name&gt;record-writer&lt;/name&gt; &lt;/value&gt; &lt;/entry&gt; &lt;entry&gt; &lt;key&gt;record-reader&lt;/key&gt; &lt;value&gt; &lt;identifiesControllerService&gt;org.apache.nifi.serialization.RecordReaderFactory&lt;/identifiesControllerService&gt; &lt;name&gt;record-reader&lt;/name&gt; &lt;/value&gt; &lt;/entry&gt; &lt;entry&gt; &lt;key&gt;include-zero-record-flowfiles&lt;/key&gt; &lt;value&gt; &lt;name&gt;include-zero-record-flowfiles&lt;/name&gt; &lt;/value&gt; &lt;/entry&gt; &lt;/descriptors&gt; &lt;executionNode&gt;ALL&lt;/executionNode&gt; &lt;lossTolerant&gt;false&lt;/lossTolerant&gt; &lt;penaltyDuration&gt;30 sec&lt;/penaltyDuration&gt; &lt;properties&gt; &lt;entry&gt; &lt;key&gt;record-writer&lt;/key&gt; &lt;value&gt;f3c04453-2b4a-37bc-0000-000000000000&lt;/value&gt; &lt;/entry&gt; &lt;entry&gt; &lt;key&gt;record-reader&lt;/key&gt; &lt;value&gt;5f712eb5-b76b-3e9f-0000-000000000000&lt;/value&gt; &lt;/entry&gt; &lt;entry&gt; &lt;key&gt;include-zero-record-flowfiles&lt;/key&gt; &lt;value&gt;true&lt;/value&gt; &lt;/entry&gt; &lt;/properties&gt; &lt;runDurationMillis&gt;0&lt;/runDurationMillis&gt; &lt;schedulingPeriod&gt;0 sec&lt;/schedulingPeriod&gt; &lt;schedulingStrategy&gt;TIMER_DRIVEN&lt;/schedulingStrategy&gt; &lt;yieldDuration&gt;1 sec&lt;/yieldDuration&gt; &lt;/config&gt; &lt;executionNodeRestricted&gt;false&lt;/executionNodeRestricted&gt; &lt;name&gt;ConvertRecord&lt;/name&gt; &lt;relationships&gt; &lt;autoTerminate&gt;true&lt;/autoTerminate&gt; &lt;name&gt;failure&lt;/name&gt; &lt;/relationships&gt; &lt;relationships&gt; &lt;autoTerminate&gt;false&lt;/autoTerminate&gt; &lt;name&gt;success&lt;/name&gt; &lt;/relationships&gt; &lt;state&gt;STOPPED&lt;/state&gt; &lt;style/&gt; &lt;type&gt;org.apache.nifi.processors.standard.ConvertRecord&lt;/type&gt; &lt;/processors&gt; &lt;/contents&gt; &lt;name&gt;sprint7PocDemo&lt;/name&gt; &lt;variables/&gt; &lt;/processGroups&gt; &lt;/snippet&gt; &lt;timestamp&gt;05/21/2020 17:21:25 IST&lt;/timestamp&gt; &lt;/template&gt;</LI-CODE><P>&nbsp;</P><P>Please guide me how to proceed the aggregation for the given json</P><P>&nbsp;</P><P>Thanks &amp; Regards,</P><P>P.Seetha</P><P>&nbsp;</P><P>&nbsp;</P><P>&nbsp;</P> Thu, 28 May 2020 08:32:00 GMT https://community.cloudera.com/t5/Support-Questions/Apache-Nifi-to-do-aggregation-for-the-given-transformed-json/m-p/296764#M218404 Seetha 2020-05-28T08:32:00Z Re: Apache Nifi to do aggregation for the given transformed json based on attribute name in the json https://community.cloudera.com/t5/Support-Questions/Apache-Nifi-to-do-aggregation-for-the-given-transformed-json/m-p/301425#M220659 <P>Nifi is not really designed to work with 'context'. If you have a simple record there are many operations which you can do, but if you are working with potentially complex files and thus complex operations, you will likely rather process them with something like spark or python.</P> Thu, 13 Aug 2020 11:33:56 GMT https://community.cloudera.com/t5/Support-Questions/Apache-Nifi-to-do-aggregation-for-the-given-transformed-json/m-p/301425#M220659 DennisJaheruddi 2020-08-13T11:33:56Z Re: Apache Nifi to do aggregation for the given transformed json based on attribute name in the json https://community.cloudera.com/t5/Support-Questions/Apache-Nifi-to-do-aggregation-for-the-given-transformed-json/m-p/301432#M220666 <P><a href="https://community.cloudera.com/t5/user/viewprofilepage/user-id/78451">@Seetha</a>&nbsp;This is a very common use case for NiFi and JSON processing pipelines.</P><P>&nbsp;</P><P>Here is a link that explains a solution (ExecuteScript) you could use:</P><P>&nbsp;</P><P><A href="https://community.cloudera.com/t5/Support-Questions/Apache-Nifi-How-to-calculate-SUM-or-AVERAGE-of-values-in-a/td-p/164131" target="_blank">https://community.cloudera.com/t5/Support-Questions/Apache-Nifi-How-to-calculate-SUM-or-AVERAGE-of-values-in-a/td-p/164131</A></P><P>&nbsp;</P><P>Additional&nbsp;<a href="https://community.cloudera.com/t5/user/viewprofilepage/user-id/38301">@mburgess</a>&nbsp;&nbsp;in that posts links a JIRA for a new Processor he was trying to work on at the time. &nbsp;The end result of that JIRA is his recommendation that QueryRecord processor should give you the ability to calculate the sum. &nbsp; Using QueryRecord you would read the values and be able to create a fabricated sql query to calculate the sums. &nbsp;Then you would use a RecordWriter to re-write the orginal json object with the sums, or to create completely different json object with the sums.</P><P>&nbsp;</P><P>&nbsp;</P><P>If this answer resolves your issue or allows you to move forward, please choose to ACCEPT this solution and close this topic. If you have further dialogue on this topic please comment here or feel free to private message me. If you have new questions related to your Use Case please create separate topic and feel free to tag me in your post. &nbsp;</P><P>&nbsp;</P><P>Thanks,</P><P><BR />Steven&nbsp;@ DFHZ</P> Thu, 13 Aug 2020 12:04:08 GMT https://community.cloudera.com/t5/Support-Questions/Apache-Nifi-to-do-aggregation-for-the-given-transformed-json/m-p/301432#M220666 stevenmatison 2020-08-13T12:04:08Z Re: Apache Nifi to do aggregation for the given transformed json based on attribute name in the json https://community.cloudera.com/t5/Support-Questions/Apache-Nifi-to-do-aggregation-for-the-given-transformed-json/m-p/301442#M220674 <P><a href="https://community.cloudera.com/t5/user/viewprofilepage/user-id/31428">@DennisJaheruddi</a>&nbsp; Thanks Dennis.I tried to use QueryRecord ,it helped to get the count.</P><P>-Seetha</P> Thu, 13 Aug 2020 13:46:16 GMT https://community.cloudera.com/t5/Support-Questions/Apache-Nifi-to-do-aggregation-for-the-given-transformed-json/m-p/301442#M220674 Seetha 2020-08-13T13:46:16Z Re: Apache Nifi to do aggregation for the given transformed json based on attribute name in the json https://community.cloudera.com/t5/Support-Questions/Apache-Nifi-to-do-aggregation-for-the-given-transformed-json/m-p/301443#M220675 <P><a href="https://community.cloudera.com/t5/user/viewprofilepage/user-id/60150">@stevenmatison</a>&nbsp; Thanks .I used QueryRecord ,it helped to get count .</P> Thu, 13 Aug 2020 13:51:25 GMT https://community.cloudera.com/t5/Support-Questions/Apache-Nifi-to-do-aggregation-for-the-given-transformed-json/m-p/301443#M220675 Seetha 2020-08-13T13:51:25Z