I too faced the same issue, I enabled stickyness on my Load balancer targetGroup and it worked!! Hompe thims hempls... ... View more

Hi @cotopaul , Thanks for the input, can you help on how to setup the invokeHTTP processor and how to fetch all the queues that we were not able to find in the Mongo DB. ... View more

To do the split , you need to transform the json input into a format that allows you to do so, for that you can use JoltTransformationJson with the following Jolt Specification: [ { "operation": "modify-overwrite-beta", "spec": { "ids": "=split('[,]',@(1,id))" } }, { "operation": "shift", "spec": { "ids": { "*": { "@": "[&1].id", "@(2,Qid)": "[&1].Qid" } } } } ] The spec above will generate the following output: [ { "id": "652fbf430f1f3f30a3111f11", "Qid": 123 }, { "id": "652fbf430f1f3f30a3333f11", "Qid": 123 } ] Then you can use SplitJson processor where the JsonPath Expression is set to $ To get the id attribute you can use EvaluateJsonPath as follows: The flowfile_id is dynamic property where the value is the json path to the id of the json input. Make sure to set the Destination property to "flowfile-attribute". If that helps please accept solution. Thanks       ... View more

@Fanxxx, How I would do the first POC: 1) GetMongoRecord: execute the count on the first table. Using the property "Query Output Attribute" you save that value directly as an attribute. 2) connected to the success queue another GetMongoRecord: execute the count on the second table. Using the property "Query Output Attribute" you save that value directly as an attribute.  3) connected to the success queue an RouteOnAttribute: here you define a rules --> if count1=count2, do what you want to do, otherwise call the logic for the insert, as you said. (using NiFi Expression language: ${attribute1:equals(${attribute2})} ) ... View more

If you download the Postgres JDBC driver's you can leverage any of the SQL processors to query Postgres directly instead of using pgdump.    https://jdbc.postgresql.org/download/ ... View more

@Fanxxx, First of all, make sure that nothing is running on the port 2182, as this is the port used by the embedded Zookeeper by default. It could be that you changed it, but my initial feeling is that you left it as it is. Secondly, make sure that you wrote the correct zookeeper connection string within state-management.xml and within each nifi.properties. ... View more