@venkii This was a known issue in some older releases. See the following post:   https://community.cloudera.com/t5/Support-Questions/How-to-enable-LDAP-Group-Authorization-for-Nifi-in-Ranger/td-p/149264 ... View more

@shrikant_bm You need to complete required setup for hive database and user in Postgres:   FATAL: no pg_hba.conf entry for host "192.168.0.109", user "hive", database "hive",  Once you make the required changes and restart Postgres, your error will go away.   More about this here:   https://community.cloudera.com/t5/Support-Questions/HDP-Ambari-installation-throws-quot-org-postgresql-util/m-p/277977   Or search our community for other post about same issue:   https://community.cloudera.com/t5/forums/searchpage/tab/message?advanced=false&allow_punctuation=false&q=pg_hba.conf     If this answer resolves your issue or allows you to move forward, please choose to ACCEPT this solution and close this topic. If you have further dialogue on this topic please comment here or feel free to private message me. If you have new questions related to your Use Case please create separate topic and feel free to tag me in your post.     Thanks, Steven @ DFHZ ... View more

@renuu   RouteOnAttribute is the method to do this.  You will need to use EvaluateJsonPath to get the attributes you want to route on. For Example: checkResource = $.alarms.resource  Then code off that attribute in RouteOnAttribute: ${checkResource:equals('abc')}  Also be sure to use valid json.  In your post above,  the snippet is incorrect format with spelling errors.  See my other reply for more info on JSON Validation as well as input on EvaluateJSON.     If this answer resolves your issue or allows you to move forward, please choose to ACCEPT this solution and close this topic. If you have further dialogue on this topic please comment here or feel free to private message me. If you have new questions related to your Use Case please create separate topic and feel free to tag me in your post.     Thanks, Steven @ DFHZ ... View more

@vikrant_kumar24   To add new attributes to a flow file you should use UpdateAttribute.  To get attributes from json you should use EvaluateJsonPath.  Once you have all the values you want as attributes you should use AttributesToJson and then finally send the json to invokeHttp.   Your flow will look like this:   And the Queued Flowfile waiting on InvokeHttp is:   Please note I did not have your original Json, just the schema above, so I created a simple JSON of the Longitute & Latitude values you gave me.    I also did not touch InvokeHttp, its default.   Once you get this far, and want to work on handling the response from InvokeHttp let me know here, in another post, or a private message.   To see my entire template, check out my GitHub for the Invoke Http Demo 2 Template:   https://github.com/steven-dfheinz/NiFi-Templates     If this answer resolves your issue or allows you to move forward, please choose to ACCEPT this solution and close this topic. If you have further dialogue on this topic please comment here or feel free to private message me. If you have new questions related to your Use Case please create separate topic and feel free to tag me in your post.     Thanks, Steven @ DFHZ ... View more

@keithg  If you change the 1 sec to 15 sec or 30 sec does it become more stable?   With the schedule set to 1 sec, invokeHttp will execute 1600 connections as fast as possible.  This opens up quite a bit of room for either exceeding the capabilities of your environment (not enough nodes, ram or cores) or the upstream service you are connecting too (actual network issues with the workload).   Since you only have 2 cores, you need to sensitive to tuning the flow, and most likely need to go slower (ie not 1 sec).  You should also investigate documented NiFi Performance Tuning Steps, adding a lot more cores, adding more ram to each node including min ram: 2-6 gb max ram: 4-8-16 gb, and/or adjusting Garbage Collection. ... View more

@keithg Can you update the post with the scheduling settings for InvokeHttp?  Also would nice to see  some specific details about the nifi environment (min/max memory settings, nifi node spec, disk config, etc) and setting for min/max threads?   Without taking those things in consideration, I would assume you are overloading capability resulting in instability you are experiencing.  If you slow down the scheduling and consume the incoming queue at a slower rate, does the timeout persist? ... View more

@arunnalpet You should be able to just add the $. If it doesn't work, maybe have to escape it:  \$ ... View more