@Purnima Kuchikulla As @Attila Kanto mentioned, Nifi is not supported in HDC, in HDC there are predefined HDP blueprints only. The cloudbreak team is working on HDF support in Cloudbreak: https://hortonworks.jira.com/browse/RMP-10082. It is planned to release in Cloudbreak 2.5 or later. ... View more

sure, no problem ... View more

If a single flow file contains an array and you want to manipulate values within, then @Andy LoPresto's solution is recommended. From your comment on his answer it appears you want to compute the average across multiple flow files. From a flow perspective, how would you know when you were "done" calculating the average? Will you have a running average that is calculated from sum-so-far and count-so-far? Or do you want to take X flow files in, calculate the average, then output the X flow files (or perhaps a single one) with the average for those X flow files? NiFi 1.2.0 (having implemented NIFI-1582) will include the ability to store and calculate state using UpdateAttribute. This can be used to maintain "sum" and "count" attributes, which at any given point would let you calculate the running average. In the meantime (or alternatively), you could use ExecuteScript or InvokeScriptedProcessor to perform this same function. It would be similar to Andy's approach, but would also store the sum-so-far and count-so-far into the processor's State Map. If you are calculating a running average and want to output each flow file as it comes in (adding a "current average" attribute for example), you can use ExecuteScript. If you want to keep the incoming flow files until a total average can be calculated, then you'd need InvokeScriptedProcessor. ... View more

Hi All, even i too need one simple example how to set mail alerts with business logic when something went wrong in NIFI. if possible share one sample link. I am very new to NIFI, now i need this requirement to my current support project, Thanks in advance. ... View more

@Michael Silas Once you have a running cluster you shouldn't have to modify the authorizers.xml, authorizations.xml, and users.xml to add a new node. There are two different ways you could do it.. Approach #1 1) Generate a cert for your new node 2) Go to your existing cluster and using the UI, add a new user with the DN from the cert for the new node 3) Grant the new user the policy for "proxy requests" 4) On the new node, leave the initial admin and all node identities blank, then start this node and it will since it will have 0 users and 0 policies and no flow, it will inherit everything from the cluster. Approach #2 1) Generate a cert for your new node 2) On the new node make the authorizers.xml exactly the same as the existing cluster... meaning if you had a 3 node cluster and you are adding the fourth node, put only the 3 existing nodes as the identity and the same initial admin, this way it generates exactly the same users and policies as the running cluster which is required for it to join. 3) At this point you should be able to start the new node and have it join the cluster 4) Go into the UI and add the user for the new node and add the user to "proxy requests" policy This blog post describes approach #2: https://pierrevillard.com/2016/11/30/scaling-updown-a-nifi-cluster/ Overall, in order to join the cluster a new node needs one of the following conditions: - The exact same users, groups, policies, and flow as the cluster - No users, no groups, no policies, and no flow, in which case it will inherit everything from the cluster ... View more

It is still considered an unstable beta release so it is not recommended for production, but it is stable enough to run in a test/dev environment. Can't really say a specific timeline, but shouldn't be too far away. The community is already working on remaining issues and anything found from testing the beta. ... View more

Hi, Could you please let me know how the resetting of target signal count in wait processor work? Refer my question: https://community.hortonworks.com/questions/138762/reset-of-target-signal-count-in-wait-processor.html Thanks, John ... View more

yeah thanks.. append works.. \\n (double backslash) doesnt.. I was doing this while writing count to file.. it now works.. The count is: ${executesql.row.count:append('\n')} ... View more