@mayki wogno The workflow displayed on the canvas is executed on each node of your cluster. Consequently, unless you have configured your GetHDFS processor to run on primary node only (in the scheduling tag of your processor configuration), each node of your cluster will get file from HDFS. This can create race condition and you should set your processor to run on primary node only. In this case, in your cluster page description, you can know which node has been elected as the primary node. In order to balance the load when getting files from HDFS you may want to use the combination of List/FetchHDFS processors. The ListHDFS processor will create one flow file per listed file with the path of the file, and the FetchHDFS processor will actually get the file from HDFS. By using a Remote Process Group in your canvas you can actually evenly spread your flow files between your nodes and each node will be assigned different files to fetch from HDFS. You can find an example of what I mean at the end of this HCC article: https://community.hortonworks.com/content/kbentry/55349/nifi-100-unsecured-cluster-setup.html Hope this helps. ... View more

@David Cuny, All the information you are looking for should be provided by the person in charge of setting the SNMP agent you are requesting. It depends of how is configured the SNMP agent on the device you are requesting. The OID is the "address" of the information you want to retrieve. Let's say you want to get the current CPU use of the device you want to monitor, then you have to know the OID of this information (usually it is provided with the device in a MIB). Some of widely used OIDs can be found on this blog for example: http://www.debianadmin.com/linux-snmp-oids-for-cpumemory-and-disk-statistics.html Hope this helps. ... View more

@Frank Maritato You have the good approach, and IMO it should work. I have followed a similar approach in this blog: https://pierrevillard.com/2016/04/04/analyze-flickr-account-using-apache/ In your screenshot, all your processors are stopped. When started do you have errors in your InvokeHTTP processor? Can you inspect the requests sent to be sure the increment is done correctly? Hope this helps. ... View more

@Mohan V Yes, MergeContent would be a solution to your problem. You have to use it before the PutFile processor in order to merge multiple flow files (each containing one json) into one flow file (containing multiple json). You may want to have a look at the documentation here: https://nifi.apache.org/docs/nifi-docs/components/org.apache.nifi.processors.standard.MergeContent/index.html In particular you have a property specifying the number of JSON you want to be merged into one single file: 'Minimum Number of Entries' As a side note, when you have a processor on your canvas, you can right click on it and go to 'Usage' to display the documentation of the processor. Hope this helps. ... View more